Concept Space
The simplest way to think about language.
Imagine a vertical list of words.
To the right of every word, imagine a list of positions in that sentence that word could be in.
Behind the lists of positions, imagine every sentence in the language that has that word in that position.
"Attention" allows you to count the word in that position in the sentences you've seen as they relate to the other words in those positions.
Luckily, you only need to do this for the words and sentences you've seen in the language.
A concept is the mapping that encodes the relationship between that word on the left and all possible sentences that use that word.
This applies in word space, but the same applies in multimodal space.
Instead of just being the positions of words in sentences, they are the positions of that concept in visual space, auditory space, etc...
This may be what we mean by Concept Space.
