Each word looks at every other word and decides which ones matter for its meaning.
- QueryEach word asks: what am I looking for?
- KeyEach word says: this is what I contain.
- ScoresMatch queries to keys, softmax into weights.
- Mix valuesBlend the words' values by those weights.
- PositionsAdd position signals so order is known.
Explain 1/6
Source: The Illustrated Transformer