Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 40
What do queries, keys and values represent in self-attention?
A
Position, token and layer
B
Three copies of the same embedding
C
Query: what a token is looking for; key: what each token offers for matching; value: the information passed on when attended to
D
Input, output and loss