Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 10
What do queries, keys and values represent in self-attention?
A
Query: what a token is looking for; key: what each token offers for matching; value: the information passed on when attended to
B
Position, token and layer
C
Input, output and loss
D
Three copies of the same embedding