Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 10
Why do transformers need positional information?
A
Attention is permutation-invariant; without positions, word order would be invisible
B
To reduce vocabulary size
C
Tokens have no IDs otherwise
D
To speed up the softmax