Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 20
Why do transformers need positional information?
A
To speed up the softmax
B
Attention is permutation-invariant; without positions, word order would be invisible
C
Tokens have no IDs otherwise
D
To reduce vocabulary size