Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 10
Why do decoder-only (GPT-style) models use a causal attention mask?
A
To make attention symmetric
B
So each position only sees earlier tokens; otherwise it could see the token it must predict
C
To save memory
D
To speed up tokenization