Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 115
What does layer normalization (or RMSNorm) do in transformers?
A
Normalizes the dataset
B
Removes rare tokens
C
Balances GPU load
D
Rescales each token's activation vector to a stable scale, stabilizing training of deep networks