Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 10
What does layer normalization (or RMSNorm) do in transformers?
A
Rescales each token's activation vector to a stable scale, stabilizing training of deep networks
B
Normalizes the dataset
C
Balances GPU load
D
Removes rare tokens