Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 40
What does layer normalization (or RMSNorm) do in transformers?
A
Balances GPU load
B
Normalizes the dataset
C
Rescales each token's activation vector to a stable scale, stabilizing training of deep networks
D
Removes rare tokens