Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 20
What does layer normalization (or RMSNorm) do in transformers?
A
Removes rare tokens
B
Rescales each token's activation vector to a stable scale, stabilizing training of deep networks
C
Normalizes the dataset
D
Balances GPU load