Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Medium
1 of 20
What does the feed-forward (MLP) sub-layer in a transformer block do?
A
Mixes information between tokens
B
Computes the loss
C
Tokenizes text
D
Processes each token's vector independently with two linear layers and a nonlinearity, holding much of the model's knowledge