Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Medium
1 of 10
What does the feed-forward (MLP) sub-layer in a transformer block do?
A
Mixes information between tokens
B
Processes each token's vector independently with two linear layers and a nonlinearity, holding much of the model's knowledge
C
Tokenizes text
D
Computes the loss