Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 10
Why is deduplicating pretraining data important?
A
It makes tokenization faster
B
Duplicates are required for RLHF
C
It increases the context window
D
Repeated documents waste compute, encourage memorization (including of private data) and can hurt generalization