Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Medium
1 of 659
How does Byte-Pair Encoding (BPE) build its vocabulary?
A
Hash words into a fixed number of buckets
B
Use one token per sentence
C
Start from bytes/characters and repeatedly merge the most frequent adjacent pair into a new token
D
Assign one token per dictionary word