Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Medium
1 of 10
How does Byte-Pair Encoding (BPE) build its vocabulary?
A
Hash words into a fixed number of buckets
B
Assign one token per dictionary word
C
Start from bytes/characters and repeatedly merge the most frequent adjacent pair into a new token
D
Use one token per sentence