Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Medium
1 of 10
How does Byte-Pair Encoding (BPE) build its vocabulary?
A
Start from bytes/characters and repeatedly merge the most frequent adjacent pair into a new token
B
Hash words into a fixed number of buckets
C
Use one token per sentence
D
Assign one token per dictionary word