Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 386
What problem does PagedAttention (vLLM) solve?
A
Slow tokenization
B
Model loading time
C
Fragmentation of KV cache memory: it stores KV in fixed-size blocks like virtual-memory pages, allocated on demand
D
Attention numerical overflow