Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 10
What is prompt (prefix) caching?
A
Compressing prompts with gzip
B
Storing prompts in a database
C
Reusing the computed KV cache for an identical prompt prefix (e.g. a long system prompt) across requests, cutting cost and TTFT
D
Caching final answers by exact question