Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 20
What is prompt (prefix) caching?
A
Storing prompts in a database
B
Caching final answers by exact question
C
Compressing prompts with gzip
D
Reusing the computed KV cache for an identical prompt prefix (e.g. a long system prompt) across requests, cutting cost and TTFT