Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Medium
1 of 10
Why are output tokens usually priced higher than input tokens by LLM APIs?
A
Output tokens are longer
B
Output tokens are stored permanently
C
Input tokens are cached for free forever
D
Each output token needs its own sequential decode step, while input tokens are processed in parallel during prefill