Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 510
Design: you serve an open-weights 70B model and need lower cost per token. Which levers help most?
A
Lowering the temperature
B
Increasing max_tokens
C
Disabling streaming
D
Quantization, continuous batching, prefix caching, speculative decoding, and routing easy traffic to a smaller model