Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 193
Why should you set max_tokens and timeouts on every LLM call in production?
A
To improve accuracy
B
To make outputs more creative
C
To bound cost and latency, and protect against runaway generations or hung requests
D
Because APIs reject calls without them