Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 20
What is model routing (cascading) in LLM applications?
A
Sending easy requests to a cheap, fast model and escalating hard ones to a stronger model
B
Load balancing identical models only
C
Choosing a tokenizer per request
D
Routing network packets to GPUs