Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 20
What is model routing (cascading) in LLM applications?
A
Load balancing identical models only
B
Sending easy requests to a cheap, fast model and escalating hard ones to a stronger model
C
Routing network packets to GPUs
D
Choosing a tokenizer per request