Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 10
What is model routing (cascading) in LLM applications?
A
Routing network packets to GPUs
B
Sending easy requests to a cheap, fast model and escalating hard ones to a stronger model
C
Choosing a tokenizer per request
D
Load balancing identical models only