Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 216
What is model routing (cascading) in LLM applications?
A
Load balancing identical models only
B
Choosing a tokenizer per request
C
Sending easy requests to a cheap, fast model and escalating hard ones to a stronger model
D
Routing network packets to GPUs