Model Orchestration
Once more than one model is in use, or once the cost of sending every request to a frontier model becomes visible on an invoice.
Orchestration routes each task to the model best suited to it, considering the nature of the work, cost, and latency. A single general model applies one cost and latency profile to everything, which means paying frontier prices for classification.
It is also the practical defence against lock-in: when routing sits above providers, capability can move between them as pricing and quality shift.
What the work includes
- Routing rules based on task type rather than team preference
- Cost and latency budgets enforced per route
- Provider-agnostic interfaces so models can be added or replaced
- Measurement of routing decisions against outcome quality