What makes a good fallback model?
One that covers the same required capabilities and stays healthy enough under load. The checker confirms both before you wire it into a routing policy.
/ tools / cz / llm-routing-health-checker
LLM Routing Health Checker
Check primary and fallback fit from health and capabilities.
Check whether a model fits as a primary or fallback route from its health, success rate, latency, and required capabilities — so your routing policy degrades gracefully instead of failing under load.
- Test primary and fallback fit against required capabilities
- Factor in success rate and p50/p95 latency
- Catch capability gaps before they hit production
Routing Health
Vstupy se zpracovavaji v tomto prohlizeci; nevkladejte skutecne API klice.
Diagnosticka zprava
- primaryFit
- true
- fallbackFit
- true
- missingCapabilities
- []
- latencyRange
- [2300,6800]
- successRate
- 0.99
- warnings
- []
FAQ
LLM Routing Health Checker FAQ
How does model routing improve reliability?
Routing sends traffic to a healthy primary and shifts to a fallback when success rate or latency degrades, avoiding single-provider outages.
What if health data is unavailable?
The checker still evaluates capability fit and flags that a live health probe is missing so you can treat the route as fallback-only.
Související nástroje
Dál optimalizujte náklady
Další krok
Použijte report pro další integrační rozhodnutí.
Zkopírujte base URL, porovnejte detaily modelů nebo vytvořte klíč, až budete připraveni na skutečný test kompatibility.