What makes a good fallback model?
One that covers the same required capabilities and stays healthy enough under load. The checker confirms both before you wire it into a routing policy.
/ tools / id / llm-routing-health-checker
LLM Routing Health Checker
Check primary and fallback fit from health and capabilities.
Check whether a model fits as a primary or fallback route from its health, success rate, latency, and required capabilities — so your routing policy degrades gracefully instead of failing under load.
- Test primary and fallback fit against required capabilities
- Factor in success rate and p50/p95 latency
- Catch capability gaps before they hit production
Routing Health
Input diproses di browser ini; jangan tempel kunci API asli.
Laporan diagnostik
- primaryFit
- true
- fallbackFit
- true
- missingCapabilities
- []
- latencyRange
- [2300,6800]
- successRate
- 0.99
- warnings
- []
FAQ
LLM Routing Health Checker FAQ
How does model routing improve reliability?
Routing sends traffic to a healthy primary and shifts to a fallback when success rate or latency degrades, avoiding single-provider outages.
What if health data is unavailable?
The checker still evaluates capability fit and flags that a live health probe is missing so you can treat the route as fallback-only.
Alat terkait
Lanjutkan optimasi biaya
Langkah berikutnya
Gunakan laporan ini untuk keputusan integrasi berikutnya.
Salin alamat dasar API, bandingkan detail model, atau buat kunci saat Anda siap untuk uji kompatibilitas nyata.