What makes a good fallback model?
One that covers the same required capabilities and stays healthy enough under load. The checker confirms both before you wire it into a routing policy.
/ tools / vn / llm-routing-health-checker
LLM Routing Health Checker
Check primary and fallback fit from health and capabilities.
Check whether a model fits as a primary or fallback route from its health, success rate, latency, and required capabilities — so your routing policy degrades gracefully instead of failing under load.
- Test primary and fallback fit against required capabilities
- Factor in success rate and p50/p95 latency
- Catch capability gaps before they hit production
Routing Health
Dau vao duoc xu ly trong trinh duyet nay; dung dan khoa API that.
Bao cao chan doan
- primaryFit
- true
- fallbackFit
- true
- missingCapabilities
- []
- latencyRange
- [2300,6800]
- successRate
- 0.99
- warnings
- []
FAQ
LLM Routing Health Checker FAQ
How does model routing improve reliability?
Routing sends traffic to a healthy primary and shifts to a fallback when success rate or latency degrades, avoiding single-provider outages.
What if health data is unavailable?
The checker still evaluates capability fit and flags that a live health probe is missing so you can treat the route as fallback-only.
Cong cu lien quan
Tiep tuc toi uu chi phi
Buoc tiep theo
Dung bao cao nay cho quyet dinh tich hop tiep theo.
Sao chep dia chi nen API, so sanh chi tiet model hoac tao khoa khi ban san sang cho bai kiem tra tuong thich thuc te.