What makes a good fallback model?
One that covers the same required capabilities and stays healthy enough under load. The checker confirms both before you wire it into a routing policy.
/ tools / in / llm-routing-health-checker
LLM Routing Health Checker
Check primary and fallback fit from health and capabilities.
Check whether a model fits as a primary or fallback route from its health, success rate, latency, and required capabilities — so your routing policy degrades gracefully instead of failing under load.
- Test primary and fallback fit against required capabilities
- Factor in success rate and p50/p95 latency
- Catch capability gaps before they hit production
Routing Health
इनपुट इसी ब्राउज़र में प्रोसेस होते हैं; असली API key पेस्ट न करें।
डायग्नोस्टिक रिपोर्ट
- primaryFit
- true
- fallbackFit
- true
- missingCapabilities
- []
- latencyRange
- [2300,6800]
- successRate
- 0.99
- warnings
- []
FAQ
LLM Routing Health Checker FAQ
How does model routing improve reliability?
Routing sends traffic to a healthy primary and shifts to a fallback when success rate or latency degrades, avoiding single-provider outages.
What if health data is unavailable?
The checker still evaluates capability fit and flags that a live health probe is missing so you can treat the route as fallback-only.
संबंधित टूल
लागत अनुकूलन जारी रखें
अगला कदम
अगले इंटीग्रेशन निर्णय के लिए इस रिपोर्ट का उपयोग करें।
API का बेस पता कॉपी करें, मॉडल विवरण की तुलना करें, या जब आप वास्तविक अनुकूलता जांच के लिए तैयार हों तब एक कुंजी बनाएं।