Shortlist models for an OpenAI-compatible LLM gateway: one base_url, multi-provider routing, cost visibility, and sane fallbacks.
An OpenAI-compatible LLM gateway means you keep the OpenAI SDK, point base_url at the gateway, and route across providers from there. You can compare unit cost, add cache or budgets, and fail over without rewriting app code. This ranking is for teams picking default models for that setup: start with solid general models, define a fallback, then estimate monthly spend. Migration steps live at /docs/openai-compatible. Cost math is at /tools/ai-api-cost-calculator. If you are comparing multi-model marketplaces specifically, use /best/openrouter-alternatives.
Source basis: NextModel catalog taxonomy, OpenAI-compatible gateway positioning, and provider public pricing when available. · Updated 2026-08-05
How to use this shortlist
Fit score
Start with the shortlist, then test real prompts and compare monthly cost before production routing.
This model always redirects to the latest model in the Claude Fable family.
This model always redirects to the latest model in the Anthropic Claude Haiku family.
This model always redirects to the latest model in the Claude Opus family.
This model always redirects to the latest model in the Anthropic Claude Sonnet family.
Comparison table
Use this view when you're narrowing a production shortlist, building a fallback policy, or comparing model economics.
| Model | Provider | Input | Output | Context | Capabilities | Best for | Latency | Status | Source |
|---|---|---|---|---|---|---|---|---|---|
| Anthropic: Claude Fable Latest~anthropic/claude-fable-latest | OpenRouter | $1.88 / 1M tokens | $9.40 / 1M tokens | 1M | StreamingTool callingJSON modeVision | image understanding, multimodal chat | 1000-3000ms | Catalog | Platform curated |
| Anthropic Claude Haiku Latest~anthropic/claude-haiku-latest | OpenRouter | $0.188 / 1M tokens | $0.94 / 1M tokens | 200k | StreamingTool callingJSON modeVision | image understanding, multimodal chat | 1000-3000ms | Catalog | Platform curated |
| Anthropic: Claude Opus Latest~anthropic/claude-opus-latest | OpenRouter | $0.94 / 1M tokens | $4.70 / 1M tokens | 1M | StreamingTool callingJSON modeVision | image understanding, multimodal chat | 1000-3000ms | Catalog | Platform curated |
| Anthropic Claude Sonnet Latest~anthropic/claude-sonnet-latest | OpenRouter | $0.564 / 1M tokens | $2.82 / 1M tokens | 1M | StreamingTool callingJSON modeVision | image understanding, multimodal chat | 1000-3000ms | Catalog | Platform curated |
| Google Gemini Flash Latest~google/gemini-flash-latest | OpenRouter | $0.282 / 1M tokens | $1.69 / 1M tokens | 1M | StreamingTool callingJSON modeVision | image understanding, multimodal chat | 1000-3000ms | Catalog | Platform curated |
| Google Gemini Pro Latest~google/gemini-pro-latest | OpenRouter | $0.376 / 1M tokens | $2.26 / 1M tokens | 1M | StreamingTool callingJSON modeVision | image understanding, multimodal chat | 1000-3000ms | Catalog | Platform curated |
| MoonshotAI Kimi Latest~moonshotai/kimi-latest | OpenRouter | $0.124 / 1M tokens | $0.658 / 1M tokens | 1M | StreamingTool callingJSON modeVision | image understanding, multimodal chat | 1000-3000ms | Catalog | Platform curated |
| OpenAI GPT Latest~openai/gpt-latest | OpenRouter | $0.94 / 1M tokens | $5.64 / 1M tokens | 1.1M | StreamingTool callingJSON modeVision | image understanding, multimodal chat | 1000-3000ms | Catalog | Platform curated |
FAQ
A hosted API that speaks the OpenAI request shape (chat completions, models, keys) and forwards to one or more providers behind a single base URL.
One integration surface, easier fallbacks, and one place for usage, budgets, and receipts before traffic gets loud.
Change base_url and the API key in most cases. Then verify streaming, tools, JSON mode, and vision against the model IDs you will actually use.
Send cheap work to cheap models, keep stronger models for hard cases, cache only when it is safe, and set project budgets. Estimate monthly cost before you scale.
Related rankings
Related guides