模型候選名單

Best OpenAI-compatible LLM gateway options for multi-model routing

Shortlist models for an OpenAI-compatible LLM gateway: one base_url, multi-provider routing, cost visibility, and sane fallbacks.

這份候選名單適合什麼用途?: LLM gateway

An OpenAI-compatible LLM gateway means you keep the OpenAI SDK, point base_url at the gateway, and route across providers from there. You can compare unit cost, add cache or budgets, and fail over without rewriting app code. This ranking is for teams picking default models for that setup: start with solid general models, define a fallback, then estimate monthly spend. Migration steps live at /docs/openai-compatible. Cost math is at /tools/ai-api-cost-calculator. If you are comparing multi-model marketplaces specifically, use /best/openrouter-alternatives.

來源依據: NextModel catalog taxonomy, OpenAI-compatible gateway positioning, and provider public pricing when available. · 更新日期 2026-08-05

如何使用这份名单

如何使用这份名单 (LLM gateway)

  1. 对照任务选模型. 先看「LLM gateway」短名单是否覆盖你的真实任务,不要只比标价。
  2. 用同一批提示词试跑. 挑 2–3 个候选,用业务提示词对比质量与输出长度。
  3. 估算月费. 用价格页或成本计算器,按预计 token 量估算月度花费。
  4. 定兜底与预算. 定主模型、兜底模型,设项目预算后再接生产流量。

匹配分

推薦候選 llm gateway

先從候選名單開始,再以真實提示詞測試,並在接入正式環境路由前比較月度成本。

OpenRouterCatalog

This model always redirects to the latest model in the Claude Fable family.

$1.88 / 1M tokensInput$9.40 / 1M tokensOutput1MContext
Best forimage understanding, multimodal chat
RoutingConfigured
StreamingTool callingJSON modeVisionLong context
Platform curatedNextModel gateway catalog (Go origin)
View details
OpenRouterCatalog

This model always redirects to the latest model in the Anthropic Claude Haiku family.

$0.188 / 1M tokensInput$0.94 / 1M tokensOutput200kContext
Best forimage understanding, multimodal chat
RoutingConfigured
StreamingTool callingJSON modeVisionLong context
Platform curatedNextModel gateway catalog (Go origin)
View details
OpenRouterCatalog

This model always redirects to the latest model in the Claude Opus family.

$0.94 / 1M tokensInput$4.70 / 1M tokensOutput1MContext
Best forimage understanding, multimodal chat
RoutingConfigured
StreamingTool callingJSON modeVisionLong context
Platform curatedNextModel gateway catalog (Go origin)
View details
OpenRouterCatalog

This model always redirects to the latest model in the Anthropic Claude Sonnet family.

$0.564 / 1M tokensInput$2.82 / 1M tokensOutput1MContext
Best forimage understanding, multimodal chat
RoutingConfigured
StreamingTool callingJSON modeVisionLong context
Platform curatedNextModel gateway catalog (Go origin)
View details

比較表

按價格、提供者、上下文、能力與來源比較這份候選名單。

當你在縮小正式環境候選名單、建立備援策略或比較模型經濟性時,可使用此視圖。

ModelProviderInputOutputContextCapabilitiesBest forLatencyStatusSource
Anthropic: Claude Fable Latest~anthropic/claude-fable-latestOpenRouter$1.88 / 1M tokens$9.40 / 1M tokens1M
StreamingTool callingJSON modeVision
image understanding, multimodal chat1000-3000msCatalogPlatform curated
Anthropic Claude Haiku Latest~anthropic/claude-haiku-latestOpenRouter$0.188 / 1M tokens$0.94 / 1M tokens200k
StreamingTool callingJSON modeVision
image understanding, multimodal chat1000-3000msCatalogPlatform curated
Anthropic: Claude Opus Latest~anthropic/claude-opus-latestOpenRouter$0.94 / 1M tokens$4.70 / 1M tokens1M
StreamingTool callingJSON modeVision
image understanding, multimodal chat1000-3000msCatalogPlatform curated
Anthropic Claude Sonnet Latest~anthropic/claude-sonnet-latestOpenRouter$0.564 / 1M tokens$2.82 / 1M tokens1M
StreamingTool callingJSON modeVision
image understanding, multimodal chat1000-3000msCatalogPlatform curated
Google Gemini Flash Latest~google/gemini-flash-latestOpenRouter$0.282 / 1M tokens$1.69 / 1M tokens1M
StreamingTool callingJSON modeVision
image understanding, multimodal chat1000-3000msCatalogPlatform curated
Google Gemini Pro Latest~google/gemini-pro-latestOpenRouter$0.376 / 1M tokens$2.26 / 1M tokens1M
StreamingTool callingJSON modeVision
image understanding, multimodal chat1000-3000msCatalogPlatform curated
MoonshotAI Kimi Latest~moonshotai/kimi-latestOpenRouter$0.124 / 1M tokens$0.658 / 1M tokens1M
StreamingTool callingJSON modeVision
image understanding, multimodal chat1000-3000msCatalogPlatform curated
OpenAI GPT Latest~openai/gpt-latestOpenRouter$0.94 / 1M tokens$5.64 / 1M tokens1.1M
StreamingTool callingJSON modeVision
image understanding, multimodal chat1000-3000msCatalogPlatform curated

常見問題

LLM gateway 常見問題

What is an OpenAI-compatible LLM gateway?

A hosted API that speaks the OpenAI request shape (chat completions, models, keys) and forwards to one or more providers behind a single base URL.

Why use a gateway instead of calling each provider directly?

One integration surface, easier fallbacks, and one place for usage, budgets, and receipts before traffic gets loud.

How do I switch an existing OpenAI app to a gateway?

Change base_url and the API key in most cases. Then verify streaming, tools, JSON mode, and vision against the model IDs you will actually use.

How should teams control cost on a multi-model gateway?

Send cheap work to cheap models, keep stronger models for hard cases, cache only when it is safe, and set project budgets. Estimate monthly cost before you scale.