모델 후보 목록

Best OpenAI-compatible LLM gateway options for multi-model routing

Shortlist models for an OpenAI-compatible LLM gateway: one base_url, multi-provider routing, cost visibility, and sane fallbacks.

이 후보 목록은 어디에 쓰나?: LLM gateway

An OpenAI-compatible LLM gateway means you keep the OpenAI SDK, point base_url at the gateway, and route across providers from there. You can compare unit cost, add cache or budgets, and fail over without rewriting app code. This ranking is for teams picking default models for that setup: start with solid general models, define a fallback, then estimate monthly spend. Migration steps live at /docs/openai-compatible. Cost math is at /tools/ai-api-cost-calculator. If you are comparing multi-model marketplaces specifically, use /best/openrouter-alternatives.

출처 기준: NextModel catalog taxonomy, OpenAI-compatible gateway positioning, and provider public pricing when available. · 업데이트 2026-08-05

Fit score

추천 후보 llm gateway

먼저 후보 목록으로 시작한 다음 실제 프롬프트로 테스트하고 운영 라우팅 전에 월간 비용을 비교합니다.

DeepSeekCatalogHealthytypical

DeepSeek-V4-1-Flash-GLB via NextModel: 1M-token context; $0.3 / 1M tokens in / $1.20 / 1M tokens out per 1M tokens. Capabilities: streaming.

$0.3 / 1M tokensInput$1.20 / 1M tokensOutput1MContext
Best forChinese Q&A, general chat
Streaming
Platform curatedCurated and maintained in the NextModel catalog
View details
OpenAICatalog

Whisper Large V3 Turbo via NextModel: context unpublished; $0 / 1M tokens in / $0 / 1M tokens out per 1M tokens. Capabilities: streaming.

$0 / 1M tokensInput—Output—Context
Best forGeneral chat via OpenAI, API workloads
Streaming
Platform curatedCurated and maintained in the NextModel catalog
View details
GoogleCatalogHealthytypical

‌Gemini 4 Argon via NextModel: 1M-token context; $2 / 1M tokens in / $10 / 1M tokens out per 1M tokens. Capabilities: streaming, tool, json.

$2 / 1M tokensInput$10 / 1M tokensOutput1MContext
Best forimage understanding, multimodal chat
StreamingTool callingJSON modeVisionLong context
Platform curatedCurated and maintained in the NextModel catalog
View details
AnthropicCatalogHealthyfast

Claude Haiku 5.5 via NextModel: 1M-token context; Starting at $0.1 / 1M tokens in / $0.5 / 1M tokens out per 1M tokens. Capabilities: streaming, tool, json.

Starting at $0.1 / 1M tokensInput$0.5 / 1M tokensOutput1MContext
Best forimage understanding, multimodal chat
StreamingTool callingJSON modeVisionLong context
Platform curatedCurated and maintained in the NextModel catalog
View details

비교표

가격, 공급자, 컨텍스트, 기능, 출처 기준으로 후보를 비교합니다.

운영 후보를 좁히거나 폴백 정책을 만들거나 모델 경제성을 비교할 때 사용합니다.

ModelProviderInputOutputContextCapabilitiesBest forLatencyStatusSource
DeepSeek-V4-1-Flash-GLBdeepseek/deepseek-v4-1-flash-glbDeepSeek$0.3 / 1M tokens$1.20 / 1M tokens1M
Streaming
Chinese Q&A, general chat1557-3097msCatalogPlatform curated
Whisper Large V3 Turboopenai/whisper-large-v3-turboOpenAI$0 / 1M tokens$0 / 1M tokens—
Streaming
General chat via OpenAI, API workloads0-0msCatalogPlatform curated
‌Gemini 4 Argongoogle/gemini-4-argonGoogle$2 / 1M tokens$10 / 1M tokens1M
StreamingTool callingJSON modeVision
image understanding, multimodal chat2974-10589msCatalogPlatform curated
Claude Haiku 5.5anthropic/claude-haiku-5.5AnthropicStarting at $0.1 / 1M tokens$0.5 / 1M tokens1M
StreamingTool callingJSON modeVision
image understanding, multimodal chat1321-2017msCatalogPlatform curated
Doubao Seedance 2.5doubao/doubao-seedance-2-5-260628Doubao$0.225 / s——
StreamingVision
image understanding, multimodal chat0-0msCatalogPlatform curated
Dreamina-Seedance 2.0 Fastdreamina/dreamina-seedance-2-0-fast-260128Dreamina$0.122 / s——
StreamingVision
image understanding, multimodal chat0-0msCatalogPlatform curated
Dreamina Seedance 2.5dreamina/dreamina-seedance-2-5-260628Dreamina$0.234 / s——
StreamingVision
image understanding, multimodal chat0-0msCatalogPlatform curated
Gemini 3 Pro Image (Nano Banana Pro) gemini/gemini-3-pro-imageGemini$0.314 / image——
StreamingVision
image understanding, multimodal chat0-0msCatalogPlatform curated

FAQ

LLM gateway FAQ

What is an OpenAI-compatible LLM gateway?

A hosted API that speaks the OpenAI request shape (chat completions, models, keys) and forwards to one or more providers behind a single base URL.

Why use a gateway instead of calling each provider directly?

One integration surface, easier fallbacks, and one place for usage, budgets, and receipts before traffic gets loud.

How do I switch an existing OpenAI app to a gateway?

Change base_url and the API key in most cases. Then verify streaming, tools, JSON mode, and vision against the model IDs you will actually use.

How should teams control cost on a multi-model gateway?

Send cheap work to cheap models, keep stronger models for hard cases, cache only when it is safe, and set project budgets. Estimate monthly cost before you scale.