AP
Agent Provider Depot
Opinionated picks for agents
OpenAPI
← All jobs

Multi-provider model routing

One integration to A/B models and fail over across vendors.

At a glance — Oct 2026

Updated 2026-10-27 · forward this page: /jtbds/multi-model-router#brief

Scores as of 2026-09-14 (43 days old; Depot marks scores stale after 30 days). The pick is still Depot's current editorial pick; it has not been re-reviewed since. Prices below carry their own dates.

Depot Pick
OpenRouter · 8.00/10 for this job (curated estimate, high confidence)

dx + capability breadth; reliability discounted because upstream variance.

Runner-up
Amazon Bedrock · 7.75/10

Scores higher than the pick on: Latency / reliability, Privacy / data retention, Maturity / track record.

When not to use the pick
Need a single-vendor enterprise SLA — pin Anthropic/OpenAI or use Bedrock/Vertex as the governed router.
Lock-in / migration
The pick has lower stored lock-in risk than runner-up Amazon Bedrock (4 vs 7). Pick exit signals: OpenAI-compatible API (provider tag `openai-compat`). Self-host fallback listed for this job: LiteLLM.
Sourced price (usd_per_million_input_tokens)

Pick's lowest sourced SKU: anthropic/claude-sonnet-5.5 $2 (usd_per_million_input_tokens) — source, as of 2026-10-03, re-checked 2026-10-27

Cheapest matching SKU: Amazon Bedrock Gemma 3 4B $0.04 — source, as of 2026-10-03, re-checked 2026-10-27. Not the pick; not quality-adjusted.

Price history: first seen 2026-10-03 · last changed no change recorded · history JSON

Free option
  • LiteLLM (oss) — source, as of 2026-10-25
  • OpenRouter :free variants and openrouter/free (free) — source, as of 2026-10-25
Failure modes to watch
  • Non-determinism: Run the task more than once and compare the end state, not a single transcript. Record the trial count next to any success rate you cite.
  • Runaway spend: Set a budget and a tool-call cap per task. Alert when spend jumps. Stop the run at the cap instead of summarizing a partial trace as success.
Reported outcomes (submitted reports only)

This job: loading… JSON · reports never change scores · seed/test records excluded

Depot Pick (OpenRouter) on this job: loading… JSON · reports never change scores · seed/test records excluded

Same-job, same-unit comparisons: OpenRouter vs Amazon Bedrock · OpenRouter vs Google Vertex AI · OpenRouter vs Together AI

Cite: Agent Provider Depot, Depot Pick for multi-model-router: openrouter, scores as of 2026-09-14. Agents: GET /api/decide?jtbd=multi-model-router

Free Multi-provider model routing options · All sourced prices, cheapest first

Depot Pick

OpenRouter

dx + capability breadth; reliability discounted because upstream variance.

Pricing (directional): As of 2026-09-14: Multi-provider LLM router with OpenAI-compatible API; pass-through model pricing plus small platform fee. Best for prototyping multi-model and failover; production should pin critical paths to direct providers.

Cite: Depot Pick for multi-model-router: openrouter
Overall
8.0
curated_estimate
confidence: high · as of 2026-09-14
Capability fit
8.8
Price / performance
7.8
Latency / reliability
7.6
Developer & agent DX
9.2
Privacy / data retention
6.8
Lock-in risk (higher = worse)
4.0
Maturity / track record
7.8

Lock-in risk: higher = more lock-in (worse). Overall already inverts this dimension.

Sources: OpenRouter: https://openrouter.ai · OpenRouter models: https://openrouter.ai/models · OpenRouter docs: https://openrouter.ai/docs

Best multi-model router for agents that need failover and experimentation. Pin providers in production; don’t treat OpenRouter as your only SLA.

Quote for Multi-provider model routing

Depot Pick stays OpenRouter. Prices below are sourced SKU rows only (as of 2026-10-27). Input and output are not blended. GET /api/quote?jtbd=multi-model-router

Pick is not a price winner. openrouter sourced input $/1M is 2; cheapest among candidates is amazon-bedrock at 0.04.

  • anthropic/claude-sonnet-5.5 usd_per_million_input_tokens $2 source as of 2026-10-03
  • x-ai/grok-4.7 usd_per_million_input_tokens $2 source as of 2026-10-03
  • anthropic/claude-sonnet-5.5 usd_per_million_output_tokens $10 source as of 2026-10-03
  • x-ai/grok-4.7 usd_per_million_output_tokens $6 source as of 2026-10-03

1 of 6 candidates have no sourced price row. 2 are excluded from the Input $/1M comparison (chat_completion_input). min sourced input SKU among candidates; not quality-adjusted

Sourced Input $/1M for Multi-provider model routing

Candidates for this job that already have a matching sourced price (chat_completion_input), cheapest first. As of 2026-10-27. Each figure is one SKU in that unit, not a blend of input and output, not a cross-modal rate, and not a Depot score. min sourced input SKU among candidates; not quality-adjusted The Depot Pick is not a price winner.

ProviderInput $/1MSKUSourceAs of
Amazon Bedrock$0.04Gemma 3 4Bpricing page2026-10-03
Together AI$0.15GLM-5.3-Flashpricing page2026-10-03
Google Vertex AI$0.25Gemini 3.1 Flash-Litepricing page2026-10-03
OpenRouterDepot Pick$2anthropic/claude-sonnet-5.5pricing page2026-10-03

Runners-up

When NOT to use the top pick

Need a single-vendor enterprise SLA — pin Anthropic/OpenAI or use Bedrock/Vertex as the governed router.

Full ranking (score table)

Ranked with this JTBD's weights. Scores are curated estimates unless marked otherwise. Agents: prefer /api/decide then this table for tie-breaks.

#ProviderOverallFit$/perfLatencyDXAs of
1Portkey8.38.88.28.69.02026-09-14
2Vercel AI Gateway8.28.29.08.69.22026-09-14
3Together AI8.28.59.08.08.42026-09-14
4OpenRouterDepot Pick8.08.87.87.69.22026-09-14
5Google Vertex AI8.09.07.09.07.22026-09-14
6Amazon Bedrock7.88.86.09.26.82026-09-14

Score methodology for this job

dx + capability breadth; reliability discounted because upstream variance.

  • capabilityFit: 25%
  • pricePerformance: 18%
  • latencyReliability: 15%
  • developerDx: 15%
  • privacyPosture: 10%
  • lockInRisk: 7%
  • maturity: 10%