{"jtbd":{"id":"llm-ai-gateway","slug":"llm-ai-gateway","name":"Production LLM AI gateway","shortName":"Production LLM AI gateway","problemStatement":"Need a unified gateway in front of many model providers with fallbacks, virtual keys, budgets, guardrails, and request logs — not just a model marketplace."},"pick":{"id":"portkey","slug":"portkey","name":"Portkey","tagline":"Depot pick for production AI gateway (fallbacks, virtual keys, budgets). OpenRouter when you want a model…","website":"https://portkey.ai","overall":8.31,"scoreBand":{"low":7.7,"mid":8.3,"high":8.9,"halfWidth":0.6,"basis":"editorial_prior","display":"7.7–8.9 (editorial prior)"},"scoreLayers":{"editorialPrior":8.31,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"As of 2026-09-14 (portkey.ai/pricing): Developer free forever (10k logs/mo, 3-day log / 30-day metrics retention). Production $49/mo (100k logs, +$9/100k overage, 30/90-day retention, guardrails, RBAC). Enterprise custom (10M+ logs, VPC, HIPAA/BAA, private cloud). OSS self-host gateway available. Note: packaging increasingly tied to Palo Alto Prisma AIRS AI Gateway narrative — same lineage as catalogued prisma-airs enterprise SKU.","scores":{"capabilityFit":8.8,"pricePerformance":8.2,"latencyReliability":8.6,"developerDx":9,"privacyPosture":8.2,"lockInRisk":5,"maturity":8.2,"overall":8.31,"kind":"curated_estimate","confidence":"high","asOf":"2026-09-14"}},"runnersUp":[{"id":"vercel-ai-gateway","slug":"vercel-ai-gateway","name":"Vercel AI Gateway","tagline":"Best when the app already ships on Vercel/AI SDK. Portkey remains production-gateway default; OpenRouter for…","website":"https://vercel.com/ai-gateway","overall":8.21,"scoreBand":{"low":7.6,"mid":8.2,"high":8.8,"halfWidth":0.6,"basis":"editorial_prior","display":"7.6–8.8 (editorial prior)"},"scoreLayers":{"editorialPrior":8.21,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"As of 2026-09-14 (vercel.com/docs/ai-gateway/pricing): Zero platform fee / zero markup on provider list prices (incl. BYOK on paid). Free tier ~$5/mo credits on free-tier-eligible models with lower per-model rate limits; purchasing any AI Gateway Credits ends monthly free credit and unlocks full catalog + higher limits. BYOK requires paid credits path. Part of Vercel AI SDK gravity.","scores":{"capabilityFit":8.2,"pricePerformance":9,"latencyReliability":8.6,"developerDx":9.2,"privacyPosture":7.8,"lockInRisk":5.8,"maturity":8,"overall":8.21,"kind":"curated_estimate","confidence":"high","asOf":"2026-09-14"}},{"id":"cloudflare-ai-gateway","slug":"cloudflare-ai-gateway","name":"Cloudflare AI Gateway","tagline":"Free edge gateway peer to Portkey/OpenRouter. Depot llm-ai-gateway pick stays Portkey for virtual…","website":"https://developers.cloudflare.com/ai-gateway/","overall":8.41,"scoreBand":{"low":7.8,"mid":8.4,"high":9,"halfWidth":0.6,"basis":"editorial_prior","display":"7.8–9.0 (editorial prior)"},"scoreLayers":{"editorialPrior":8.41,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"As of 2026-09-14 (developers.cloudflare.com/ai-gateway/reference/pricing, updated 2026-05-19): Core gateway (analytics, caching, rate limiting, DLP profiles) free on all Cloudflare plans. Persistent logs: Workers Free 100k total; Workers Paid 10M/gateway. Unified Billing adds 5% fee on prepaid credits (provider token rates pass through, no markup). Guardrails billed as Workers AI tokens (Llama Guard). Logpush Workers Paid 10M req/mo then $0.05/M. Distinct catalog entry from cloudflare-workers-ai.","scores":{"capabilityFit":8,"pricePerformance":9.4,"latencyReliability":9,"developerDx":8.2,"privacyPosture":8.8,"lockInRisk":4,"maturity":8.4,"overall":8.41,"kind":"curated_estimate","confidence":"high","asOf":"2026-09-14"}},{"id":"openrouter","slug":"openrouter","name":"OpenRouter","tagline":"Best multi-model router for agents that need failover and experimentation. Pin providers in production; don’t…","website":"https://openrouter.ai","overall":8,"scoreBand":{"low":7.4,"mid":8,"high":8.6,"halfWidth":0.6,"basis":"editorial_prior","display":"7.4–8.6 (editorial prior)"},"scoreLayers":{"editorialPrior":8,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"As of 2026-09-14: Multi-provider LLM router with OpenAI-compatible API; pass-through model pricing plus small platform fee. Best for prototyping multi-model and failover; production should pin critical paths to direct providers.","scores":{"capabilityFit":8.8,"pricePerformance":7.8,"latencyReliability":7.6,"developerDx":9.2,"privacyPosture":6.8,"lockInRisk":4,"maturity":7.8,"overall":8,"kind":"curated_estimate","confidence":"high","asOf":"2026-09-14"}},{"id":"helicone","slug":"helicone","name":"Helicone","tagline":"Maintenance mode since 2026-03-03 (Mintlify); site now says 'no longer part of Mintlify'. Runner-up only, not a pick.","website":"https://www.helicone.ai","overall":8.13,"scoreBand":{"low":7.5,"mid":8.1,"high":8.7,"halfWidth":0.6,"basis":"editorial_prior","display":"7.5–8.7 (editorial prior)"},"scoreLayers":{"editorialPrior":8.13,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-10-19","pricingNotes":"Proxy/gateway logging; usage-based plans from low tens of $/mo; open-source components.","scores":{"capabilityFit":8.2,"pricePerformance":8.5,"latencyReliability":8.4,"developerDx":8.8,"privacyPosture":7.5,"lockInRisk":4,"maturity":8,"overall":8.13,"kind":"curated_estimate","confidence":"high","asOf":"2026-10-19"}},{"id":"cloudflare-workers-ai","slug":"cloudflare-workers-ai","name":"Cloudflare Workers AI","tagline":"Best when your agent already runs on Workers and you want colocated small/open models. Not a frontier brain.","website":"https://developers.cloudflare.com/workers-ai/","overall":7.69,"scoreBand":{"low":7.1,"mid":7.7,"high":8.3,"halfWidth":0.6,"basis":"editorial_prior","display":"7.1–8.3 (editorial prior)"},"scoreLayers":{"editorialPrior":7.69,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"As of 2026-10-24 (developers.cloudflare.com/workers-ai/platform/pricing, fetched 2026-10-24): '$0.011 per 1,000 Neurons' with '10,000 Neurons per day at no charge' on both Workers Free and Workers Paid ('All limits reset daily at 00:00 UTC.'). 'To use more than 10,000 Neurons per day, you need to sign up for the Workers Paid plan'. 'Some models require a paid billing method' (listed Kimi K2.6/K2.7-code, GLM-5.2/5.3 and DeepSeek V4 models), payable via Workers Paid or 'prepaid AI Gateway credits'. Per-model token prices are shown as equivalents while 'still billing in neurons in the back end': @cf/meta/llama-3.1-8b-instruct-fp8-fast $0.045/$0.384 per M input/output tokens ('$0.045 per M input tokens', '$0.384 per M output tokens'); @cf/openai/gpt-oss-120b $0.350/$0.750 per M input/output tokens ('$0.350 per M input tokens', '$0.750 per M output tokens'); @cf/baai/bge-m3 '$0.012 per M input tokens'.","scores":{"capabilityFit":6.8,"pricePerformance":8.5,"latencyReliability":8.2,"developerDx":8.4,"privacyPosture":8,"lockInRisk":4.5,"maturity":7.8,"overall":7.69,"kind":"curated_estimate","confidence":"high","asOf":"2026-09-14"}}],"scoreBand":{"low":7.7,"mid":8.3,"high":8.9,"halfWidth":0.6,"basis":"editorial_prior","display":"7.7–8.9 (editorial prior)"},"scoreLayers":{"editorialPrior":8.31,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"whyPickOverHigherScore":{"pickId":"portkey","pickName":"Portkey","pickScore":8.31,"highestScoredCandidateId":"cloudflare-ai-gateway","highestScoredCandidateName":"Cloudflare AI Gateway","highestScore":8.41,"pickHasLowerCompositeScore":true,"delta":-0.1,"pickLeadsOnDimensions":["capabilityFit (8.8 vs 8)","developerDx (9 vs 8.2)"],"explanation":"Portkey (8.31) is the editorial pick for Production LLM AI gateway over higher-composite Cloudflare AI Gateway (8.41) because composite scores are provider-wide priors while Portkey wins on capabilityFit (8.8 vs 8), developerDx (9 vs 8.2): DX + reliability + capability for fallbacks/keys/guardrails. OpenRouter wins catalog breadth; Portkey wins production gateway controls."},"cheapest":null,"recommendedWorkloadQuote":{"providerId":"portkey","providerName":"Portkey","skuId":"portkey-production-usd-per-month","item":"Production","plan":"Production — Gateway plan","unit":"usd_per_month","amountUsd":49,"outputSkuId":null,"outputItem":null,"outputAmountUsd":null,"outputUnit":null,"sourceUrl":"https://portkey.ai/pricing","asOf":"2026-10-03","pricingLastVerifiedAt":"2026-10-27","isFlagshipForJob":true,"differsFromFloorCheapest":false,"representativeQuote":{"skuId":"portkey-production-usd-per-month","item":"Production","plan":"Production — Gateway plan","amountUsd":49,"inputOrUnitUsd":49,"unit":"usd_per_month","outputUsd":null,"outputUnit":null,"sourceUrl":"https://portkey.ai/pricing","asOf":"2026-10-03"},"estimatedTaskCost":{"tasks":1000,"retryAndToolOverheadMultiplier":1.15,"retryToolOverheadMultiplier":1.15,"unitsPerTask":1,"baseCostPer1kTasksUsd":49,"totalUsd":56.35,"estimatedTotalUsd":56.35,"perTaskUsd":0.05635,"estimatedCostPerTaskUsd":0.05635,"formula":"Monthly base plan $49/mo covering 1,000 tasks (1.15x overhead buffer)","assumptions":"Monthly subscription plan amortized over 1,000 tasks/month."}},"representativeQuote":{"skuId":"portkey-production-usd-per-month","item":"Production","plan":"Production — Gateway plan","amountUsd":49,"inputOrUnitUsd":49,"unit":"usd_per_month","outputUsd":null,"outputUnit":null,"sourceUrl":"https://portkey.ai/pricing","asOf":"2026-10-03"},"estimatedTaskCost":{"tasks":1000,"retryAndToolOverheadMultiplier":1.15,"retryToolOverheadMultiplier":1.15,"unitsPerTask":1,"baseCostPer1kTasksUsd":49,"totalUsd":56.35,"estimatedTotalUsd":56.35,"perTaskUsd":0.05635,"estimatedCostPerTaskUsd":0.05635,"formula":"Monthly base plan $49/mo covering 1,000 tasks (1.15x overhead buffer)","assumptions":"Monthly subscription plan amortized over 1,000 tasks/month."},"freeAlternatives":[{"id":"litellm-oss","name":"LiteLLM","kind":"dev_tool","jtbdIds":["llm-ai-gateway","multi-model-router"],"whatYouGet":"Self-hosted OpenAI-compatible gateway. Code outside enterprise/ is MIT. Provider tokens are not included.","cost":"oss","license":"MIT outside enterprise/","sourceUrl":"https://github.com/BerriAI/litellm/blob/main/LICENSE","notes":"enterprise/ uses enterprise/LICENSE. No free hosted quota is stated here. Re-fetched twice 2026-10-25 (~10 s apart, plain curl, no login): GitHub blob page HTTP 200, no redirect (page chrome differs between fetches); raw LICENSE fetched twice too, HTTP 200, byte-identical: 'available under the MIT license' / 'Copyright (c) 2023 Berri AI'. The LICENSE still names only the 'enterprise/' directory. License unchanged.","providerId":null,"limits":null,"asOf":"2026-10-25","freeType":"dev_tool","substitutable":true}],"referenceDocs":[],"falsification":{"jtbdId":"llm-ai-gateway","jtbdName":"Production LLM AI gateway","currentPickId":"portkey","currentPickScore":8.31,"challengerId":"vercel-ai-gateway","challengerScore":8.21,"currentScoreGap":0.1,"minVerifiedOutcomes":10,"requiredOutcomeMargin":0.25,"requiredSuccessRateDelta":0.15,"maxPickPriceIncreasePct":25,"whatWouldChangePick":["Vercel AI Gateway (vercel-ai-gateway) outperforms Portkey (portkey) by >= 0.25 outcome points (or >= 15% worked-rate delta) across >= 10 Countersign-verified production outcomes.","A verified price increase > 25% on Portkey's representative SKU for llm-ai-gateway without a corresponding capability gain.","Live caller rail exhaustion (?exhausted=portkey) or sustained >= 30% degraded/failed rate in verified production outcomes."],"frozenHoldoutPolicy":{"holdoutSplit":"20% frozen benchmark holdout tasks + 80% live production outcome receipts","requireCountersignReceipt":true,"requiredEvidenceTiers":["outcome_verified","reference_checked"],"minDistinctContributors":2,"antiGamingRule":"Unverified self-reports and seed/editorial rows never mutate picks or scores."},"triggers":[{"kind":"verified_outcomes_outperformance","challengerId":"vercel-ai-gateway","minVerifiedOutcomes":10,"requiredOutcomeMargin":0.25,"requiredWorkedRateDelta":0.15},{"kind":"verified_price_increase","providerId":"portkey","maxPriceIncreasePct":25},{"kind":"live_rail_exhaustion_or_degradation","providerId":"portkey","immediateOverrideUrl":"/api/decide?jtbd=llm-ai-gateway&exhausted=portkey"}],"submissionSpec":{"falsifyEndpoint":"/api/falsify?jtbd=llm-ai-gateway","outcomesEndpoint":"POST /api/feedback","correctionsEndpoint":"POST /api/corrections","payloadTemplate":{"agentIdentity":"agent:<your-agent-id>","jtbdId":"llm-ai-gateway","providerId":"vercel-ai-gateway","outcome":"worked","detail":"Comparative production evaluation on llm-ai-gateway (n>=10 tasks) with Countersign receipt.","confidence":"high","receipt":{"countersign":{"claim_id":"cs-00000000","status":"verified","evidence_tier":"outcome_verified","counts_as_verified":true}}}}},"whatWouldChangePick":["Vercel AI Gateway (vercel-ai-gateway) outperforms Portkey (portkey) by >= 0.25 outcome points (or >= 15% worked-rate delta) across >= 10 Countersign-verified production outcomes.","A verified price increase > 25% on Portkey's representative SKU for llm-ai-gateway without a corresponding capability gain.","Live caller rail exhaustion (?exhausted=portkey) or sustained >= 30% degraded/failed rate in verified production outcomes."],"routePlan":{"jtbdId":"llm-ai-gateway","primary":{"providerId":"portkey","name":"Portkey","overall":8.31,"scoreBand":{"low":7.7,"mid":8.3,"high":8.9,"halfWidth":0.6,"basis":"editorial_prior","display":"7.7–8.9 (editorial prior)"},"scoreLayers":{"editorialPrior":8.31,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"primary","reason":"Editorial Depot Pick for Production LLM AI gateway; healthy/eligible under caller constraints."},"fallback":[{"providerId":"vercel-ai-gateway","name":"Vercel AI Gateway","overall":8.21,"scoreBand":{"low":7.6,"mid":8.2,"high":8.8,"halfWidth":0.6,"basis":"editorial_prior","display":"7.6–8.8 (editorial prior)"},"scoreLayers":{"editorialPrior":8.21,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"fallback","reason":"Ranked fallback route for Production LLM AI gateway."},{"providerId":"cloudflare-ai-gateway","name":"Cloudflare AI Gateway","overall":8.41,"scoreBand":{"low":7.8,"mid":8.4,"high":9,"halfWidth":0.6,"basis":"editorial_prior","display":"7.8–9.0 (editorial prior)"},"scoreLayers":{"editorialPrior":8.41,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"fallback","reason":"Ranked fallback route for Production LLM AI gateway."},{"providerId":"openrouter","name":"OpenRouter","overall":8,"scoreBand":{"low":7.4,"mid":8,"high":8.6,"halfWidth":0.6,"basis":"editorial_prior","display":"7.4–8.6 (editorial prior)"},"scoreLayers":{"editorialPrior":8,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"fallback","reason":"Ranked fallback route for Production LLM AI gateway."},{"providerId":"helicone","name":"Helicone","overall":8.13,"scoreBand":{"low":7.5,"mid":8.1,"high":8.7,"halfWidth":0.6,"basis":"editorial_prior","display":"7.5–8.7 (editorial prior)"},"scoreLayers":{"editorialPrior":8.13,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-10-19","role":"fallback","reason":"Ranked fallback route for Production LLM AI gateway."},{"providerId":"cloudflare-workers-ai","name":"Cloudflare Workers AI","overall":7.69,"scoreBand":{"low":7.1,"mid":7.7,"high":8.3,"halfWidth":0.6,"basis":"editorial_prior","display":"7.1–8.3 (editorial prior)"},"scoreLayers":{"editorialPrior":7.69,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"fallback","reason":"Ranked fallback route for Production LLM AI gateway."}],"disqualified":[],"expectedRegret":{"scoreDeltaVsUnconstrainedPick":0,"unconstrainedPickId":"portkey","activePrimaryId":"portkey","summary":"0.00 score regret: unconstrained editorial pick satisfies all caller constraints."},"evidenceAgeDays":{"editorialScoreAgeDays":43,"pricingVerifiedAgeDays":0,"editorialPriorAsOf":"2026-09-14","pricingLastVerifiedAt":"2026-10-27"},"confidenceBand":{"low":7.7,"mid":8.3,"high":8.9,"halfWidth":0.6,"basis":"editorial_prior","display":"7.7–8.9 (editorial prior)"},"constraintsApplied":false,"constraintBundle":{"task":null,"jtbd":"llm-ai-gateway","quotaExhausted":[],"degraded":[],"healthy":[],"budgetUsd":null,"maxLatencyMs":null,"region":null,"privacy":null,"exit":[],"existing":[]}},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","tie":true,"scoreGap":0.1,"decidingFactor":"capabilityFit (8.8 vs 8.2)","tieNote":"Scores are within 0.10 on a curated_estimate 0-10 scale (8.31 vs 8.21); treat as a statistical tie and decide on decidingFactor or whenNotTopPick.","rationale":"DX + reliability + capability for fallbacks/keys/guardrails. OpenRouter wins catalog breadth; Portkey wins production gateway controls.","whenNotTopPick":"You only need a multi-model catalog/router (OpenRouter), pure cheap request logs (Helicone), or are standardized on Palo Alto Prisma AIRS enterprise gateway.","skipTopPick":false,"skipReason":null,"matchedConstraints":[],"pricingSummary":"As of 2026-09-14 (portkey.ai/pricing): Developer free forever (10k logs/mo, 3-day log / 30-day metrics retention). Production $49/mo (100k logs, +$9/100k overage, 30/90-day retention, guardrails, RBAC). Enterprise custom (10M+ logs, VPC, HIPAA/BAA, private cloud). OSS self-host g…","cite":"Depot Pick for llm-ai-gateway: portkey (asOf 2026-09-14). See GET /api/jtbds/llm-ai-gateway + GET /api/methodology.","nextActions":[{"step":1,"title":"Inspect full JTBD + embeds","href":"/api/jtbds/llm-ai-gateway?embed=providers","why":"Confirm pick, runners-up, and methodology notes."},{"step":2,"title":"Quote sourced SKUs","href":"/api/quote?jtbd=llm-ai-gateway","why":"Depot Pick SKUs plus the cheapest sourced SKU whose unit matches this job. Does not change the pick. Does not blend input and output or borrow a chat rate for a non-chat job."},{"step":3,"title":"Open provider detail","href":"/api/providers/portkey","why":"Scores, pricingNotes, strengths/weaknesses, communitySignals (claims only)."},{"step":4,"title":"Cite methodology","href":"/api/methodology","why":"Required when publishing a Depot Pick citation."},{"step":5,"title":"Grab badge SVG","href":"/api/badge?type=depot-pick&jtbd=llm-ai-gateway","why":"Embed in README / agent passport."},{"step":6,"title":"Post production insight","method":"POST","href":"/api/insights","why":"Unverified until curated; never auto-mutates official scores."}],"honesty":["Do not invent scores or benches.","Insights are claims until curated/reviewed; they never silently mutate official scores.","lockInRisk higher = more lock-in (worse).","normalizedUsdPerMillionTokens is set only for a single sourced token row. Otherwise null, with a machine-readable reason. Do not coerce GPU, minute, or per-1k search units.","Runners-up are not Depot Picks.","Depot overall is editorial_weighted, not Arena Elo and not an Artificial Analysis index."],"asOf":"2026-09-14","depth":{"whenNotToUse":{"text":"You only need a multi-model catalog/router (OpenRouter), pure cheap request logs (Helicone), or are standardized on Palo Alto Prisma AIRS enterprise gateway.","source":"editorial `whenNotTopPick` (data/jtbds.json)"},"whenNotToUseReason":null,"runnerUp":{"providerId":"vercel-ai-gateway","name":"Vercel AI Gateway","overallForJob":8.21,"pickOverallForJob":8.31,"beatsPickOn":["pricePerformance","developerDx"],"source":"first resolvable entry of the job's editorially ranked `runnersUpIds`; scores are stored job-weighted scores"},"runnerUpReason":null,"lockIn":{"pickLockInRisk":5,"runnerUpLockInRisk":5.8,"scale":"0–10 stored curated estimate; higher = more lock-in (worse)","pickExitSignals":["OpenAI-compatible API (provider tag `openai-compat`)"],"runnerUpExitSignals":[],"pickNotes":[{"text":"OSS self-host option","field":"strengths"}],"selfHostFallback":[{"id":"litellm-oss","name":"LiteLLM","license":"MIT outside enterprise/","sourceUrl":"https://github.com/BerriAI/litellm/blob/main/LICENSE"}],"migration":"The pick has lower stored lock-in risk than runner-up Vercel AI Gateway (5 vs 5.8). Pick exit signals: OpenAI-compatible API (provider tag `openai-compat`). Self-host fallback listed for this job: LiteLLM.","migrationReason":null,"derivedFrom":"stored lockInRisk scores, provider tags (oss, self-host, openai-compat, open-models), free rows that list this job, and verbatim provider notes. No migration guide was invented."}},"citation":{"text":"Agent Provider Depot (v0.12.151), Depot Pick for llm-ai-gateway: portkey, scores as of 2026-09-14, retrieved 2026-10-27. https://getagentdepot.com/jtbds/llm-ai-gateway","markdown":"[Agent Provider Depot](https://getagentdepot.com/jtbds/llm-ai-gateway) (v0.12.151) — Depot Pick for `llm-ai-gateway`: **portkey** (scores as of 2026-09-14, retrieved 2026-10-27)","fields":{"publisher":"Agent Provider Depot","version":"0.12.151","role":"depot_pick","jtbdId":"llm-ai-gateway","providerId":"portkey","scoreAsOf":"2026-09-14","retrievedOn":"2026-10-27","page":"https://getagentdepot.com/jtbds/llm-ai-gateway","api":"https://getagentdepot.com/api/decide?jtbd=llm-ai-gateway"},"howToCite":"Cite Depot as an editorial, dated recommendation, not a benchmark: name the job, the Depot Pick (or runner-up), the score asOf date and the day you retrieved it, and link the job page. Format: “Agent Provider Depot (v{version}), Depot Pick for {jobId}: {providerId}, scores as of {scoreAsOf}, retrieved {retrievedOn}. {baseUrl}/jtbds/{jobId}”. Quote prices only with their own sourceUrl and asOf. If the pick's score is stale (freshness.pick.score.stale), say so."},"freshness":{"pick":{"score":{"asOf":"2026-09-14","ageDays":43,"stale":true,"staleAfterDays":30,"reason":null},"lastReviewed":{"asOf":"2026-09-14","ageDays":43,"stale":true,"staleAfterDays":30,"reason":null},"sourceCheck":{"checkedAt":"2026-10-27","sourceUrls":2,"sourcesReachable":2,"pricingRows":1,"pricingRowsReconfirmed":1,"note":"A source re-check confirms the page is reachable and, for pricing rows, that the stored amount and SKU name appear on it. It does not re-derive or change the score.","reason":null}},"scoreAsOf":"2026-09-14","editorialPriorAsOf":"2026-09-14","pricingLastVerifiedAt":"2026-10-27","pickLastReviewed":"2026-09-14","runnersUpScoreAsOf":["2026-09-14","2026-09-14","2026-09-14","2026-10-19","2026-09-14"],"contractAsOf":"2026-10-03","pricingShape":"sourced_rows","normalizedUsdPerMillionTokens":null,"normalizationStatus":"unit_mismatch","normalizationReason":"unit_mismatch"},"pricingContract":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"unit_mismatch","normalizationReason":"unit_mismatch","shape":"sourced_rows","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[{"id":"portkey-production-usd-per-month","providerId":"portkey","sku":"Production","unit":"usd_per_month","amountUsd":49,"currency":"USD","sourceUrl":"https://portkey.ai/pricing","asOf":"2026-10-03","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_month","priceSortEligible":false,"qualifier":"Gateway plan. 100k recorded logs, then +$9 per additional 100k requests. Not a model token rate. Enterprise is custom and was omitted."}],"notesExcerpt":"As of 2026-09-14 (portkey.ai/pricing): Developer free forever (10k logs/mo, 3-day log / 30-day metrics retention). Production $49/mo (100k logs, +$9/100k overage, 30/90-day retention, guardrails, RBAC). Enterprise custom (10M+ logs, VPC, HIPAA/BAA, private cloud). OSS self-host g…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://portkey.ai","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"links":{"jtbd":"/jtbds/llm-ai-gateway","jtbdApi":"/api/jtbds/llm-ai-gateway","leaderboard":"/api/leaderboards?jtbd=llm-ai-gateway","methodology":"/api/methodology","badge":"/api/badge?type=depot-pick&jtbd=llm-ai-gateway","decide":"/api/decide?jtbd=llm-ai-gateway","humanPage":"/jtbds/llm-ai-gateway","alternatives":"/api/alternatives?provider=portkey","canonical":"/api/canonical","quote":"/api/quote?jtbd=llm-ai-gateway","falsify":"/api/falsify?jtbd=llm-ai-gateway"},"constraintBundle":{"task":null,"jtbd":"llm-ai-gateway","quotaExhausted":[],"degraded":[],"healthy":[],"budgetUsd":null,"maxLatencyMs":null,"region":null,"privacy":null,"exit":[],"existing":[]},"stackContext":{"host":null,"framework":null,"repo":null,"lang":null,"existing":[],"volume":null,"sender":null,"detectedFromTask":[]},"keep":null,"contextAdvice":null,"communityFeedback":{"pickOnThisJob":{"failed":0,"degraded":0,"worked":0,"insights":0,"withVerifiedReceipt":0,"failureModes":{},"latestAt":null,"note":"Agent-reported claims (unverified unless a receipt is verified by Depot's re-check). They never change scores or picks."},"outcomes":{"job":{"n":0,"worked":0,"degraded":0,"failed":0,"failureModes":{},"verifiedReports":0,"contributors":0,"excluded":{"seed_editorial":0,"test":0,"notFeedback":0},"reason":"no_submitted_outcome_reports_yet"},"pick":{"providerId":"portkey","n":0,"worked":0,"degraded":0,"failed":0,"failureModes":{},"evidenceTiers":{"agent_claim":0,"self_declared":0,"reference_checked":0,"outcome_verified":0},"reason":"no_submitted_outcome_reports_yet"},"scoresMutated":false,"more":"/api/outcomes?jtbd=llm-ai-gateway"},"report":"POST /api/feedback {agentIdentity, outcome: failed|degraded|worked, detail, providerId, jtbdId, failureModeId?, receipt?}"}}