{"id":"llm-rate-limit-shield","slug":"llm-rate-limit-shield","name":"LLM rate-limit & backoff shield","shortName":"Rate-limit shield","problemStatement":"Protect upstream model quotas with per-tenant limits, smart retries, fallbacks, and 429 shielding so one noisy agent cannot melt the budget.","whenNotTopPick":"Need per-virtual-key budgets and a full governance gateway (Portkey); Vercel already terminates AI traffic (Vercel AI Gateway); Helicone only if you accept maintenance-mode risk (since 2026-03-03, ownership unclear).","categoryIds":["cat-observability"],"depotPickProviderId":"cloudflare-ai-gateway","depotPickRationale":"Editorial replacement 2026-10-21: the former pick Helicone (8.12 for this job) has been in maintenance mode since 2026-03-03 (https://www.mintlify.com/blog/mintlify-acquires-helicone) and its site now says 'Helicone is no longer part of Mintlify. Details to come soon.' (https://www.helicone.ai/, re-checked 2026-10-21), so ownership and roadmap are unclear. Replaced by the highest-scoring live runner-up, Cloudflare AI Gateway (8.42 for this job; rate limiting is a free core feature, fixed or sliding windows, 429 on excess, per https://developers.cloudflare.com/ai-gateway/features/rate-limiting/ and /reference/pricing/; per user/project/team rate and budget limits with fallbacks via Dynamic Routing per /features/dynamic-routing/; all re-checked 2026-10-21; AI Gateway component 'operational' on cloudflarestatus.com 2026-10-21). Helicone stays a runner-up with the maintenance_mode flag. No score changed. Distinct from `llm-ai-gateway` (routing/guardrails). Focus rate limits + cost ceilings.","runnersUpIds":["portkey","vercel-ai-gateway","openrouter","helicone"],"weights":{"capabilityFit":0.2,"pricePerformance":0.12,"latencyReliability":0.28,"developerDx":0.14,"privacyPosture":0.08,"lockInRisk":0.08,"maturity":0.1},"methodologyNotes":"Distinct from `llm-ai-gateway` (routing/guardrails). Focus rate limits + cost ceilings. Confidence: high.","tags":["rate-limit","gateway","cost","reliability"],"depth":{"whenNotToUse":{"text":"Need per-virtual-key budgets and a full governance gateway (Portkey); Vercel already terminates AI traffic (Vercel AI Gateway); Helicone only if you accept maintenance-mode risk (since 2026-03-03, ownership unclear).","source":"editorial `whenNotTopPick` (data/jtbds.json)"},"whenNotToUseReason":null,"runnerUp":{"providerId":"portkey","name":"Portkey","overallForJob":8.29,"pickOverallForJob":8.42,"beatsPickOn":["capabilityFit","developerDx"],"source":"first resolvable entry of the job's editorially ranked `runnersUpIds`; scores are stored job-weighted scores"},"runnerUpReason":null,"lockIn":{"pickLockInRisk":4,"runnerUpLockInRisk":5,"scale":"0–10 stored curated estimate; higher = more lock-in (worse)","pickExitSignals":[],"runnerUpExitSignals":["OpenAI-compatible API (provider tag `openai-compat`)"],"pickNotes":[],"selfHostFallback":[],"migration":"The pick has lower stored lock-in risk than runner-up Portkey (4 vs 5).","migrationReason":null,"derivedFrom":"stored lockInRisk scores, provider tags (oss, self-host, openai-compat, open-models), free rows that list this job, and verbatim provider notes. No migration guide was invented."}},"freshness":{"pick":{"score":{"asOf":"2026-09-14","ageDays":43,"stale":true,"staleAfterDays":30,"reason":null},"lastReviewed":{"asOf":"2026-09-14","ageDays":43,"stale":true,"staleAfterDays":30,"reason":null},"sourceCheck":{"checkedAt":"2026-10-27","sourceUrls":3,"sourcesReachable":3,"pricingRows":0,"pricingRowsReconfirmed":0,"note":"A source re-check confirms the page is reachable and, for pricing rows, that the stored amount and SKU name appear on it. It does not re-derive or change the score.","reason":null}}},"depotPick":{"id":"cloudflare-ai-gateway","slug":"cloudflare-ai-gateway","name":"Cloudflare AI Gateway","tagline":"Free edge gateway peer to Portkey/OpenRouter. Depot llm-ai-gateway pick stays Portkey for virtual…","overall":8.42},"runnersUp":[{"id":"portkey","slug":"portkey","name":"Portkey","tagline":"Depot pick for production AI gateway (fallbacks, virtual keys, budgets). OpenRouter when you want a model…","overall":8.29},{"id":"vercel-ai-gateway","slug":"vercel-ai-gateway","name":"Vercel AI Gateway","tagline":"Best when the app already ships on Vercel/AI SDK. Portkey remains production-gateway default; OpenRouter for…","overall":8.18},{"id":"openrouter","slug":"openrouter","name":"OpenRouter","tagline":"Best multi-model router for agents that need failover and experimentation. Pin providers in production; don’t…","overall":7.92},{"id":"helicone","slug":"helicone","name":"Helicone","tagline":"Maintenance mode since 2026-03-03 (Mintlify); site now says 'no longer part of Mintlify'. Runner-up only, not a pick.","overall":8.12}]}