AP
Agent Provider Depot
Opinionated picks for agents
OpenAPI
← Categories

⚡Inference APIs

Hosted LLM and multimodal APIs — chat, completion, vision, speech, embeddings. Pay-per-token or reserved capacity.

Machine board /api/leaderboards?category=inference-apis. Editorial 0–10, not Arena Elo. Alternatives for the current top row: /alternatives/openai-moderation.

OpenAI Moderation

Default first-pass content filter for agent I/O. Pair with Llama Guard (Groq) or NeMo Guardrails when you…

8.6
moderationsafetyfreepolicy

Fal

Depot default for programmatic image/video/audio gen. One API to rule the media zoo.

8.5
imagevideoaudioserverless

Deepgram

Default STT and strong voice-agent platform. Standard Flux TTS / Voice Agent rates live since 2026-09-15…

8.5
sttttsvoice-agentrealtime

Google AI (Gemini)

Best value frontier stack and multimodal king. Use Flash for high-volume agent loops; Pro when quality…

8.4
llmgeminimultimodallong-context

Anthropic

Depot default for serious coding and production agents. Prefer Sonnet for cost/quality; reserve Opus for hard…

8.4
llmfrontiercodingagents

Cloudflare AI Gateway

Free edge gateway peer to Portkey/OpenRouter. Depot llm-ai-gateway pick stays Portkey for virtual…

8.4
gatewaycloudflarecachingobservability

Full ranking

#ProviderOverallFit$/perfLatencyDXAs of
1OpenAI Moderation8.68.29.89.29.42026-09-14
2Fal8.59.28.58.69.62026-10-19
3Deepgram8.58.88.88.68.62026-10-19
4Google AI (Gemini)8.49.28.88.58.22026-10-19
5Anthropic8.49.76.88.79.22026-10-19
6Cloudflare AI Gateway8.48.09.49.08.22026-09-14
7Voyage AI8.49.28.88.48.62026-09-14
8Fireworks AI8.38.68.88.49.02026-09-14
9Portkey8.38.88.28.69.02026-09-14
10Rime8.38.68.88.48.62026-09-14
11Speechmatics8.29.07.28.87.82026-09-14
12OpenAI8.29.66.28.89.52026-09-14
13Lakera Guard8.28.87.88.49.02026-09-14
14Vercel AI Gateway8.28.29.08.69.22026-09-14
15Together AI8.28.59.08.08.42026-09-14
16Guardrails AI8.28.48.87.88.22026-09-14
17OpenAI Media (Images/Audio)8.28.87.28.89.22026-09-14
18Jina AI8.18.28.67.88.82026-09-14
19AssemblyAI8.18.67.28.48.82026-09-14
20Scaleway Generative APIs8.17.88.68.08.22026-09-14
21You.com API8.18.47.88.28.82026-09-14
22Mistral AI8.18.28.48.08.02026-09-14
23FriendliAI8.08.48.08.48.22026-10-01
24IONOS AI Model Hub8.07.88.48.07.82026-09-14
25OpenRouter8.08.87.87.69.22026-09-14
26Baseten8.08.47.88.48.62026-09-14
27Hyperstack8.08.28.48.08.02026-09-14
28Infomaniak AI8.07.48.08.27.82026-09-14
29Google Vertex AI8.09.07.09.07.22026-09-14
30Cohere8.07.88.08.47.82026-10-19
31Groq8.07.89.08.28.82026-09-14
32DeepInfra8.08.09.47.58.52026-09-14
33Hugging Face Inference8.08.47.27.48.62026-09-14
34DeepSeek8.08.89.87.88.02026-09-14
35Gladia7.98.27.88.08.22026-09-14
36Moonshot (Kimi)7.98.68.47.88.22026-09-14
37Predibase7.98.48.07.88.22026-09-14
38NVIDIA NeMo Guardrails7.98.87.58.07.02026-09-14
39Alibaba Cloud Model Studio (DashScope)7.98.68.28.47.22026-09-14
40MiniMax7.88.48.87.88.22026-09-14
41Replicate7.88.46.08.29.42026-09-14
42Z.AI (Zhipu GLM)7.88.29.07.68.02026-09-14
43Amazon Bedrock7.88.86.09.26.82026-09-14
44OVHcloud AI Endpoints7.77.28.87.87.22026-09-14
45Cloudflare Workers AI7.76.88.58.28.42026-09-14
46xAI7.78.88.07.87.82026-09-14
47Perplexity7.78.27.58.08.02026-09-14
48NVIDIA NIM / NGC7.78.67.08.06.82026-10-19
49Azure OpenAI7.69.05.59.07.02026-09-14
50Cerebras7.68.08.27.87.52026-09-14
51SambaNova7.58.07.88.26.82026-09-14
52AI21 Labs7.57.67.28.27.22026-09-14
53Novita AI7.47.29.07.07.82026-09-14
54STACKIT AI Model Serving7.47.08.07.86.52026-09-14
55T-Systems AI Foundation Services7.48.05.58.26.82026-09-14
56SiliconFlow7.37.49.26.87.62026-09-14
57Lepton AI7.37.28.27.27.82026-09-14
58Hyperbolic7.37.08.86.88.02026-09-14
59Chutes7.37.49.26.87.62026-09-14
60Databricks Mosaic AI7.18.44.88.56.82026-09-14
61Snowflake Cortex7.17.85.58.47.02026-09-14
62Aleph Alpha (PhariaAI)6.67.24.58.05.52026-09-14
63Infermatic6.55.58.05.87.02026-09-14