AP
Agent Provider Depot
Opinionated picks for agents
OpenAPI
← All providers

Baseten

Strong custom-model serving alternative to Replicate/Modal when you bring your own model.

Website ↗

Strong custom-model serving alternative to Replicate/Modal when you bring your own model. Strengths: Production model serving focus; Good DX for custom models; Autoscaling inference.

Overall
8.0
curated_estimate
confidence: high · as of 2026-09-14
Capability fit
8.4
Price / performance
7.8
Latency / reliability
8.4
Developer & agent DX
8.6
Privacy / data retention
7.5
Lock-in risk (higher = worse)
4.5
Maturity / track record
8.0

Lock-in risk: higher = more lock-in (worse). Overall already inverts this dimension.

Sources: Baseten: https://www.baseten.co · Baseten docs: https://docs.baseten.co · Baseten pricing: https://www.baseten.co/pricing

Strong custom-model serving alternative to Replicate/Modal when you bring your own model.

Strengths

  • · Production model serving focus
  • · Good DX for custom models
  • · Autoscaling inference

Weaknesses

  • · Less model zoo than Replicate
  • · Pricing vs Fireworks tradeoffs
  • · Smaller community

Pricing notes

As of 2026-09-14 (baseten.co/pricing live): Model APIs + dedicated Truss deploys. Token examples: GLM-5.3-Flash $0.15/$0.50 per 1M (stored row). Per baseten.co/pricing as of 2026-10-21 (not stored as rows): GLM-5.3 and GLM-5.2 each input $1.40, cache input $0.14, output $4.40 per 1M; GLM-5.3 Fast and GLM-5.2 Fast each input $2.10, cache input $0.21, output $6.60 per 1M. GLM 4.7 is no longer listed on that page as of 2026-10-21, so its figure was removed. Dedicated GPU/VM rates published on page (e.g. 16 GiB VM ~$0.01052, L4 ~$0.01414, A10G ~$0.02012, A100/B200 class higher). Basic self-serve; Pro priority GPUs; Enterprise BYOC/self-host. SOC2 Type II + HIPAA. No idle charge when scaled to zero.

Regions: us, globalLast reviewed: 2026-09-14Status: active

Sourced pricing

Contract status ambiguous · input_output_split_not_a_single_rate. Single normalized $/1M: null. Machine list: /api/pricing?provider=baseten

  • GPT OSS 120B · usd_per_million_input_tokens · $0.1 · sourced_token_price
  • GPT OSS 120B · usd_per_million_output_tokens · $0.5 · sourced_token_price
  • GLM-5.3-Flash · usd_per_million_input_tokens · $0.15 · sourced_token_price
  • GLM-5.3-Flash · usd_per_million_output_tokens · $0.5 · sourced_token_price
  • DeepSeek V4.1 Flash · usd_per_million_input_tokens · $0.3 · sourced_token_price
  • DeepSeek V4.1 Flash · usd_per_million_output_tokens · $1.2 · sourced_token_price
  • Kimi K3 · usd_per_million_input_tokens · $3 · sourced_token_price
  • Kimi K3 · usd_per_million_output_tokens · $15 · sourced_token_price

Community signals

Insight claims only — never mutate official scores. Outside reports: 0; seed examples: 0.

0 insights

No insights yet. Submit a production claim →

All insights for this provider →