AP
Agent Provider Depot
Opinionated picks for agents
OpenAPI
← All jobs

Batch / interruptible GPU jobs

Offline evals, embeddings, or training steps that tolerate preemption.

At a glance — Oct 2026

Updated 2026-10-27 · forward this page: /jtbds/batch-gpu#brief

Scores as of 2026-10-19 (8 days old).

Depot Pick
RunPod · 8.34/10 for this job (curated estimate, high confidence)

pricePerf + dx for spot/serverless batch.

Runner-up
Vast.ai · 7.20/10

Scores higher than the pick on: Price / performance, Lock-in risk (higher = worse).

When not to use the pick
Strict deadlines without restart logic — dedicated on-demand.
Lock-in / migration
Runner-up Vast.ai has lower stored lock-in risk (2.5 vs 3.5, 0–10, higher = more lock-in).
Sourced price (usd_per_gpu_hour)

Pick's lowest sourced SKU: RTX 4090 Pod (Community Cloud) $0.34 (usd_per_gpu_hour) — source, as of 2026-10-19

Cheapest matching SKU: SaladCloud RTX 3090 24GB (Lowest priority, batch) $0.09 — source, as of 2026-10-19. Not the pick; not quality-adjusted.

Price history: first seen 2026-10-19 · last changed no change recorded · history JSON

Free option
No free resource lists this job. A cheap paid SKU is not a free option.
Failure modes to watch
  • Partial tool success: Require a per-item status and a failure count. Success for the task requires the failed count to be zero or explicitly handed to a retry queue.
  • Runaway spend: Set a budget and a tool-call cap per task. Alert when spend jumps. Stop the run at the cap instead of summarizing a partial trace as success.
Reported outcomes (submitted reports only)

This job: loading… JSON · reports never change scores · seed/test records excluded

Depot Pick (RunPod) on this job: loading… JSON · reports never change scores · seed/test records excluded

Same-job, same-unit comparisons: RunPod vs SaladCloud

Cite: Agent Provider Depot, Depot Pick for batch-gpu: runpod, scores as of 2026-10-19. Agents: GET /api/decide?jtbd=batch-gpu

All sourced prices, cheapest first

Depot Pick

RunPod

pricePerf + dx for spot/serverless batch.

Pricing (directional): Secure Cloud + Community Cloud; serverless per-second; H100 often ~$2–3+/hr depending tier; spot cheaper.

Cite: Depot Pick for batch-gpu: runpod
Overall
8.3
curated_estimate
confidence: high · as of 2026-10-19
Capability fit
8.8
Price / performance
9.0
Latency / reliability
8.0
Developer & agent DX
8.8
Privacy / data retention
7.0
Lock-in risk (higher = worse)
3.5
Maturity / track record
8.2

Lock-in risk: higher = more lock-in (worse). Overall already inverts this dimension.

Sources: RunPod: https://www.runpod.io · GPU cloud comparisons: https://www.runpod.io/articles/alternatives/best-gpu-cloud-providers-for-ai-and-ml

Depot default for self-serve GPUs. Secure Cloud for anything customer-facing; Community/spot for batch.

Quote for Batch / interruptible GPU jobs

Depot Pick stays RunPod. Prices below are sourced SKU rows only (as of 2026-10-27). Input and output are not blended. GET /api/quote?jtbd=batch-gpu

Pick is not a price winner. runpod matching USD per GPU-hour is 0.34; cheapest among candidates is salad at 0.09.

  • A100 SXM Pod (Community Cloud) usd_per_gpu_hour $1.39 source as of 2026-10-19
  • A100 SXM Pod (Secure Cloud) usd_per_gpu_hour $1.79 source as of 2026-10-19
  • B200 Pod (Community Cloud) usd_per_gpu_hour $5.98 source as of 2026-10-19
  • B200 Pod (Secure Cloud) usd_per_gpu_hour $7.99 source as of 2026-10-19
  • H100 SXM Pod (Community Cloud) usd_per_gpu_hour $2.69 source as of 2026-10-19
  • H100 SXM Pod (Secure Cloud) usd_per_gpu_hour $3.99 source as of 2026-10-19
  • H200 Pod (Community Cloud) usd_per_gpu_hour $3.59 source as of 2026-10-19
  • H200 Pod (Secure Cloud) usd_per_gpu_hour $5.29 source as of 2026-10-19
  • L40S Pod (Community Cloud) usd_per_gpu_hour $0.79 source as of 2026-10-19
  • L40S Pod (Secure Cloud) usd_per_gpu_hour $1.09 source as of 2026-10-19
  • RTX 4090 Pod (Community Cloud) usd_per_gpu_hour $0.34 source as of 2026-10-19
  • RTX 4090 Pod (Secure Cloud) usd_per_gpu_hour $0.89 source as of 2026-10-19

5 of 10 candidates have no sourced price row. 6 are excluded from the USD per GPU-hour comparison (gpu_hour). min sourced GPU-hour SKU among candidates; not coerced to $/1M; per-second GPU was not included; not quality-adjusted

Sourced USD per GPU-hour for Batch / interruptible GPU jobs

Candidates for this job that already have a matching sourced price (gpu_hour), cheapest first. As of 2026-10-27. Each figure is one SKU in that unit, not a blend of input and output, not a cross-modal rate, and not a Depot score. min sourced GPU-hour SKU among candidates; not coerced to $/1M; per-second GPU was not included; not quality-adjusted The Depot Pick is not a price winner.

ProviderUSD per GPU-hourSKUSourceAs of
SaladCloud$0.09usd_per_gpu_hourRTX 3090 24GB (Lowest priority, batch)pricing page2026-10-19
RunPodDepot Pick$0.34usd_per_gpu_hourRTX 4090 Pod (Community Cloud)pricing page2026-10-19
Massed Compute$0.97usd_per_gpu_hourL40S (48GB) x1pricing page2026-10-19
Verda$1.845usd_per_gpu_hour1x L40S 48GBpricing page2026-10-27

Runners-up

When NOT to use the top pick

Strict deadlines without restart logic — dedicated on-demand.

Full ranking (score table)

Ranked with this JTBD's weights. Scores are curated estimates unless marked otherwise. Agents: prefer /api/decide then this table for tie-breaks.

#ProviderOverallFit$/perfLatencyDXAs of
1Modal8.49.08.28.69.62026-10-19
2RunPodDepot Pick8.38.89.08.08.82026-10-19
3Verda8.28.68.28.48.42026-09-14
4Thunder Compute7.77.28.87.48.22026-09-14
5FluidStack7.58.08.47.26.82026-09-14
6Massed Compute7.57.68.27.47.22026-09-14
7AWS GPU (EC2/P5/SageMaker)7.49.44.89.57.02026-09-14
8TensorDock7.27.28.86.27.22026-09-14
9Vast.ai7.27.09.84.57.22026-09-14
10SaladCloud7.06.59.55.07.02026-10-19

Score methodology for this job

pricePerf + dx for spot/serverless batch.

  • capabilityFit: 22%
  • pricePerformance: 25%
  • latencyReliability: 15%
  • developerDx: 12%
  • privacyPosture: 8%
  • lockInRisk: 8%
  • maturity: 10%