Batch / interruptible GPU jobs
Offline evals, embeddings, or training steps that tolerate preemption.
At a glance — Oct 2026
Updated 2026-10-27 · forward this page: /jtbds/batch-gpu#briefScores as of 2026-10-19 (8 days old).
- Depot Pick
- RunPod · 8.34/10 for this job (curated estimate, high confidence)
pricePerf + dx for spot/serverless batch.
- Runner-up
- Vast.ai · 7.20/10
Scores higher than the pick on: Price / performance, Lock-in risk (higher = worse).
- When not to use the pick
- Strict deadlines without restart logic — dedicated on-demand.
- Lock-in / migration
- Runner-up Vast.ai has lower stored lock-in risk (2.5 vs 3.5, 0–10, higher = more lock-in).
- Sourced price (usd_per_gpu_hour)
Pick's lowest sourced SKU: RTX 4090 Pod (Community Cloud) $0.34 (usd_per_gpu_hour) — source, as of 2026-10-19
Cheapest matching SKU: SaladCloud RTX 3090 24GB (Lowest priority, batch) $0.09 — source, as of 2026-10-19. Not the pick; not quality-adjusted.
Price history: first seen 2026-10-19 · last changed no change recorded · history JSON
- Free option
- No free resource lists this job. A cheap paid SKU is not a free option.
- Failure modes to watch
- Partial tool success: Require a per-item status and a failure count. Success for the task requires the failed count to be zero or explicitly handed to a retry queue.
- Runaway spend: Set a budget and a tool-call cap per task. Alert when spend jumps. Stop the run at the cap instead of summarizing a partial trace as success.
Same-job, same-unit comparisons: RunPod vs SaladCloud
Cite: Agent Provider Depot, Depot Pick for batch-gpu: runpod, scores as of 2026-10-19. Agents: GET /api/decide?jtbd=batch-gpu
All sourced prices, cheapest first
RunPod
pricePerf + dx for spot/serverless batch.
Pricing (directional): Secure Cloud + Community Cloud; serverless per-second; H100 often ~$2–3+/hr depending tier; spot cheaper.
Lock-in risk: higher = more lock-in (worse). Overall already inverts this dimension.
Depot default for self-serve GPUs. Secure Cloud for anything customer-facing; Community/spot for batch.
Quote for Batch / interruptible GPU jobs
Depot Pick stays RunPod. Prices below are sourced SKU rows only (as of 2026-10-27). Input and output are not blended. GET /api/quote?jtbd=batch-gpu
Pick is not a price winner. runpod matching USD per GPU-hour is 0.34; cheapest among candidates is salad at 0.09.
- A100 SXM Pod (Community Cloud) usd_per_gpu_hour $1.39 source as of 2026-10-19
- A100 SXM Pod (Secure Cloud) usd_per_gpu_hour $1.79 source as of 2026-10-19
- B200 Pod (Community Cloud) usd_per_gpu_hour $5.98 source as of 2026-10-19
- B200 Pod (Secure Cloud) usd_per_gpu_hour $7.99 source as of 2026-10-19
- H100 SXM Pod (Community Cloud) usd_per_gpu_hour $2.69 source as of 2026-10-19
- H100 SXM Pod (Secure Cloud) usd_per_gpu_hour $3.99 source as of 2026-10-19
- H200 Pod (Community Cloud) usd_per_gpu_hour $3.59 source as of 2026-10-19
- H200 Pod (Secure Cloud) usd_per_gpu_hour $5.29 source as of 2026-10-19
- L40S Pod (Community Cloud) usd_per_gpu_hour $0.79 source as of 2026-10-19
- L40S Pod (Secure Cloud) usd_per_gpu_hour $1.09 source as of 2026-10-19
- RTX 4090 Pod (Community Cloud) usd_per_gpu_hour $0.34 source as of 2026-10-19
- RTX 4090 Pod (Secure Cloud) usd_per_gpu_hour $0.89 source as of 2026-10-19
5 of 10 candidates have no sourced price row. 6 are excluded from the USD per GPU-hour comparison (gpu_hour). min sourced GPU-hour SKU among candidates; not coerced to $/1M; per-second GPU was not included; not quality-adjusted
Sourced USD per GPU-hour for Batch / interruptible GPU jobs
Candidates for this job that already have a matching sourced price (gpu_hour), cheapest first. As of 2026-10-27. Each figure is one SKU in that unit, not a blend of input and output, not a cross-modal rate, and not a Depot score. min sourced GPU-hour SKU among candidates; not coerced to $/1M; per-second GPU was not included; not quality-adjusted The Depot Pick is not a price winner.
| Provider | USD per GPU-hour | SKU | Source | As of |
|---|---|---|---|---|
| SaladCloud | $0.09usd_per_gpu_hour | RTX 3090 24GB (Lowest priority, batch) | pricing page | 2026-10-19 |
| RunPodDepot Pick | $0.34usd_per_gpu_hour | RTX 4090 Pod (Community Cloud) | pricing page | 2026-10-19 |
| Massed Compute | $0.97usd_per_gpu_hour | L40S (48GB) x1 | pricing page | 2026-10-19 |
| Verda | $1.845usd_per_gpu_hour | 1x L40S 48GB | pricing page | 2026-10-27 |
Runners-up
Vast.ai
Cheapest GPUs if your job can die and restart. Never put customer PII training here without eyes wide open.
Modal
Depot darling for Python agent backends and bursty GPU jobs. If you think in functions not VMs, start here.
AWS GPU (EC2/P5/SageMaker)
Use when AWS is destiny. For greenfield agent GPUs, neoclouds win on price and speed-to-pod.
When NOT to use the top pick
Strict deadlines without restart logic — dedicated on-demand.
Full ranking (score table)
Ranked with this JTBD's weights. Scores are curated estimates unless marked otherwise. Agents: prefer /api/decide then this table for tie-breaks.
| # | Provider | Overall | Fit | $/perf | Latency | DX | As of |
|---|---|---|---|---|---|---|---|
| 1 | Modal | 8.4 | 9.0 | 8.2 | 8.6 | 9.6 | 2026-10-19 |
| 2 | RunPodDepot Pick | 8.3 | 8.8 | 9.0 | 8.0 | 8.8 | 2026-10-19 |
| 3 | Verda | 8.2 | 8.6 | 8.2 | 8.4 | 8.4 | 2026-09-14 |
| 4 | Thunder Compute | 7.7 | 7.2 | 8.8 | 7.4 | 8.2 | 2026-09-14 |
| 5 | FluidStack | 7.5 | 8.0 | 8.4 | 7.2 | 6.8 | 2026-09-14 |
| 6 | Massed Compute | 7.5 | 7.6 | 8.2 | 7.4 | 7.2 | 2026-09-14 |
| 7 | AWS GPU (EC2/P5/SageMaker) | 7.4 | 9.4 | 4.8 | 9.5 | 7.0 | 2026-09-14 |
| 8 | TensorDock | 7.2 | 7.2 | 8.8 | 6.2 | 7.2 | 2026-09-14 |
| 9 | Vast.ai | 7.2 | 7.0 | 9.8 | 4.5 | 7.2 | 2026-09-14 |
| 10 | SaladCloud | 7.0 | 6.5 | 9.5 | 5.0 | 7.0 | 2026-10-19 |
Score methodology for this job
pricePerf + dx for spot/serverless batch.
capabilityFit: 22%pricePerformance: 25%latencyReliability: 15%developerDx: 12%privacyPosture: 8%lockInRisk: 8%maturity: 10%