{"jtbd":{"id":"serverless-gpu","slug":"serverless-gpu","name":"Serverless GPU inference/jobs","shortName":"Serverless GPU inference/jobs","problemStatement":"Run GPU work with scale-to-zero and minimal ops."},"pick":{"id":"modal","slug":"modal","name":"Modal","tagline":"Depot darling for Python agent backends and bursty GPU jobs. If you think in functions not VMs, start here.","website":"https://modal.com","overall":8.36,"scoreBand":{"low":7.8,"mid":8.4,"high":9,"halfWidth":0.6,"basis":"editorial_prior","display":"7.8–9.0 (editorial prior)"},"scoreLayers":{"editorialPrior":8.36,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-10-19","pricingNotes":"As of 2026-10-24 (modal.com/pricing, fetched 2026-10-24): Python-native serverless GPU/CPU billed per second of compute ('You never pay for idle resources'). GPU list rates per second: H100 SXM5 '$0.001097', H200 SXM '$0.001261', B200 '$0.001736', A100 80 GB '$0.000694', L40S '$0.000542', A10 '$0.000306', L4 '$0.000222', T4 '$0.000164'; CPU '$0.0000131' per core per second (physical core, 2 vCPU equivalent); memory '$0.00000222' per GiB per second. Region selection '1.15 - 1.75x base prices'; non-preemptible execution '3x base prices' ('Sandboxes are billed at non-preemptible rates of 3x list price.'). Containers are kept alive '60 seconds after the last inputs', which is billed (configurable). Plans: Starter '$0 + compute / month' with '$30 / month free credits' ('100 containers + 10 GPU concurrency'); Team '$250 + compute / month' with '$100 / month free credits' ('5000 containers + 50 GPU concurrency'); Enterprise custom. Shared Endpoints are 'billed per token rather than per second' and not covered by included compute ('This took effect September 1, 2026.'). Excellent DX for jobs and endpoints; cold starts matter for interactive agents.","scores":{"capabilityFit":9,"pricePerformance":8.2,"latencyReliability":8.6,"developerDx":9.6,"privacyPosture":7.8,"lockInRisk":4.5,"maturity":8.2,"overall":8.36,"kind":"curated_estimate","confidence":"high","asOf":"2026-10-19"}},"runnersUp":[{"id":"runpod","slug":"runpod","name":"RunPod","tagline":"Depot default for self-serve GPUs. Secure Cloud for anything customer-facing; Community/spot for batch.","website":"https://www.runpod.io","overall":8.34,"scoreBand":{"low":7.7,"mid":8.3,"high":8.9,"halfWidth":0.6,"basis":"editorial_prior","display":"7.7–8.9 (editorial prior)"},"scoreLayers":{"editorialPrior":8.34,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-19","editorialPriorAsOf":"2026-10-19","pricingNotes":"Secure Cloud + Community Cloud; serverless per-second; H100 often ~$2–3+/hr depending tier; spot cheaper.","scores":{"capabilityFit":8.8,"pricePerformance":9,"latencyReliability":8,"developerDx":8.8,"privacyPosture":7,"lockInRisk":3.5,"maturity":8.2,"overall":8.34,"kind":"curated_estimate","confidence":"high","asOf":"2026-10-19"}},{"id":"replicate","slug":"replicate","name":"Replicate","tagline":"Ship a model demo by lunch. Migrate hot paths to Modal/RunPod/Fireworks when the bill hurts.","website":"https://replicate.com","overall":7.63,"scoreBand":{"low":7,"mid":7.6,"high":8.2,"halfWidth":0.6,"basis":"editorial_prior","display":"7.0–8.2 (editorial prior)"},"scoreLayers":{"editorialPrior":7.63,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"Run Cog models per-second; prediction-based billing; higher effective GPU cost, lowest friction.","scores":{"capabilityFit":8.4,"pricePerformance":6,"latencyReliability":8.2,"developerDx":9.4,"privacyPosture":7,"lockInRisk":4,"maturity":8.8,"overall":7.63,"kind":"curated_estimate","confidence":"high","asOf":"2026-09-14"}},{"id":"beam","slug":"beam","name":"Beam","tagline":"Viable Modal/RunPod alternative for serverless endpoints. Evaluate cold starts on your workload.","website":"https://www.beam.cloud","overall":7.57,"scoreBand":{"low":7,"mid":7.6,"high":8.2,"halfWidth":0.6,"basis":"editorial_prior","display":"7.0–8.2 (editorial prior)"},"scoreLayers":{"editorialPrior":7.57,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"As of 2026-09-14 (beam.cloud/pricing live): Developer **$0/mo + usage**; Team **$89/mo + usage** (3 seats, +$25/seat); Growth contact. Page headline: sandboxes from **$0.319/hr**, H100s from **$1.83/hr**. Example CPU calc: 2 cores (4 vCPU) $0.09 + 8 GiB $0.06 = $0.15/hr. GPU concurrency 5/50/1000+ by tier. BYOC management fee $0.019/vCPU-hr + $0.009/GB-RAM-hr (compute on your cloud bill). SOC2/HIPAA on higher tiers.","scores":{"capabilityFit":7.8,"pricePerformance":8,"latencyReliability":7.5,"developerDx":8.2,"privacyPosture":7,"lockInRisk":4,"maturity":7,"overall":7.57,"kind":"curated_estimate","confidence":"high","asOf":"2026-09-14"}},{"id":"baseten","slug":"baseten","name":"Baseten","tagline":"Strong custom-model serving alternative to Replicate/Modal when you bring your own model.","website":"https://www.baseten.co","overall":7.93,"scoreBand":{"low":7.3,"mid":7.9,"high":8.5,"halfWidth":0.6,"basis":"editorial_prior","display":"7.3–8.5 (editorial prior)"},"scoreLayers":{"editorialPrior":7.93,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"As of 2026-09-14 (baseten.co/pricing live): Model APIs + dedicated Truss deploys. Token examples: GLM-5.3-Flash $0.15/$0.50 per 1M (stored row). Per baseten.co/pricing as of 2026-10-21 (not stored as rows): GLM-5.3 and GLM-5.2 each input $1.40, cache input $0.14, output $4.40 per 1M; GLM-5.3 Fast and GLM-5.2 Fast each input $2.10, cache input $0.21, output $6.60 per 1M. GLM 4.7 is no longer listed on that page as of 2026-10-21, so its figure was removed. Dedicated GPU/VM rates published on page (e.g. 16 GiB VM ~$0.01052, L4 ~$0.01414, A10G ~$0.02012, A100/B200 class higher). Basic self-serve; Pro priority GPUs; Enterprise BYOC/self-host. SOC2 Type II + HIPAA. No idle charge when scaled to zero.","scores":{"capabilityFit":8.4,"pricePerformance":7.8,"latencyReliability":8.4,"developerDx":8.6,"privacyPosture":7.5,"lockInRisk":4.5,"maturity":8,"overall":7.93,"kind":"curated_estimate","confidence":"high","asOf":"2026-09-14"}},{"id":"chutes","slug":"chutes","name":"Chutes","tagline":"Budget open-model overflow with a now-pinned public TEE matrix. Depot open-model production pick stays…","website":"https://chutes.ai","overall":7.42,"scoreBand":{"low":6.8,"mid":7.4,"high":8,"halfWidth":0.6,"basis":"editorial_prior","display":"6.8–8.0 (editorial prior)"},"scoreLayers":{"editorialPrior":7.42,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"As of 2026-10-27 (chutes.ai/pricing, fetched twice 2026-10-27): Public TEE inference PAYG per 1M tokens, input/output (the page says per-model rates are 'pulled live from our pricing API'): gemma-4-31B-turbo $0.12/$0.37; Qwen3.8-27B $0.039/$1.25; Qwen3.6-27B $0.25/$2.00; DeepSeek-V4-Flash-0731 $0.44/$1.32; Kimi K2.6 $0.39/$1.80; Qwen 3.5 (397B-A17B) $0.45/$3.00; DeepSeek-V3.2 $1.00/$1.00; GLM-5.1 $0.90/$2.90; GLM-5.2 $1.25/$3.95; Kimi-K3 $1.85/$9.50 (cached-input rates also on page, not stored). Mistral-Nemo, Nemotron-3-Nano-Omni-30B, Qwen3-32B and Qwen3-235B-A22B-Thinking-2507 are no longer on the page (re-checked 2026-10-27; stored rows kept at their 2026-10-03 amounts, marked unverified, never ranked). Private Chute self-serve TEE GPU RTX Pro 6000 96 GB $1.80/hr + one-time deploy fee 3× hourly ($5.40). Page FAQ: 'Monthly plans are no longer sold on chutes.ai' (stored Plus $10 and Pro $20 rows kept from 2026-10-03, marked unverified, never ranked); no free tier. Matrix moves — re-curl before commits.","scores":{"capabilityFit":7.4,"pricePerformance":9.2,"latencyReliability":6.8,"developerDx":7.6,"privacyPosture":5.8,"lockInRisk":4,"maturity":6.2,"overall":7.42,"kind":"curated_estimate","confidence":"high","asOf":"2026-09-14"}},{"id":"friendli","slug":"friendli","name":"FriendliAI","tagline":"Open-model production peer when latency/tool-calling matter. Fireworks remains depot open-model default…","website":"https://friendli.ai","overall":7.99,"scoreBand":{"low":7.4,"mid":8,"high":8.6,"halfWidth":0.6,"basis":"editorial_prior","display":"7.4–8.6 (editorial prior)"},"scoreLayers":{"editorialPrior":7.99,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-10-01","pricingNotes":"As of 2026-10-01 (friendli.ai/pricing live): Dedicated Endpoints on-demand step-up **is live** — A100 **$4.0**/hr, H100 **$5.0**/hr, H200 **$7.0**/hr, B200 **$9.0**/hr, B300 $12.0/hr (was through-Sep-30: A100 $2.9, H100 $3.9, H200 $4.5, B200 $8.9, B300 $12.0). Billed per second; no idle/startup charge. Model API token examples on page (GLM/DeepSeek/MiniMax/whisper). SOC2 + HIPAA.","scores":{"capabilityFit":8.4,"pricePerformance":8,"latencyReliability":8.4,"developerDx":8.2,"privacyPosture":8.2,"lockInRisk":4,"maturity":7.6,"overall":7.99,"kind":"curated_estimate","confidence":"high","asOf":"2026-10-01"}},{"id":"koyeb","slug":"koyeb","name":"Koyeb","tagline":"Serverless GPU/app peer for EU-friendly deploys. Depot neocloud pick stays Nebius; interruptible Salad…","website":"https://www.koyeb.com","overall":8.11,"scoreBand":{"low":7.5,"mid":8.1,"high":8.7,"halfWidth":0.6,"basis":"editorial_prior","display":"7.5–8.7 (editorial prior)"},"scoreLayers":{"editorialPrior":8.11,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"As of 2026-09-14 (koyeb.com/pricing): Per-second serverless. GPUs: RTX-4000 $0.50; L4 $0.70; A6000 $0.75; L40S $1.20; A100 $1.60; A100 SXM $2.15; H100 **$2.50**; H200 $3.00; B200 $5.50 (multi-GPU SKUs listed). Pro $29/mo +compute ($10 included); Scale $299; Enterprise custom. Postgres Small ~$0.04/hr.","scores":{"capabilityFit":8.2,"pricePerformance":8.4,"latencyReliability":8.2,"developerDx":8.8,"privacyPosture":7.8,"lockInRisk":3.6,"maturity":7.8,"overall":8.11,"kind":"curated_estimate","confidence":"high","asOf":"2026-09-14"}}],"scoreBand":{"low":7.8,"mid":8.4,"high":9,"halfWidth":0.6,"basis":"editorial_prior","display":"7.8–9.0 (editorial prior)"},"scoreLayers":{"editorialPrior":8.36,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"whyPickOverHigherScore":{"pickId":"modal","pickName":"Modal","pickScore":8.36,"highestScoredCandidateId":"modal","highestScoredCandidateName":"Modal","highestScore":8.36,"pickHasLowerCompositeScore":false,"delta":0,"pickLeadsOnDimensions":[],"explanation":"Modal (8.36) holds both the highest composite score among ranked candidates and the editorial pick for Serverless GPU inference/jobs: dx + pricePerf + reliability. Modal wins Python DX; RunPod wins flexible $/GPU."},"cheapest":{"providerId":"runpod","providerName":"RunPod","skuId":"runpod-pod-rtx-4090-community","item":"RTX 4090 Pod (Community Cloud)","plan":"RTX 4090 Pod (Community Cloud) — On-demand Pod, Community Cloud (third-party hosts), per GPU per hour","unit":"usd_per_gpu_hour","amountUsd":0.34,"isFloorPrice":true,"floorWarning":"Provider-wide floor SKU; may not be the flagship model scored for this JTBD.","skuCountInUnit":12,"isDepotPick":false,"sourceUrl":"https://www.runpod.io/pricing","asOf":"2026-10-19","verifiedAsOf":"2026-10-19"},"recommendedWorkloadQuote":{"providerId":"modal","providerName":"Modal","skuId":"modal-memory-usd-per-gib-second","item":"Memory","plan":"Memory — Container memory","unit":"usd_per_gib_second","amountUsd":0.00000222,"outputSkuId":null,"outputItem":null,"outputAmountUsd":null,"outputUnit":null,"sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","pricingLastVerifiedAt":"2026-10-27","isFlagshipForJob":false,"differsFromFloorCheapest":false,"representativeQuote":{"skuId":"modal-memory-usd-per-gib-second","item":"Memory","plan":"Memory — Container memory","amountUsd":0.00000222,"inputOrUnitUsd":0.00000222,"unit":"usd_per_gib_second","outputUsd":null,"outputUnit":null,"sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27"},"estimatedTaskCost":{"tasks":1000,"retryAndToolOverheadMultiplier":1.15,"retryToolOverheadMultiplier":1.15,"unitsPerTask":1,"baseCostPer1kTasksUsd":0,"totalUsd":0,"estimatedTotalUsd":0,"perTaskUsd":0,"estimatedCostPerTaskUsd":0,"formula":"$0.00000222 (usd_per_gib_second) * 1.15 overhead","assumptions":"1,000 tasks in job native unit with 1.15x retry overhead."}},"representativeQuote":{"skuId":"modal-memory-usd-per-gib-second","item":"Memory","plan":"Memory — Container memory","amountUsd":0.00000222,"inputOrUnitUsd":0.00000222,"unit":"usd_per_gib_second","outputUsd":null,"outputUnit":null,"sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27"},"estimatedTaskCost":{"tasks":1000,"retryAndToolOverheadMultiplier":1.15,"retryToolOverheadMultiplier":1.15,"unitsPerTask":1,"baseCostPer1kTasksUsd":0,"totalUsd":0,"estimatedTotalUsd":0,"perTaskUsd":0,"estimatedCostPerTaskUsd":0,"formula":"$0.00000222 (usd_per_gib_second) * 1.15 overhead","assumptions":"1,000 tasks in job native unit with 1.15x retry overhead."},"freeAlternatives":[],"referenceDocs":[],"falsification":{"jtbdId":"serverless-gpu","jtbdName":"Serverless GPU inference/jobs","currentPickId":"modal","currentPickScore":8.36,"challengerId":"runpod","challengerScore":8.34,"currentScoreGap":0.02,"minVerifiedOutcomes":10,"requiredOutcomeMargin":0.17,"requiredSuccessRateDelta":0.15,"maxPickPriceIncreasePct":25,"whatWouldChangePick":["RunPod (runpod) outperforms Modal (modal) by >= 0.17 outcome points (or >= 15% worked-rate delta) across >= 10 Countersign-verified production outcomes.","A verified price increase > 25% on Modal's representative SKU for serverless-gpu without a corresponding capability gain.","Live caller rail exhaustion (?exhausted=modal) or sustained >= 30% degraded/failed rate in verified production outcomes."],"frozenHoldoutPolicy":{"holdoutSplit":"20% frozen benchmark holdout tasks + 80% live production outcome receipts","requireCountersignReceipt":true,"requiredEvidenceTiers":["outcome_verified","reference_checked"],"minDistinctContributors":2,"antiGamingRule":"Unverified self-reports and seed/editorial rows never mutate picks or scores."},"triggers":[{"kind":"verified_outcomes_outperformance","challengerId":"runpod","minVerifiedOutcomes":10,"requiredOutcomeMargin":0.17,"requiredWorkedRateDelta":0.15},{"kind":"verified_price_increase","providerId":"modal","maxPriceIncreasePct":25},{"kind":"live_rail_exhaustion_or_degradation","providerId":"modal","immediateOverrideUrl":"/api/decide?jtbd=serverless-gpu&exhausted=modal"}],"submissionSpec":{"falsifyEndpoint":"/api/falsify?jtbd=serverless-gpu","outcomesEndpoint":"POST /api/feedback","correctionsEndpoint":"POST /api/corrections","payloadTemplate":{"agentIdentity":"agent:<your-agent-id>","jtbdId":"serverless-gpu","providerId":"runpod","outcome":"worked","detail":"Comparative production evaluation on serverless-gpu (n>=10 tasks) with Countersign receipt.","confidence":"high","receipt":{"countersign":{"claim_id":"cs-00000000","status":"verified","evidence_tier":"outcome_verified","counts_as_verified":true}}}}},"whatWouldChangePick":["RunPod (runpod) outperforms Modal (modal) by >= 0.17 outcome points (or >= 15% worked-rate delta) across >= 10 Countersign-verified production outcomes.","A verified price increase > 25% on Modal's representative SKU for serverless-gpu without a corresponding capability gain.","Live caller rail exhaustion (?exhausted=modal) or sustained >= 30% degraded/failed rate in verified production outcomes."],"routePlan":{"jtbdId":"serverless-gpu","primary":{"providerId":"modal","name":"Modal","overall":8.36,"scoreBand":{"low":7.8,"mid":8.4,"high":9,"halfWidth":0.6,"basis":"editorial_prior","display":"7.8–9.0 (editorial prior)"},"scoreLayers":{"editorialPrior":8.36,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-10-19","role":"primary","reason":"Editorial Depot Pick for Serverless GPU inference/jobs; healthy/eligible under caller constraints."},"fallback":[{"providerId":"runpod","name":"RunPod","overall":8.34,"scoreBand":{"low":7.7,"mid":8.3,"high":8.9,"halfWidth":0.6,"basis":"editorial_prior","display":"7.7–8.9 (editorial prior)"},"scoreLayers":{"editorialPrior":8.34,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-19","editorialPriorAsOf":"2026-10-19","role":"fallback","reason":"Ranked fallback route for Serverless GPU inference/jobs."},{"providerId":"replicate","name":"Replicate","overall":7.63,"scoreBand":{"low":7,"mid":7.6,"high":8.2,"halfWidth":0.6,"basis":"editorial_prior","display":"7.0–8.2 (editorial prior)"},"scoreLayers":{"editorialPrior":7.63,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"fallback","reason":"Ranked fallback route for Serverless GPU inference/jobs."},{"providerId":"beam","name":"Beam","overall":7.57,"scoreBand":{"low":7,"mid":7.6,"high":8.2,"halfWidth":0.6,"basis":"editorial_prior","display":"7.0–8.2 (editorial prior)"},"scoreLayers":{"editorialPrior":7.57,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"fallback","reason":"Ranked fallback route for Serverless GPU inference/jobs."},{"providerId":"baseten","name":"Baseten","overall":7.93,"scoreBand":{"low":7.3,"mid":7.9,"high":8.5,"halfWidth":0.6,"basis":"editorial_prior","display":"7.3–8.5 (editorial prior)"},"scoreLayers":{"editorialPrior":7.93,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"fallback","reason":"Ranked fallback route for Serverless GPU inference/jobs."},{"providerId":"chutes","name":"Chutes","overall":7.42,"scoreBand":{"low":6.8,"mid":7.4,"high":8,"halfWidth":0.6,"basis":"editorial_prior","display":"6.8–8.0 (editorial prior)"},"scoreLayers":{"editorialPrior":7.42,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"fallback","reason":"Ranked fallback route for Serverless GPU inference/jobs."},{"providerId":"friendli","name":"FriendliAI","overall":7.99,"scoreBand":{"low":7.4,"mid":8,"high":8.6,"halfWidth":0.6,"basis":"editorial_prior","display":"7.4–8.6 (editorial prior)"},"scoreLayers":{"editorialPrior":7.99,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-10-01","role":"fallback","reason":"Ranked fallback route for Serverless GPU inference/jobs."},{"providerId":"koyeb","name":"Koyeb","overall":8.11,"scoreBand":{"low":7.5,"mid":8.1,"high":8.7,"halfWidth":0.6,"basis":"editorial_prior","display":"7.5–8.7 (editorial prior)"},"scoreLayers":{"editorialPrior":8.11,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"fallback","reason":"Ranked fallback route for Serverless GPU inference/jobs."}],"disqualified":[],"expectedRegret":{"scoreDeltaVsUnconstrainedPick":0,"unconstrainedPickId":"modal","activePrimaryId":"modal","summary":"0.00 score regret: unconstrained editorial pick satisfies all caller constraints."},"evidenceAgeDays":{"editorialScoreAgeDays":8,"pricingVerifiedAgeDays":0,"editorialPriorAsOf":"2026-10-19","pricingLastVerifiedAt":"2026-10-27"},"confidenceBand":{"low":7.8,"mid":8.4,"high":9,"halfWidth":0.6,"basis":"editorial_prior","display":"7.8–9.0 (editorial prior)"},"constraintsApplied":false,"constraintBundle":{"task":null,"jtbd":"serverless-gpu","quotaExhausted":[],"degraded":[],"healthy":[],"budgetUsd":null,"maxLatencyMs":null,"region":null,"privacy":null,"exit":[],"existing":[]}},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-10-19","tie":true,"scoreGap":0.02,"decidingFactor":"developerDx (9.6 vs 8.8)","tieNote":"Scores are within 0.10 on a curated_estimate 0-10 scale (8.36 vs 8.34); treat as a statistical tie and decide on decidingFactor or whenNotTopPick.","rationale":"dx + pricePerf + reliability. Modal wins Python DX; RunPod wins flexible $/GPU.","whenNotTopPick":"Need cheapest raw GPU-seconds on familiar pods (RunPod) or one-click public models (Replicate).","skipTopPick":false,"skipReason":null,"matchedConstraints":[],"pricingSummary":"As of 2026-10-24 (modal.com/pricing, fetched 2026-10-24): Python-native serverless GPU/CPU billed per second of compute ('You never pay for idle resources'). GPU list rates per second: H100 SXM5 '$0.001097', H200 SXM '$0.001261', B200 '$0.001736', A100 80 GB '$0.000694', L40S '$0…","cite":"Depot Pick for serverless-gpu: modal (asOf 2026-10-19). See GET /api/jtbds/serverless-gpu + GET /api/methodology.","nextActions":[{"step":1,"title":"Inspect full JTBD + embeds","href":"/api/jtbds/serverless-gpu?embed=providers","why":"Confirm pick, runners-up, and methodology notes."},{"step":2,"title":"Quote sourced SKUs","href":"/api/quote?jtbd=serverless-gpu","why":"Depot Pick SKUs plus the cheapest sourced SKU whose unit matches this job. Does not change the pick. Does not blend input and output or borrow a chat rate for a non-chat job."},{"step":3,"title":"Open provider detail","href":"/api/providers/modal","why":"Scores, pricingNotes, strengths/weaknesses, communitySignals (claims only)."},{"step":4,"title":"Cite methodology","href":"/api/methodology","why":"Required when publishing a Depot Pick citation."},{"step":5,"title":"Grab badge SVG","href":"/api/badge?type=depot-pick&jtbd=serverless-gpu","why":"Embed in README / agent passport."},{"step":6,"title":"Post production insight","method":"POST","href":"/api/insights","why":"Unverified until curated; never auto-mutates official scores."}],"honesty":["Do not invent scores or benches.","Insights are claims until curated/reviewed; they never silently mutate official scores.","lockInRisk higher = more lock-in (worse).","normalizedUsdPerMillionTokens is set only for a single sourced token row. Otherwise null, with a machine-readable reason. Do not coerce GPU, minute, or per-1k search units.","Runners-up are not Depot Picks.","Depot overall is editorial_weighted, not Arena Elo and not an Artificial Analysis index."],"asOf":"2026-10-19","depth":{"whenNotToUse":{"text":"Need cheapest raw GPU-seconds on familiar pods (RunPod) or one-click public models (Replicate).","source":"editorial `whenNotTopPick` (data/jtbds.json)"},"whenNotToUseReason":null,"runnerUp":{"providerId":"runpod","name":"RunPod","overallForJob":8.34,"pickOverallForJob":8.36,"beatsPickOn":["pricePerformance","lockInRisk"],"source":"first resolvable entry of the job's editorially ranked `runnersUpIds`; scores are stored job-weighted scores"},"runnerUpReason":null,"lockIn":{"pickLockInRisk":4.5,"runnerUpLockInRisk":3.5,"scale":"0–10 stored curated estimate; higher = more lock-in (worse)","pickExitSignals":[],"runnerUpExitSignals":[],"pickNotes":[],"selfHostFallback":[],"migration":"Runner-up RunPod has lower stored lock-in risk (3.5 vs 4.5, 0–10, higher = more lock-in).","migrationReason":null,"derivedFrom":"stored lockInRisk scores, provider tags (oss, self-host, openai-compat, open-models), free rows that list this job, and verbatim provider notes. No migration guide was invented."}},"citation":{"text":"Agent Provider Depot (v0.12.152), Depot Pick for serverless-gpu: modal, scores as of 2026-10-19, retrieved 2026-10-27. https://getagentdepot.com/jtbds/serverless-gpu","markdown":"[Agent Provider Depot](https://getagentdepot.com/jtbds/serverless-gpu) (v0.12.152) — Depot Pick for `serverless-gpu`: **modal** (scores as of 2026-10-19, retrieved 2026-10-27)","fields":{"publisher":"Agent Provider Depot","version":"0.12.152","role":"depot_pick","jtbdId":"serverless-gpu","providerId":"modal","scoreAsOf":"2026-10-19","retrievedOn":"2026-10-27","page":"https://getagentdepot.com/jtbds/serverless-gpu","api":"https://getagentdepot.com/api/decide?jtbd=serverless-gpu"},"howToCite":"Cite Depot as an editorial, dated recommendation, not a benchmark: name the job, the Depot Pick (or runner-up), the score asOf date and the day you retrieved it, and link the job page. Format: “Agent Provider Depot (v{version}), Depot Pick for {jobId}: {providerId}, scores as of {scoreAsOf}, retrieved {retrievedOn}. {baseUrl}/jtbds/{jobId}”. Quote prices only with their own sourceUrl and asOf. If the pick's score is stale (freshness.pick.score.stale), say so."},"freshness":{"pick":{"score":{"asOf":"2026-10-19","ageDays":8,"stale":false,"staleAfterDays":30,"reason":null},"lastReviewed":{"asOf":"2026-10-19","ageDays":8,"stale":false,"staleAfterDays":30,"reason":null},"sourceCheck":{"checkedAt":"2026-10-27","sourceUrls":2,"sourcesReachable":2,"pricingRows":18,"pricingRowsReconfirmed":18,"note":"A source re-check confirms the page is reachable and, for pricing rows, that the stored amount and SKU name appear on it. It does not re-derive or change the score.","reason":null}},"scoreAsOf":"2026-10-19","editorialPriorAsOf":"2026-10-19","pricingLastVerifiedAt":"2026-10-27","pickLastReviewed":"2026-10-19","runnersUpScoreAsOf":["2026-10-19","2026-09-14","2026-09-14","2026-09-14","2026-09-14","2026-10-01","2026-09-14"],"contractAsOf":"2026-10-03","pricingShape":"sourced_rows","normalizedUsdPerMillionTokens":null,"normalizationStatus":"unit_mismatch","normalizationReason":"unit_mismatch"},"pricingContract":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"unit_mismatch","normalizationReason":"unit_mismatch","shape":"sourced_rows","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[{"id":"modal-nvidia-b300-usd-per-gpu-second","providerId":"modal","sku":"Nvidia B300","unit":"usd_per_gpu_second","amountUsd":0.001972,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-b200-usd-per-gpu-second","providerId":"modal","sku":"Nvidia B200","unit":"usd_per_gpu_second","amountUsd":0.001736,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-h200-sxm-usd-per-gpu-second","providerId":"modal","sku":"Nvidia H200 SXM","unit":"usd_per_gpu_second","amountUsd":0.001261,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-h100-sxm5-usd-per-gpu-second","providerId":"modal","sku":"Nvidia H100 SXM5","unit":"usd_per_gpu_second","amountUsd":0.001097,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-rtx-pro-6000-usd-per-gpu-second","providerId":"modal","sku":"Nvidia RTX PRO 6000","unit":"usd_per_gpu_second","amountUsd":0.000842,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-a100-80gb-usd-per-gpu-second","providerId":"modal","sku":"Nvidia A100 80GB","unit":"usd_per_gpu_second","amountUsd":0.000694,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-a100-40gb-usd-per-gpu-second","providerId":"modal","sku":"Nvidia A100 40GB","unit":"usd_per_gpu_second","amountUsd":0.000583,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-l40s-usd-per-gpu-second","providerId":"modal","sku":"Nvidia L40S","unit":"usd_per_gpu_second","amountUsd":0.000542,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-a10-usd-per-gpu-second","providerId":"modal","sku":"Nvidia A10","unit":"usd_per_gpu_second","amountUsd":0.000306,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-l4-usd-per-gpu-second","providerId":"modal","sku":"Nvidia L4","unit":"usd_per_gpu_second","amountUsd":0.000222,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-t4-usd-per-gpu-second","providerId":"modal","sku":"Nvidia T4","unit":"usd_per_gpu_second","amountUsd":0.000164,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-cpu-physical-core-usd-per-core-second","providerId":"modal","sku":"CPU physical core","unit":"usd_per_core_second","amountUsd":0.0000131,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_core_second","priceSortEligible":false,"qualifier":"Physical core (2 vCPU). Minimum 0.125 cores."},{"id":"modal-memory-usd-per-gib-second","providerId":"modal","sku":"Memory","unit":"usd_per_gib_second","amountUsd":0.00000222,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gib_second","priceSortEligible":false,"qualifier":"Container memory."},{"id":"modal-sandbox-cpu-usd-per-core-second","providerId":"modal","sku":"Sandbox CPU","unit":"usd_per_core_second","amountUsd":0.00003942,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_core_second","priceSortEligible":false,"qualifier":"Modal Sandbox rate (page: 'Modal Sandbox pricing', 'CPU (non-preemptible)'; 'Sandboxes are billed at non-preemptible rates of 3x list price'), separate from the default CPU rate."},{"id":"modal-sandbox-memory-usd-per-gib-second","providerId":"modal","sku":"Sandbox memory","unit":"usd_per_gib_second","amountUsd":0.00000667,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gib_second","priceSortEligible":false,"qualifier":"Sandbox memory (page: 'Memory (non-preemptible)' under 'Modal Sandbox pricing')."},{"id":"modal-volumes-usd-per-gib-month","providerId":"modal","sku":"Volumes","unit":"usd_per_gib_month","amountUsd":0.09,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gib_month","priceSortEligible":false,"qualifier":"Includes 1 TiB/mo free, not folded into this rate."},{"id":"modal-network-egress-usd-per-gib","providerId":"modal","sku":"Network egress","unit":"usd_per_gib","amountUsd":0.04,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gib","priceSortEligible":false,"qualifier":"See plan for included usage."},{"id":"modal-team-plan-usd-per-month","providerId":"modal","sku":"Team plan","unit":"usd_per_month","amountUsd":250,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_month","priceSortEligible":false,"qualifier":"Plus compute. $100/mo credits not subtracted."}],"notesExcerpt":"As of 2026-10-24 (modal.com/pricing, fetched 2026-10-24): Python-native serverless GPU/CPU billed per second of compute ('You never pay for idle resources'). GPU list rates per second: H100 SXM5 '$0.001097', H200 SXM '$0.001261', B200 '$0.001736', A100 80 GB '$0.000694', L40S '$0…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-10-19","scoreAsOf":"2026-10-19","website":"https://modal.com","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"links":{"jtbd":"/jtbds/serverless-gpu","jtbdApi":"/api/jtbds/serverless-gpu","leaderboard":"/api/leaderboards?jtbd=serverless-gpu","methodology":"/api/methodology","badge":"/api/badge?type=depot-pick&jtbd=serverless-gpu","decide":"/api/decide?jtbd=serverless-gpu","humanPage":"/jtbds/serverless-gpu","alternatives":"/api/alternatives?provider=modal","canonical":"/api/canonical","quote":"/api/quote?jtbd=serverless-gpu","falsify":"/api/falsify?jtbd=serverless-gpu"},"constraintBundle":{"task":null,"jtbd":"serverless-gpu","quotaExhausted":[],"degraded":[],"healthy":[],"budgetUsd":null,"maxLatencyMs":null,"region":null,"privacy":null,"exit":[],"existing":[]},"stackContext":{"host":null,"framework":null,"repo":null,"lang":null,"existing":[],"volume":null,"sender":null,"detectedFromTask":[]},"keep":null,"contextAdvice":null,"communityFeedback":{"pickOnThisJob":{"failed":0,"degraded":0,"worked":0,"insights":0,"withVerifiedReceipt":0,"failureModes":{},"latestAt":null,"note":"Agent-reported claims (unverified unless a receipt is verified by Depot's re-check). They never change scores or picks."},"outcomes":{"job":{"n":0,"worked":0,"degraded":0,"failed":0,"failureModes":{},"verifiedReports":0,"contributors":0,"excluded":{"seed_editorial":0,"test":0,"notFeedback":0},"reason":"no_submitted_outcome_reports_yet"},"pick":{"providerId":"modal","n":0,"worked":0,"degraded":0,"failed":0,"failureModes":{},"evidenceTiers":{"agent_claim":0,"self_declared":0,"reference_checked":0,"outcome_verified":0},"reason":"no_submitted_outcome_reports_yet"},"scoresMutated":false,"more":"/api/outcomes?jtbd=serverless-gpu"},"report":"POST /api/feedback {agentIdentity, outcome: failed|degraded|worked, detail, providerId, jtbdId, failureModeId?, receipt?}"}}