{"jtbd":{"id":"agent-ephemeral-ci","slug":"agent-ephemeral-ci","name":"Ephemeral CI runners for agent jobs","shortName":"Agent CI runners","problemStatement":"Spin isolated CPU/GPU sandboxes per CI job to run agent integration tests, tool mocks, and eval suites that need real browsers or kernels."},"pick":{"id":"modal","slug":"modal","name":"Modal","tagline":"Depot darling for Python agent backends and bursty GPU jobs. If you think in functions not VMs, start here.","website":"https://modal.com","overall":8.63,"scoreBand":{"low":8,"mid":8.6,"high":9.2,"halfWidth":0.6,"basis":"editorial_prior","display":"8.0–9.2 (editorial prior)"},"scoreLayers":{"editorialPrior":8.63,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-10-19","pricingNotes":"As of 2026-10-24 (modal.com/pricing, fetched 2026-10-24): Python-native serverless GPU/CPU billed per second of compute ('You never pay for idle resources'). GPU list rates per second: H100 SXM5 '$0.001097', H200 SXM '$0.001261', B200 '$0.001736', A100 80 GB '$0.000694', L40S '$0.000542', A10 '$0.000306', L4 '$0.000222', T4 '$0.000164'; CPU '$0.0000131' per core per second (physical core, 2 vCPU equivalent); memory '$0.00000222' per GiB per second. Region selection '1.15 - 1.75x base prices'; non-preemptible execution '3x base prices' ('Sandboxes are billed at non-preemptible rates of 3x list price.'). Containers are kept alive '60 seconds after the last inputs', which is billed (configurable). Plans: Starter '$0 + compute / month' with '$30 / month free credits' ('100 containers + 10 GPU concurrency'); Team '$250 + compute / month' with '$100 / month free credits' ('5000 containers + 50 GPU concurrency'); Enterprise custom. Shared Endpoints are 'billed per token rather than per second' and not covered by included compute ('This took effect September 1, 2026.'). Excellent DX for jobs and endpoints; cold starts matter for interactive agents.","scores":{"capabilityFit":9,"pricePerformance":8.2,"latencyReliability":8.6,"developerDx":9.6,"privacyPosture":7.8,"lockInRisk":4.5,"maturity":8.2,"overall":8.63,"kind":"curated_estimate","confidence":"high","asOf":"2026-10-19"}},"runnersUp":[{"id":"e2b","slug":"e2b","name":"E2B","tagline":"Depot default code sandbox for agents. Use for untrusted code; Daytona when you need persistent…","website":"https://e2b.dev","overall":8.7,"scoreBand":{"low":8.1,"mid":8.7,"high":9.3,"halfWidth":0.6,"basis":"editorial_prior","display":"8.1–9.3 (editorial prior)"},"scoreLayers":{"editorialPrior":8.7,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"Firecracker microVM sandboxes billed per second; templates; code interpreter for agents.","scores":{"capabilityFit":9.4,"pricePerformance":8,"latencyReliability":8.6,"developerDx":9.4,"privacyPosture":8.5,"lockInRisk":4,"maturity":8,"overall":8.7,"kind":"curated_estimate","confidence":"high","asOf":"2026-09-14"}},{"id":"fly-machines","slug":"fly-machines","name":"Fly Machines","tagline":"DIY sandbox substrate with global edge. Prefer E2B unless you need custom machine control.","website":"https://fly.io/docs/machines/","overall":8.17,"scoreBand":{"low":7.6,"mid":8.2,"high":8.8,"halfWidth":0.6,"basis":"editorial_prior","display":"7.6–8.8 (editorial prior)"},"scoreLayers":{"editorialPrior":8.17,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"API-driven Firecracker VMs on Fly; pay while running; great for custom sandboxes.","scores":{"capabilityFit":8.5,"pricePerformance":8.5,"latencyReliability":8.2,"developerDx":8,"privacyPosture":7.8,"lockInRisk":3,"maturity":8.5,"overall":8.17,"kind":"curated_estimate","confidence":"high","asOf":"2026-09-14"}},{"id":"daytona","slug":"daytona","name":"Daytona","tagline":"Choose when agents need sticky filesystems and full dev environments. E2B for disposable code exec. Confirm…","website":"https://daytona.io","overall":8.33,"scoreBand":{"low":7.7,"mid":8.3,"high":8.9,"halfWidth":0.6,"basis":"editorial_prior","display":"7.7–8.9 (editorial prior)"},"scoreLayers":{"editorialPrior":8.33,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"As of 2026-09-14 (daytona.io/pricing live): PAYG per-second — vCPU **$0.0504/h**, Memory **$0.0162/GiB-h**, Storage **$0.000108/GiB-h** (first 5 GiB free). $200 free compute signup. Windows $0.0858/vCPU-h. GPU preemptible $/hour (stored rows, reconfirmed 2026-10-27): H100 $2.27, H200 $2.61, B200 $3.59, RTX 4090 $0.57, RTX 5090 $0.74, RTX PRO 6000 $1.74. GPU on-demand $/hour (stored rows since 2026-10-27): H100 $3.95, H200 $4.54, B200 $6.25, B300 $6.25, MI355X $5.99, RTX 4090 $0.99, RTX 5090 $1.29, RTX PRO 6000 $3.03. Startup program up to $50k credits. Closed-source cloud mid-2026 — verify OSS assumptions.","scores":{"capabilityFit":8.8,"pricePerformance":8.2,"latencyReliability":8.2,"developerDx":8.8,"privacyPosture":8,"lockInRisk":3,"maturity":7.2,"overall":8.33,"kind":"curated_estimate","confidence":"high","asOf":"2026-09-14"}},{"id":"upstash-box","slug":"upstash-box","name":"Upstash Box","tagline":"Interesting E2B peer for freezeable agent computers. Keep medium until preview exits; production default…","website":"https://upstash.com/docs/box/overall/quickstart","overall":7.84,"scoreBand":{"low":7.2,"mid":7.8,"high":8.4,"halfWidth":0.6,"basis":"editorial_prior","display":"7.2–8.4 (editorial prior)"},"scoreLayers":{"editorialPrior":7.84,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-03","editorialPriorAsOf":"2026-09-14","pricingNotes":"As of 2026-09-14 (upstash.com/pricing/box): Still developer preview. Free: 10 concurrent, 5 CPU-hrs/mo, $1 LLM. PAYG Small/Med/Large **$0.10/$0.20/$0.40** per active CPU-hour; storage $0.1/GB-mo; Keep Alive $8/$16/$32/mo; PAYG LLM budget $100/mo + BYOK. Soft quota ~1000 concurrent. Re-pin when GA.","scores":{"capabilityFit":8,"pricePerformance":8.6,"latencyReliability":7.2,"developerDx":8.8,"privacyPosture":7.4,"lockInRisk":4.2,"maturity":5.8,"overall":7.84,"kind":"curated_estimate","confidence":"medium","asOf":"2026-09-14"}}],"scoreBand":{"low":8,"mid":8.6,"high":9.2,"halfWidth":0.6,"basis":"editorial_prior","display":"8.0–9.2 (editorial prior)"},"scoreLayers":{"editorialPrior":8.63,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"whyPickOverHigherScore":{"pickId":"modal","pickName":"Modal","pickScore":8.63,"highestScoredCandidateId":"e2b","highestScoredCandidateName":"E2B","highestScore":8.7,"pickHasLowerCompositeScore":true,"delta":-0.07,"pickLeadsOnDimensions":["pricePerformance (8.2 vs 8)","developerDx (9.6 vs 9.4)","maturity (8.2 vs 8)"],"explanation":"Modal (8.63) is the editorial pick for Ephemeral CI runners for agent jobs over higher-composite E2B (8.7) because composite scores are provider-wide priors while Modal wins on pricePerformance (8.2 vs 8), developerDx (9.6 vs 9.4), maturity (8.2 vs 8): Serverless GPU/CPU job DX for CI. Confidence: high for Modal; Box still preview."},"cheapest":null,"recommendedWorkloadQuote":{"providerId":"modal","providerName":"Modal","skuId":"modal-nvidia-t4-usd-per-gpu-second","item":"Nvidia T4","plan":"Nvidia T4 — Per-second rate shown with the per-second toggle","unit":"usd_per_gpu_second","amountUsd":0.000164,"outputSkuId":null,"outputItem":null,"outputAmountUsd":null,"outputUnit":null,"sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","pricingLastVerifiedAt":"2026-10-27","isFlagshipForJob":false,"differsFromFloorCheapest":false,"representativeQuote":{"skuId":"modal-nvidia-t4-usd-per-gpu-second","item":"Nvidia T4","plan":"Nvidia T4 — Per-second rate shown with the per-second toggle","amountUsd":0.000164,"inputOrUnitUsd":0.000164,"unit":"usd_per_gpu_second","outputUsd":null,"outputUnit":null,"sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27"},"estimatedTaskCost":{"tasks":1000,"retryAndToolOverheadMultiplier":1.15,"retryToolOverheadMultiplier":1.15,"unitsPerTask":1,"baseCostPer1kTasksUsd":0.0002,"totalUsd":0.0002,"estimatedTotalUsd":0.0002,"perTaskUsd":0,"estimatedCostPerTaskUsd":0,"formula":"$0.000164 (usd_per_gpu_second) * 1.15 overhead","assumptions":"1,000 tasks in job native unit with 1.15x retry overhead."}},"representativeQuote":{"skuId":"modal-nvidia-t4-usd-per-gpu-second","item":"Nvidia T4","plan":"Nvidia T4 — Per-second rate shown with the per-second toggle","amountUsd":0.000164,"inputOrUnitUsd":0.000164,"unit":"usd_per_gpu_second","outputUsd":null,"outputUnit":null,"sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27"},"estimatedTaskCost":{"tasks":1000,"retryAndToolOverheadMultiplier":1.15,"retryToolOverheadMultiplier":1.15,"unitsPerTask":1,"baseCostPer1kTasksUsd":0.0002,"totalUsd":0.0002,"estimatedTotalUsd":0.0002,"perTaskUsd":0,"estimatedCostPerTaskUsd":0,"formula":"$0.000164 (usd_per_gpu_second) * 1.15 overhead","assumptions":"1,000 tasks in job native unit with 1.15x retry overhead."},"freeAlternatives":[{"id":"dagger","name":"Dagger","kind":"dev_tool","providerId":null,"jtbdIds":["agent-ephemeral-ci"],"whatYouGet":"Engine that runs a delivery task in containers on a laptop, a CI server, or the cloud. The README says tools run in containers orchestrated by sandboxed functions, and that the same task can run in an AI sandbox. You still supply a container runtime. Not a hosted GPU runner.","cost":"oss","license":"Apache-2.0","limits":null,"sourceUrl":"https://raw.githubusercontent.com/dagger/dagger/main/LICENSE","asOf":"2026-10-25","notes":"LICENSE fetched 2026-10-03 is Apache License 2.0. README fetched the same day. No price is stored. Re-fetched twice 2026-10-25 (~10 s apart, plain curl, no login): HTTP 200, no redirect, byte-identical: 'Apache License Version 2.0, January 2004' / 'Copyright 2022 Dagger, Inc.'. License unchanged.","freeType":"dev_tool","substitutable":true}],"referenceDocs":[],"falsification":{"jtbdId":"agent-ephemeral-ci","jtbdName":"Ephemeral CI runners for agent jobs","currentPickId":"modal","currentPickScore":8.63,"challengerId":"e2b","challengerScore":8.7,"currentScoreGap":0.07,"minVerifiedOutcomes":10,"requiredOutcomeMargin":0.22,"requiredSuccessRateDelta":0.15,"maxPickPriceIncreasePct":25,"whatWouldChangePick":["E2B (e2b) outperforms Modal (modal) by >= 0.22 outcome points (or >= 15% worked-rate delta) across >= 10 Countersign-verified production outcomes.","A verified price increase > 25% on Modal's representative SKU for agent-ephemeral-ci without a corresponding capability gain.","Live caller rail exhaustion (?exhausted=modal) or sustained >= 30% degraded/failed rate in verified production outcomes."],"frozenHoldoutPolicy":{"holdoutSplit":"20% frozen benchmark holdout tasks + 80% live production outcome receipts","requireCountersignReceipt":true,"requiredEvidenceTiers":["outcome_verified","reference_checked"],"minDistinctContributors":2,"antiGamingRule":"Unverified self-reports and seed/editorial rows never mutate picks or scores."},"triggers":[{"kind":"verified_outcomes_outperformance","challengerId":"e2b","minVerifiedOutcomes":10,"requiredOutcomeMargin":0.22,"requiredWorkedRateDelta":0.15},{"kind":"verified_price_increase","providerId":"modal","maxPriceIncreasePct":25},{"kind":"live_rail_exhaustion_or_degradation","providerId":"modal","immediateOverrideUrl":"/api/decide?jtbd=agent-ephemeral-ci&exhausted=modal"}],"submissionSpec":{"falsifyEndpoint":"/api/falsify?jtbd=agent-ephemeral-ci","outcomesEndpoint":"POST /api/feedback","correctionsEndpoint":"POST /api/corrections","payloadTemplate":{"agentIdentity":"agent:<your-agent-id>","jtbdId":"agent-ephemeral-ci","providerId":"e2b","outcome":"worked","detail":"Comparative production evaluation on agent-ephemeral-ci (n>=10 tasks) with Countersign receipt.","confidence":"high","receipt":{"countersign":{"claim_id":"cs-00000000","status":"verified","evidence_tier":"outcome_verified","counts_as_verified":true}}}}},"whatWouldChangePick":["E2B (e2b) outperforms Modal (modal) by >= 0.22 outcome points (or >= 15% worked-rate delta) across >= 10 Countersign-verified production outcomes.","A verified price increase > 25% on Modal's representative SKU for agent-ephemeral-ci without a corresponding capability gain.","Live caller rail exhaustion (?exhausted=modal) or sustained >= 30% degraded/failed rate in verified production outcomes."],"routePlan":{"jtbdId":"agent-ephemeral-ci","primary":{"providerId":"modal","name":"Modal","overall":8.63,"scoreBand":{"low":8,"mid":8.6,"high":9.2,"halfWidth":0.6,"basis":"editorial_prior","display":"8.0–9.2 (editorial prior)"},"scoreLayers":{"editorialPrior":8.63,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-10-19","role":"primary","reason":"Editorial Depot Pick for Ephemeral CI runners for agent jobs; healthy/eligible under caller constraints."},"fallback":[{"providerId":"e2b","name":"E2B","overall":8.7,"scoreBand":{"low":8.1,"mid":8.7,"high":9.3,"halfWidth":0.6,"basis":"editorial_prior","display":"8.1–9.3 (editorial prior)"},"scoreLayers":{"editorialPrior":8.7,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"fallback","reason":"Ranked fallback route for Ephemeral CI runners for agent jobs."},{"providerId":"fly-machines","name":"Fly Machines","overall":8.17,"scoreBand":{"low":7.6,"mid":8.2,"high":8.8,"halfWidth":0.6,"basis":"editorial_prior","display":"7.6–8.8 (editorial prior)"},"scoreLayers":{"editorialPrior":8.17,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"fallback","reason":"Ranked fallback route for Ephemeral CI runners for agent jobs."},{"providerId":"daytona","name":"Daytona","overall":8.33,"scoreBand":{"low":7.7,"mid":8.3,"high":8.9,"halfWidth":0.6,"basis":"editorial_prior","display":"7.7–8.9 (editorial prior)"},"scoreLayers":{"editorialPrior":8.33,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"fallback","reason":"Ranked fallback route for Ephemeral CI runners for agent jobs."},{"providerId":"upstash-box","name":"Upstash Box","overall":7.84,"scoreBand":{"low":7.2,"mid":7.8,"high":8.4,"halfWidth":0.6,"basis":"editorial_prior","display":"7.2–8.4 (editorial prior)"},"scoreLayers":{"editorialPrior":7.84,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-03","editorialPriorAsOf":"2026-09-14","role":"fallback","reason":"Ranked fallback route for Ephemeral CI runners for agent jobs."}],"disqualified":[],"expectedRegret":{"scoreDeltaVsUnconstrainedPick":0,"unconstrainedPickId":"modal","activePrimaryId":"modal","summary":"0.00 score regret: unconstrained editorial pick satisfies all caller constraints."},"evidenceAgeDays":{"editorialScoreAgeDays":9,"pricingVerifiedAgeDays":1,"editorialPriorAsOf":"2026-10-19","pricingLastVerifiedAt":"2026-10-27"},"confidenceBand":{"low":8,"mid":8.6,"high":9.2,"halfWidth":0.6,"basis":"editorial_prior","display":"8.0–9.2 (editorial prior)"},"constraintsApplied":false,"constraintBundle":{"task":null,"jtbd":"agent-ephemeral-ci","quotaExhausted":[],"degraded":[],"healthy":[],"budgetUsd":null,"maxLatencyMs":null,"region":null,"privacy":null,"exit":[],"existing":[]}},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-10-19","tie":true,"scoreGap":-0.07,"decidingFactor":"developerDx (9.6 vs 9.4)","tieNote":"Scores are within 0.10 on a curated_estimate 0-10 scale (8.63 vs 8.7); treat as a statistical tie and decide on decidingFactor or whenNotTopPick.","rationale":"Serverless GPU/CPU job DX for CI. Confidence: high for Modal; Box still preview.","whenNotTopPick":"Need browser-native sandboxes (E2B), Fly Machines already in mesh, or Upstash Box when GA fits.","skipTopPick":false,"skipReason":null,"matchedConstraints":[],"pricingSummary":"As of 2026-10-24 (modal.com/pricing, fetched 2026-10-24): Python-native serverless GPU/CPU billed per second of compute ('You never pay for idle resources'). GPU list rates per second: H100 SXM5 '$0.001097', H200 SXM '$0.001261', B200 '$0.001736', A100 80 GB '$0.000694', L40S '$0…","cite":"Depot Pick for agent-ephemeral-ci: modal (asOf 2026-10-19). See GET /api/jtbds/agent-ephemeral-ci + GET /api/methodology.","nextActions":[{"step":1,"title":"Inspect full JTBD + embeds","href":"/api/jtbds/agent-ephemeral-ci?embed=providers","why":"Confirm pick, runners-up, and methodology notes."},{"step":2,"title":"Quote sourced SKUs","href":"/api/quote?jtbd=agent-ephemeral-ci","why":"Depot Pick SKUs plus the cheapest sourced SKU whose unit matches this job. Does not change the pick. Does not blend input and output or borrow a chat rate for a non-chat job."},{"step":3,"title":"Open provider detail","href":"/api/providers/modal","why":"Scores, pricingNotes, strengths/weaknesses, communitySignals (claims only)."},{"step":4,"title":"Cite methodology","href":"/api/methodology","why":"Required when publishing a Depot Pick citation."},{"step":5,"title":"Grab badge SVG","href":"/api/badge?type=depot-pick&jtbd=agent-ephemeral-ci","why":"Embed in README / agent passport."},{"step":6,"title":"Post production insight","method":"POST","href":"/api/insights","why":"Unverified until curated; never auto-mutates official scores."}],"honesty":["Do not invent scores or benches.","Insights are claims until curated/reviewed; they never silently mutate official scores.","lockInRisk higher = more lock-in (worse).","normalizedUsdPerMillionTokens is set only for a single sourced token row. Otherwise null, with a machine-readable reason. Do not coerce GPU, minute, or per-1k search units.","Runners-up are not Depot Picks.","Depot overall is editorial_weighted, not Arena Elo and not an Artificial Analysis index."],"asOf":"2026-10-19","depth":{"whenNotToUse":{"text":"Need browser-native sandboxes (E2B), Fly Machines already in mesh, or Upstash Box when GA fits.","source":"editorial `whenNotTopPick` (data/jtbds.json)"},"whenNotToUseReason":null,"runnerUp":{"providerId":"e2b","name":"E2B","overallForJob":8.7,"pickOverallForJob":8.63,"beatsPickOn":["capabilityFit","privacyPosture","lockInRisk"],"source":"first resolvable entry of the job's editorially ranked `runnersUpIds`; scores are stored job-weighted scores"},"runnerUpReason":null,"lockIn":{"pickLockInRisk":4.5,"runnerUpLockInRisk":4,"scale":"0–10 stored curated estimate; higher = more lock-in (worse)","pickExitSignals":[],"runnerUpExitSignals":[],"pickNotes":[],"selfHostFallback":[{"id":"dagger","name":"Dagger","license":"Apache-2.0","sourceUrl":"https://raw.githubusercontent.com/dagger/dagger/main/LICENSE"}],"migration":"Runner-up E2B has lower stored lock-in risk (4 vs 4.5, 0–10, higher = more lock-in). Self-host fallback listed for this job: Dagger.","migrationReason":null,"derivedFrom":"stored lockInRisk scores, provider tags (oss, self-host, openai-compat, open-models), free rows that list this job, and verbatim provider notes. No migration guide was invented."}},"citation":{"text":"Agent Provider Depot (v0.12.158), Depot Pick for agent-ephemeral-ci: modal, scores as of 2026-10-19, retrieved 2026-10-28. https://getagentdepot.com/jtbds/agent-ephemeral-ci","markdown":"[Agent Provider Depot](https://getagentdepot.com/jtbds/agent-ephemeral-ci) (v0.12.158) — Depot Pick for `agent-ephemeral-ci`: **modal** (scores as of 2026-10-19, retrieved 2026-10-28)","fields":{"publisher":"Agent Provider Depot","version":"0.12.158","role":"depot_pick","jtbdId":"agent-ephemeral-ci","providerId":"modal","scoreAsOf":"2026-10-19","retrievedOn":"2026-10-28","page":"https://getagentdepot.com/jtbds/agent-ephemeral-ci","api":"https://getagentdepot.com/api/decide?jtbd=agent-ephemeral-ci"},"howToCite":"Cite Depot as an editorial, dated recommendation, not a benchmark: name the job, the Depot Pick (or runner-up), the score asOf date and the day you retrieved it, and link the job page. Format: “Agent Provider Depot (v{version}), Depot Pick for {jobId}: {providerId}, scores as of {scoreAsOf}, retrieved {retrievedOn}. {baseUrl}/jtbds/{jobId}”. Quote prices only with their own sourceUrl and asOf. If the pick's score is stale (freshness.pick.score.stale), say so."},"freshness":{"pick":{"score":{"asOf":"2026-10-19","ageDays":9,"stale":false,"staleAfterDays":30,"reason":null},"lastReviewed":{"asOf":"2026-10-19","ageDays":9,"stale":false,"staleAfterDays":30,"reason":null},"sourceCheck":{"checkedAt":"2026-10-27","sourceUrls":2,"sourcesReachable":2,"pricingRows":18,"pricingRowsReconfirmed":18,"note":"A source re-check confirms the page is reachable and, for pricing rows, that the stored amount and SKU name appear on it. It does not re-derive or change the score.","reason":null}},"scoreAsOf":"2026-10-19","editorialPriorAsOf":"2026-10-19","pricingLastVerifiedAt":"2026-10-27","pickLastReviewed":"2026-10-19","runnersUpScoreAsOf":["2026-09-14","2026-09-14","2026-09-14","2026-09-14"],"contractAsOf":"2026-10-03","pricingShape":"sourced_rows","normalizedUsdPerMillionTokens":null,"normalizationStatus":"unit_mismatch","normalizationReason":"unit_mismatch"},"pricingContract":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"unit_mismatch","normalizationReason":"unit_mismatch","shape":"sourced_rows","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[{"id":"modal-nvidia-b300-usd-per-gpu-second","providerId":"modal","sku":"Nvidia B300","unit":"usd_per_gpu_second","amountUsd":0.001972,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-b200-usd-per-gpu-second","providerId":"modal","sku":"Nvidia B200","unit":"usd_per_gpu_second","amountUsd":0.001736,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-h200-sxm-usd-per-gpu-second","providerId":"modal","sku":"Nvidia H200 SXM","unit":"usd_per_gpu_second","amountUsd":0.001261,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-h100-sxm5-usd-per-gpu-second","providerId":"modal","sku":"Nvidia H100 SXM5","unit":"usd_per_gpu_second","amountUsd":0.001097,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-rtx-pro-6000-usd-per-gpu-second","providerId":"modal","sku":"Nvidia RTX PRO 6000","unit":"usd_per_gpu_second","amountUsd":0.000842,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-a100-80gb-usd-per-gpu-second","providerId":"modal","sku":"Nvidia A100 80GB","unit":"usd_per_gpu_second","amountUsd":0.000694,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-a100-40gb-usd-per-gpu-second","providerId":"modal","sku":"Nvidia A100 40GB","unit":"usd_per_gpu_second","amountUsd":0.000583,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-l40s-usd-per-gpu-second","providerId":"modal","sku":"Nvidia L40S","unit":"usd_per_gpu_second","amountUsd":0.000542,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-a10-usd-per-gpu-second","providerId":"modal","sku":"Nvidia A10","unit":"usd_per_gpu_second","amountUsd":0.000306,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-l4-usd-per-gpu-second","providerId":"modal","sku":"Nvidia L4","unit":"usd_per_gpu_second","amountUsd":0.000222,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-t4-usd-per-gpu-second","providerId":"modal","sku":"Nvidia T4","unit":"usd_per_gpu_second","amountUsd":0.000164,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-cpu-physical-core-usd-per-core-second","providerId":"modal","sku":"CPU physical core","unit":"usd_per_core_second","amountUsd":0.0000131,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_core_second","priceSortEligible":false,"qualifier":"Physical core (2 vCPU). Minimum 0.125 cores."},{"id":"modal-memory-usd-per-gib-second","providerId":"modal","sku":"Memory","unit":"usd_per_gib_second","amountUsd":0.00000222,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gib_second","priceSortEligible":false,"qualifier":"Container memory."},{"id":"modal-sandbox-cpu-usd-per-core-second","providerId":"modal","sku":"Sandbox CPU","unit":"usd_per_core_second","amountUsd":0.00003942,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_core_second","priceSortEligible":false,"qualifier":"Modal Sandbox rate (page: 'Modal Sandbox pricing', 'CPU (non-preemptible)'; 'Sandboxes are billed at non-preemptible rates of 3x list price'), separate from the default CPU rate."},{"id":"modal-sandbox-memory-usd-per-gib-second","providerId":"modal","sku":"Sandbox memory","unit":"usd_per_gib_second","amountUsd":0.00000667,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gib_second","priceSortEligible":false,"qualifier":"Sandbox memory (page: 'Memory (non-preemptible)' under 'Modal Sandbox pricing')."},{"id":"modal-volumes-usd-per-gib-month","providerId":"modal","sku":"Volumes","unit":"usd_per_gib_month","amountUsd":0.09,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gib_month","priceSortEligible":false,"qualifier":"Includes 1 TiB/mo free, not folded into this rate."},{"id":"modal-network-egress-usd-per-gib","providerId":"modal","sku":"Network egress","unit":"usd_per_gib","amountUsd":0.04,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gib","priceSortEligible":false,"qualifier":"See plan for included usage."},{"id":"modal-team-plan-usd-per-month","providerId":"modal","sku":"Team plan","unit":"usd_per_month","amountUsd":250,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_month","priceSortEligible":false,"qualifier":"Plus compute. $100/mo credits not subtracted."}],"notesExcerpt":"As of 2026-10-24 (modal.com/pricing, fetched 2026-10-24): Python-native serverless GPU/CPU billed per second of compute ('You never pay for idle resources'). GPU list rates per second: H100 SXM5 '$0.001097', H200 SXM '$0.001261', B200 '$0.001736', A100 80 GB '$0.000694', L40S '$0…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-10-19","scoreAsOf":"2026-10-19","website":"https://modal.com","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"links":{"jtbd":"/jtbds/agent-ephemeral-ci","jtbdApi":"/api/jtbds/agent-ephemeral-ci","leaderboard":"/api/leaderboards?jtbd=agent-ephemeral-ci","methodology":"/api/methodology","badge":"/api/badge?type=depot-pick&jtbd=agent-ephemeral-ci","decide":"/api/decide?jtbd=agent-ephemeral-ci","humanPage":"/jtbds/agent-ephemeral-ci","alternatives":"/api/alternatives?provider=modal","canonical":"/api/canonical","quote":"/api/quote?jtbd=agent-ephemeral-ci","falsify":"/api/falsify?jtbd=agent-ephemeral-ci"},"constraintBundle":{"task":null,"jtbd":"agent-ephemeral-ci","quotaExhausted":[],"degraded":[],"healthy":[],"budgetUsd":null,"maxLatencyMs":null,"region":null,"privacy":null,"exit":[],"existing":[]},"stackContext":{"host":null,"framework":null,"repo":null,"lang":null,"existing":[],"volume":null,"sender":null,"detectedFromTask":[]},"keep":null,"contextAdvice":null,"communityFeedback":{"pickOnThisJob":{"failed":0,"degraded":0,"worked":0,"insights":0,"withVerifiedReceipt":0,"failureModes":{},"latestAt":null,"note":"Agent-reported claims (unverified unless a receipt is verified by Depot's re-check). They never change scores or picks."},"outcomes":{"job":{"n":0,"worked":0,"degraded":0,"failed":0,"failureModes":{},"verifiedReports":0,"contributors":0,"excluded":{"seed_editorial":0,"test":0,"notFeedback":0},"reason":"no_submitted_outcome_reports_yet"},"pick":{"providerId":"modal","n":0,"worked":0,"degraded":0,"failed":0,"failureModes":{},"evidenceTiers":{"agent_claim":0,"self_declared":0,"reference_checked":0,"outcome_verified":0},"reason":"no_submitted_outcome_reports_yet"},"scoresMutated":false,"more":"/api/outcomes?jtbd=agent-ephemeral-ci"},"report":"POST /api/feedback {agentIdentity, outcome: failed|degraded|worked, detail, providerId, jtbdId, failureModeId?, receipt?}"}}