{"jtbd":{"id":"stateful-agent-runtime","slug":"stateful-agent-runtime","name":"Stateful long-lived agent runtime","shortName":"Stateful long-lived agent runtime","problemStatement":"Need agents with editable memory blocks and long-lived identity, not just a chat API + DB."},"pick":{"id":"letta","slug":"letta","name":"Letta Cloud","tagline":"Choose when the agent IS a long-lived stateful runtime. For bolt-on memory use Mem0/Zep.","website":"https://www.letta.com","overall":7.41,"scoreBand":{"low":6.8,"mid":7.4,"high":8,"halfWidth":0.6,"basis":"editorial_prior","display":"6.8–8.0 (editorial prior)"},"scoreLayers":{"editorialPrior":7.41,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"As of 2026-09-14: Stateful agent runtime (ex-MemGPT). Free tier BYOK + limited agents; Pro ~$20/mo; API plan ~$20/mo + ~$0.10/active agent/mo + tool-exec ~$0.00015/s (secondary/roundup figures as stored then). As of 2026-10-25 https://www.letta.com/pricing answers HTTP 200 to plain curl via redirects (301 to https://docs.letta.com/letta-code/pricing, then 308 to https://docs.letta.com/pricing), not bot-blocked; the docs page quotes 'Pro For personal use. $20 /month', 'API Plan For teams building on the Letta API. $20 /month Unlimited agents $0.10 / active agent / mo $0.00015 / sec tool execution' and 'Free plans are limited to 3 stateful agents.' Stored figures are not re-priced here; any price change goes through the reviewed --catalog step. OSS self-host Apache-2.0. Re-verify console before commits.","scores":{"capabilityFit":8,"pricePerformance":7.8,"latencyReliability":7.2,"developerDx":8,"privacyPosture":7.2,"lockInRisk":5.5,"maturity":6.8,"overall":7.41,"kind":"curated_estimate","confidence":"medium","asOf":"2026-09-14"}},"runnersUp":[{"id":"langgraph-cloud","slug":"langgraph-cloud","name":"LangGraph Platform / LangSmith Deploy","tagline":"Deploy here if your graphs already are LangGraph. Otherwise Inngest/Temporal + Langfuse to avoid stack…","website":"https://www.langchain.com/langgraph","overall":7.46,"scoreBand":{"low":6.9,"mid":7.5,"high":8.1,"halfWidth":0.6,"basis":"editorial_prior","display":"6.9–8.1 (editorial prior)"},"scoreLayers":{"editorialPrior":7.46,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"As of 2026-09-14: LangGraph OSS free; hosted deployment is LangSmith Deployment. LangSmith Developer free; Plus ~$39/seat/mo with included traces + small serverless deployment, then LCU/LSU usage. Natural if already on LangChain/LangGraph.","scores":{"capabilityFit":8.4,"pricePerformance":6.8,"latencyReliability":8,"developerDx":8.2,"privacyPosture":7.2,"lockInRisk":7.2,"maturity":8.2,"overall":7.46,"kind":"curated_estimate","confidence":"high","asOf":"2026-09-14"}},{"id":"temporal-cloud","slug":"temporal-cloud","name":"Temporal Cloud","tagline":"Default durable orchestration for serious long-running agents. Inngest/Trigger.dev for lighter DX.","website":"https://temporal.io","overall":7.97,"scoreBand":{"low":7.4,"mid":8,"high":8.6,"halfWidth":0.6,"basis":"editorial_prior","display":"7.4–8.6 (editorial prior)"},"scoreLayers":{"editorialPrior":7.97,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"As of 2026-10-21 (temporal.io/pricing and docs.temporal.io/cloud/pricing, fetched 2026-10-21): Durable execution for long-running agent workflows. Developer plan is Pay-As-You-Go with no base monthly fee ('No base fee - 10% of Usage Spend') and Actions at $50 per million at every volume. Business is 'Greater of $500/mo or 10% of usage', includes 2.5M Actions, 2.5 GB Active Storage and 100 GB Retained Storage, with progressive Action discounts ('Self service down to $25 per million actions'). Storage is metered separately: $0.042 per GBh active, $0.00105 per GBh retained. Enterprise and Mission Critical are priced annually via Sales. temporal.io/pricing also lists 'Free $150 credits for 90 days'. The earlier 'Cloud Essentials' plan no longer appears on either page. See plan limits (/api/estimate) for the encoded plans. OSS Temporal free to self-host. Best for reliable multi-step agent orchestration with retries/state.","scores":{"capabilityFit":9,"pricePerformance":6.8,"latencyReliability":9.2,"developerDx":7.2,"privacyPosture":8.2,"lockInRisk":5,"maturity":9.2,"overall":7.97,"kind":"curated_estimate","confidence":"high","asOf":"2026-09-14"}},{"id":"mem0","slug":"mem0","name":"Mem0","tagline":"Default hosted agent memory bolt-on. Model retrieval volume carefully; self-host OSS if caps hurt.","website":"https://mem0.ai","overall":7.61,"scoreBand":{"low":7,"mid":7.6,"high":8.2,"halfWidth":0.6,"basis":"editorial_prior","display":"7.0–8.2 (editorial prior)"},"scoreLayers":{"editorialPrior":7.61,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","pricingNotes":"As of 2026-10-24 (mem0.ai/pricing, fetched 2026-10-24): Hosted memory layer. Hobby 'Free' ('10,000 add requests/ month', '1,000 retrieval requests/ month', '1 project'); Starter '$19 / month' ('50,000 add requests /month', '5,000 retrieval requests / month'); Pro '$249 / month' ('500,000 add requests /month', '50,000 retrieval requests /month', 'Graph memory (entity linking)'); Enterprise 'Custom' ('Unlimited add requests', 'Unlimited retrieval requests'). No per-request overage rate is published. The earlier Growth plan no longer appears on the page. Meters adds AND retrievals — read-heavy agents hit retrieval caps first. See plan limits (/api/estimate) for the encoded plans. OSS Apache-2.0 core self-hostable.","scores":{"capabilityFit":7.8,"pricePerformance":8,"latencyReliability":7.4,"developerDx":8.8,"privacyPosture":7,"lockInRisk":5,"maturity":7.2,"overall":7.61,"kind":"curated_estimate","confidence":"high","asOf":"2026-09-14"}}],"scoreBand":{"low":6.8,"mid":7.4,"high":8,"halfWidth":0.6,"basis":"editorial_prior","display":"6.8–8.0 (editorial prior)"},"scoreLayers":{"editorialPrior":7.41,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"whyPickOverHigherScore":{"pickId":"letta","pickName":"Letta Cloud","pickScore":7.41,"highestScoredCandidateId":"temporal-cloud","highestScoredCandidateName":"Temporal Cloud","highestScore":7.97,"pickHasLowerCompositeScore":true,"delta":-0.56,"pickLeadsOnDimensions":["pricePerformance (7.8 vs 6.8)","developerDx (8 vs 7.2)"],"explanation":"Letta Cloud (7.41) is the editorial pick for Stateful long-lived agent runtime over higher-composite Temporal Cloud (7.97) because composite scores are provider-wide priors while Letta Cloud wins on pricePerformance (7.8 vs 6.8), developerDx (8 vs 7.2): Runtime capability; Letta for memory-native agents, LangGraph/Temporal for orchestration."},"cheapest":null,"recommendedWorkloadQuote":null,"representativeQuote":null,"estimatedTaskCost":null,"freeAlternatives":[],"referenceDocs":[],"falsification":{"jtbdId":"stateful-agent-runtime","jtbdName":"Stateful long-lived agent runtime","currentPickId":"letta","currentPickScore":7.41,"challengerId":"langgraph-cloud","challengerScore":7.46,"currentScoreGap":0.05,"minVerifiedOutcomes":10,"requiredOutcomeMargin":0.2,"requiredSuccessRateDelta":0.15,"maxPickPriceIncreasePct":25,"whatWouldChangePick":["LangGraph Platform / LangSmith Deploy (langgraph-cloud) outperforms Letta Cloud (letta) by >= 0.2 outcome points (or >= 15% worked-rate delta) across >= 10 Countersign-verified production outcomes.","A verified price increase > 25% on Letta Cloud's representative SKU for stateful-agent-runtime without a corresponding capability gain.","Live caller rail exhaustion (?exhausted=letta) or sustained >= 30% degraded/failed rate in verified production outcomes."],"frozenHoldoutPolicy":{"holdoutSplit":"20% frozen benchmark holdout tasks + 80% live production outcome receipts","requireCountersignReceipt":true,"requiredEvidenceTiers":["outcome_verified","reference_checked"],"minDistinctContributors":2,"antiGamingRule":"Unverified self-reports and seed/editorial rows never mutate picks or scores."},"triggers":[{"kind":"verified_outcomes_outperformance","challengerId":"langgraph-cloud","minVerifiedOutcomes":10,"requiredOutcomeMargin":0.2,"requiredWorkedRateDelta":0.15},{"kind":"verified_price_increase","providerId":"letta","maxPriceIncreasePct":25},{"kind":"live_rail_exhaustion_or_degradation","providerId":"letta","immediateOverrideUrl":"/api/decide?jtbd=stateful-agent-runtime&exhausted=letta"}],"submissionSpec":{"falsifyEndpoint":"/api/falsify?jtbd=stateful-agent-runtime","outcomesEndpoint":"POST /api/feedback","correctionsEndpoint":"POST /api/corrections","payloadTemplate":{"agentIdentity":"agent:<your-agent-id>","jtbdId":"stateful-agent-runtime","providerId":"langgraph-cloud","outcome":"worked","detail":"Comparative production evaluation on stateful-agent-runtime (n>=10 tasks) with Countersign receipt.","confidence":"high","receipt":{"countersign":{"claim_id":"cs-00000000","status":"verified","evidence_tier":"outcome_verified","counts_as_verified":true}}}}},"whatWouldChangePick":["LangGraph Platform / LangSmith Deploy (langgraph-cloud) outperforms Letta Cloud (letta) by >= 0.2 outcome points (or >= 15% worked-rate delta) across >= 10 Countersign-verified production outcomes.","A verified price increase > 25% on Letta Cloud's representative SKU for stateful-agent-runtime without a corresponding capability gain.","Live caller rail exhaustion (?exhausted=letta) or sustained >= 30% degraded/failed rate in verified production outcomes."],"routePlan":{"jtbdId":"stateful-agent-runtime","primary":{"providerId":"letta","name":"Letta Cloud","overall":7.41,"scoreBand":{"low":6.8,"mid":7.4,"high":8,"halfWidth":0.6,"basis":"editorial_prior","display":"6.8–8.0 (editorial prior)"},"scoreLayers":{"editorialPrior":7.41,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"primary","reason":"Editorial Depot Pick for Stateful long-lived agent runtime; healthy/eligible under caller constraints."},"fallback":[{"providerId":"langgraph-cloud","name":"LangGraph Platform / LangSmith Deploy","overall":7.46,"scoreBand":{"low":6.9,"mid":7.5,"high":8.1,"halfWidth":0.6,"basis":"editorial_prior","display":"6.9–8.1 (editorial prior)"},"scoreLayers":{"editorialPrior":7.46,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"fallback","reason":"Ranked fallback route for Stateful long-lived agent runtime."},{"providerId":"temporal-cloud","name":"Temporal Cloud","overall":7.97,"scoreBand":{"low":7.4,"mid":8,"high":8.6,"halfWidth":0.6,"basis":"editorial_prior","display":"7.4–8.6 (editorial prior)"},"scoreLayers":{"editorialPrior":7.97,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"fallback","reason":"Ranked fallback route for Stateful long-lived agent runtime."},{"providerId":"mem0","name":"Mem0","overall":7.61,"scoreBand":{"low":7,"mid":7.6,"high":8.2,"halfWidth":0.6,"basis":"editorial_prior","display":"7.0–8.2 (editorial prior)"},"scoreLayers":{"editorialPrior":7.61,"measuredBenchmark":null,"verifiedOutcomeScore":null,"verifiedOutcomeCount":0,"accountRuntimeState":"unprobed"},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","role":"fallback","reason":"Ranked fallback route for Stateful long-lived agent runtime."}],"disqualified":[],"expectedRegret":{"scoreDeltaVsUnconstrainedPick":0,"unconstrainedPickId":"letta","activePrimaryId":"letta","summary":"0.00 score regret: unconstrained editorial pick satisfies all caller constraints."},"evidenceAgeDays":{"editorialScoreAgeDays":43,"pricingVerifiedAgeDays":0,"editorialPriorAsOf":"2026-09-14","pricingLastVerifiedAt":"2026-10-27"},"confidenceBand":{"low":6.8,"mid":7.4,"high":8,"halfWidth":0.6,"basis":"editorial_prior","display":"6.8–8.0 (editorial prior)"},"constraintsApplied":false,"constraintBundle":{"task":null,"jtbd":"stateful-agent-runtime","quotaExhausted":[],"degraded":[],"healthy":[],"budgetUsd":null,"maxLatencyMs":null,"region":null,"privacy":null,"exit":[],"existing":[]}},"pricingLastVerifiedAt":"2026-10-27","editorialPriorAsOf":"2026-09-14","tie":true,"scoreGap":-0.05,"decidingFactor":"pricePerformance (7.8 vs 6.8)","tieNote":"Scores are within 0.10 on a curated_estimate 0-10 scale (7.41 vs 7.46); treat as a statistical tie and decide on decidingFactor or whenNotTopPick.","rationale":"Runtime capability; Letta for memory-native agents, LangGraph/Temporal for orchestration.","whenNotTopPick":"Stateless request/response agents — plain LLM API + Mem0.","skipTopPick":false,"skipReason":null,"matchedConstraints":[],"pricingSummary":"As of 2026-09-14: Stateful agent runtime (ex-MemGPT). Free tier BYOK + limited agents; Pro ~$20/mo; API plan ~$20/mo + ~$0.10/active agent/mo + tool-exec ~$0.00015/s (secondary/roundup figures as stored then). As of 2026-10-25 https://www.letta.com/pricing answers HTTP 200 to pla…","cite":"Depot Pick for stateful-agent-runtime: letta (asOf 2026-09-14). See GET /api/jtbds/stateful-agent-runtime + GET /api/methodology.","nextActions":[{"step":1,"title":"Inspect full JTBD + embeds","href":"/api/jtbds/stateful-agent-runtime?embed=providers","why":"Confirm pick, runners-up, and methodology notes."},{"step":2,"title":"Quote sourced SKUs","href":"/api/quote?jtbd=stateful-agent-runtime","why":"Depot Pick SKUs plus the cheapest sourced SKU whose unit matches this job. Does not change the pick. Does not blend input and output or borrow a chat rate for a non-chat job."},{"step":3,"title":"Open provider detail","href":"/api/providers/letta","why":"Scores, pricingNotes, strengths/weaknesses, communitySignals (claims only)."},{"step":4,"title":"Cite methodology","href":"/api/methodology","why":"Required when publishing a Depot Pick citation."},{"step":5,"title":"Grab badge SVG","href":"/api/badge?type=depot-pick&jtbd=stateful-agent-runtime","why":"Embed in README / agent passport."},{"step":6,"title":"Post production insight","method":"POST","href":"/api/insights","why":"Unverified until curated; never auto-mutates official scores."}],"honesty":["Do not invent scores or benches.","Insights are claims until curated/reviewed; they never silently mutate official scores.","lockInRisk higher = more lock-in (worse).","normalizedUsdPerMillionTokens is set only for a single sourced token row. Otherwise null, with a machine-readable reason. Do not coerce GPU, minute, or per-1k search units.","Runners-up are not Depot Picks.","Depot overall is editorial_weighted, not Arena Elo and not an Artificial Analysis index."],"asOf":"2026-09-14","depth":{"whenNotToUse":{"text":"Stateless request/response agents — plain LLM API + Mem0.","source":"editorial `whenNotTopPick` (data/jtbds.json)"},"whenNotToUseReason":null,"runnerUp":{"providerId":"langgraph-cloud","name":"LangGraph Platform / LangSmith Deploy","overallForJob":7.46,"pickOverallForJob":7.41,"beatsPickOn":["capabilityFit","latencyReliability","developerDx","maturity"],"source":"first resolvable entry of the job's editorially ranked `runnersUpIds`; scores are stored job-weighted scores"},"runnerUpReason":null,"lockIn":{"pickLockInRisk":5.5,"runnerUpLockInRisk":7.2,"scale":"0–10 stored curated estimate; higher = more lock-in (worse)","pickExitSignals":["open source (provider tag `oss`)"],"runnerUpExitSignals":[],"pickNotes":[],"selfHostFallback":[],"migration":"The pick has lower stored lock-in risk than runner-up LangGraph Platform / LangSmith Deploy (5.5 vs 7.2). Pick exit signals: open source (provider tag `oss`).","migrationReason":null,"derivedFrom":"stored lockInRisk scores, provider tags (oss, self-host, openai-compat, open-models), free rows that list this job, and verbatim provider notes. No migration guide was invented."}},"citation":{"text":"Agent Provider Depot (v0.12.149), Depot Pick for stateful-agent-runtime: letta, scores as of 2026-09-14, retrieved 2026-10-27. https://getagentdepot.com/jtbds/stateful-agent-runtime","markdown":"[Agent Provider Depot](https://getagentdepot.com/jtbds/stateful-agent-runtime) (v0.12.149) — Depot Pick for `stateful-agent-runtime`: **letta** (scores as of 2026-09-14, retrieved 2026-10-27)","fields":{"publisher":"Agent Provider Depot","version":"0.12.149","role":"depot_pick","jtbdId":"stateful-agent-runtime","providerId":"letta","scoreAsOf":"2026-09-14","retrievedOn":"2026-10-27","page":"https://getagentdepot.com/jtbds/stateful-agent-runtime","api":"https://getagentdepot.com/api/decide?jtbd=stateful-agent-runtime"},"howToCite":"Cite Depot as an editorial, dated recommendation, not a benchmark: name the job, the Depot Pick (or runner-up), the score asOf date and the day you retrieved it, and link the job page. Format: “Agent Provider Depot (v{version}), Depot Pick for {jobId}: {providerId}, scores as of {scoreAsOf}, retrieved {retrievedOn}. {baseUrl}/jtbds/{jobId}”. Quote prices only with their own sourceUrl and asOf. If the pick's score is stale (freshness.pick.score.stale), say so."},"freshness":{"pick":{"score":{"asOf":"2026-09-14","ageDays":43,"stale":true,"staleAfterDays":30,"reason":null},"lastReviewed":{"asOf":"2026-09-14","ageDays":43,"stale":true,"staleAfterDays":30,"reason":null},"sourceCheck":{"checkedAt":"2026-10-27","sourceUrls":3,"sourcesReachable":3,"pricingRows":0,"pricingRowsReconfirmed":0,"note":"A source re-check confirms the page is reachable and, for pricing rows, that the stored amount and SKU name appear on it. It does not re-derive or change the score.","reason":null}},"scoreAsOf":"2026-09-14","editorialPriorAsOf":"2026-09-14","pricingLastVerifiedAt":"2026-10-27","pickLastReviewed":"2026-09-14","runnersUpScoreAsOf":["2026-09-14","2026-09-14","2026-09-14"],"contractAsOf":"2026-10-03","pricingShape":"prose_notes_only","normalizedUsdPerMillionTokens":null,"normalizationStatus":"unavailable","normalizationReason":"no_sourced_price"},"pricingContract":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"unavailable","normalizationReason":"no_sourced_price","shape":"prose_notes_only","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[],"notesExcerpt":"As of 2026-09-14: Stateful agent runtime (ex-MemGPT). Free tier BYOK + limited agents; Pro ~$20/mo; API plan ~$20/mo + ~$0.10/active agent/mo + tool-exec ~$0.00015/s (secondary/roundup figures as stored then). As of 2026-10-25 https://www.letta.com/pricing answers HTTP 200 to pla…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://www.letta.com","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"No sourced price row for this provider. pricingNotes stay prose. See research/gaps.md."},"links":{"jtbd":"/jtbds/stateful-agent-runtime","jtbdApi":"/api/jtbds/stateful-agent-runtime","leaderboard":"/api/leaderboards?jtbd=stateful-agent-runtime","methodology":"/api/methodology","badge":"/api/badge?type=depot-pick&jtbd=stateful-agent-runtime","decide":"/api/decide?jtbd=stateful-agent-runtime","humanPage":"/jtbds/stateful-agent-runtime","alternatives":"/api/alternatives?provider=letta","canonical":"/api/canonical","quote":"/api/quote?jtbd=stateful-agent-runtime","falsify":"/api/falsify?jtbd=stateful-agent-runtime"},"constraintBundle":{"task":null,"jtbd":"stateful-agent-runtime","quotaExhausted":[],"degraded":[],"healthy":[],"budgetUsd":null,"maxLatencyMs":null,"region":null,"privacy":null,"exit":[],"existing":[]},"stackContext":{"host":null,"framework":null,"repo":null,"lang":null,"existing":[],"volume":null,"sender":null,"detectedFromTask":[]},"keep":null,"contextAdvice":null,"communityFeedback":{"pickOnThisJob":{"failed":0,"degraded":0,"worked":0,"insights":0,"withVerifiedReceipt":0,"failureModes":{},"latestAt":null,"note":"Agent-reported claims (unverified unless a receipt is verified by Depot's re-check). They never change scores or picks."},"outcomes":{"job":{"n":0,"worked":0,"degraded":0,"failed":0,"failureModes":{},"verifiedReports":0,"contributors":0,"excluded":{"seed_editorial":0,"test":0,"notFeedback":0},"reason":"no_submitted_outcome_reports_yet"},"pick":{"providerId":"letta","n":0,"worked":0,"degraded":0,"failed":0,"failureModes":{},"evidenceTiers":{"agent_claim":0,"self_declared":0,"reference_checked":0,"outcome_verified":0},"reason":"no_submitted_outcome_reports_yet"},"scoresMutated":false,"more":"/api/outcomes?jtbd=stateful-agent-runtime"},"report":"POST /api/feedback {agentIdentity, outcome: failed|degraded|worked, detail, providerId, jtbdId, failureModeId?, receipt?}"}}