{"id":"confidential-tee-inference","slug":"confidential-tee-inference","name":"Confidential / TEE-backed LLM inference","shortName":"TEE inference","problemStatement":"Run inference where the host cannot read prompts/weights in cleartext — confidential VMs or TEE-backed serverless for regulated or high-trust agents.","whenNotTopPick":"Need hyperscaler confidential-compute contracts with BAA/DPA already negotiated (Bedrock/Azure), or a dedicated Friendli/GPU TEE SKU your security team already approved.","categoryIds":["cat-inference-apis"],"depotPickProviderId":"chutes","depotPickRationale":"Capability = real TEE/confidential posture + model coverage. Privacy weighted high. Chutes publishes a TEE matrix agents can pin; hyperscalers win when enterprise paperwork dominates. Confidence: medium — re-curl chutes.ai/pricing TEE rows before production.","runnersUpIds":["friendli","amazon-bedrock","azure-openai","fireworks"],"weights":{"capabilityFit":0.2,"pricePerformance":0.1,"latencyReliability":0.12,"developerDx":0.1,"privacyPosture":0.3,"lockInRisk":0.08,"maturity":0.1},"methodologyNotes":"Capability = real TEE/confidential posture + model coverage. Privacy weighted high. Chutes publishes a TEE matrix agents can pin; hyperscalers win when enterprise paperwork dominates. Confidence: medium — re-curl chutes.ai/pricing TEE rows before production.","tags":["tee","confidential","privacy","inference"],"depth":{"whenNotToUse":{"text":"Need hyperscaler confidential-compute contracts with BAA/DPA already negotiated (Bedrock/Azure), or a dedicated Friendli/GPU TEE SKU your security team already approved.","source":"editorial `whenNotTopPick` (data/jtbds.json)"},"whenNotToUseReason":null,"runnerUp":{"providerId":"friendli","name":"FriendliAI","overallForJob":8.01,"pickOverallForJob":6.82,"beatsPickOn":["capabilityFit","latencyReliability","developerDx","privacyPosture","maturity"],"source":"first resolvable entry of the job's editorially ranked `runnersUpIds`; scores are stored job-weighted scores"},"runnerUpReason":null,"lockIn":{"pickLockInRisk":4,"runnerUpLockInRisk":4,"scale":"0–10 stored curated estimate; higher = more lock-in (worse)","pickExitSignals":["serves open-weight models (provider tag `open-model`)"],"runnerUpExitSignals":[],"pickNotes":[],"selfHostFallback":[],"migration":"Pick exit signals: serves open-weight models (provider tag `open-model`).","migrationReason":null,"derivedFrom":"stored lockInRisk scores, provider tags (oss, self-host, openai-compat, open-models), free rows that list this job, and verbatim provider notes. No migration guide was invented."}},"freshness":{"pick":{"score":{"asOf":"2026-09-14","ageDays":43,"stale":true,"staleAfterDays":30,"reason":null},"lastReviewed":{"asOf":"2026-09-14","ageDays":43,"stale":true,"staleAfterDays":30,"reason":null},"sourceCheck":{"checkedAt":"2026-10-27","sourceUrls":3,"sourcesReachable":3,"pricingRows":32,"pricingRowsReconfirmed":22,"note":"A source re-check confirms the page is reachable and, for pricing rows, that the stored amount and SKU name appear on it. It does not re-derive or change the score.","reason":null}}},"depotPick":{"id":"chutes","slug":"chutes","name":"Chutes","tagline":"Budget open-model overflow with a now-pinned public TEE matrix. Depot open-model production pick stays…","overall":6.82},"runnersUp":[{"id":"friendli","slug":"friendli","name":"FriendliAI","tagline":"Open-model production peer when latency/tool-calling matter. Fireworks remains depot open-model default…","overall":8.01},{"id":"amazon-bedrock","slug":"amazon-bedrock","name":"Amazon Bedrock","tagline":"Enterprise multi-model switchboard. Great when AWS is mandatory; mediocre when you just want the best Claude…","overall":8.04},{"id":"azure-openai","slug":"azure-openai","name":"Azure OpenAI","tagline":"Pick when IT already standardized on Azure and needs VNET/private endpoints. Otherwise go direct OpenAI and…","overall":7.9},{"id":"fireworks","slug":"fireworks","name":"Fireworks AI","tagline":"Top pick for production open-model serving with real DX. Prefer over random GPU DIY when you want tokens not…","overall":8.08}]}