{"id":"air-gapped-model-serve","slug":"air-gapped-model-serve","name":"Air-gapped / VPC model serving","shortName":"Air-gapped serve","problemStatement":"Serve optimized models inside VPC/air-gapped networks with no mandatory data egress to public LLM APIs.","whenNotTopPick":"Private Bedrock/Azure endpoints suffice without NIM packaging, or HF Inference Endpoints already in VPC.","categoryIds":["cat-inference-apis"],"depotPickProviderId":"nvidia-nim","depotPickRationale":"Remove invalid runner if any. NIM for optimized self-host. Confidence: medium on packaging/licensing.","runnersUpIds":["huggingface-inference","amazon-bedrock","azure-openai"],"weights":{"capabilityFit":0.2,"pricePerformance":0.1,"latencyReliability":0.12,"developerDx":0.1,"privacyPosture":0.3,"lockInRisk":0.08,"maturity":0.1},"methodologyNotes":"Remove invalid runner if any. NIM for optimized self-host. Confidence: medium on packaging/licensing.","tags":["air-gapped","vpc","self-host","nim"],"depth":{"whenNotToUse":{"text":"Private Bedrock/Azure endpoints suffice without NIM packaging, or HF Inference Endpoints already in VPC.","source":"editorial `whenNotTopPick` (data/jtbds.json)"},"whenNotToUseReason":null,"runnerUp":{"providerId":"huggingface-inference","name":"Hugging Face Inference","overallForJob":7.93,"pickOverallForJob":7.83,"beatsPickOn":["pricePerformance","developerDx","lockInRisk","maturity"],"source":"first resolvable entry of the job's editorially ranked `runnersUpIds`; scores are stored job-weighted scores"},"runnerUpReason":null,"lockIn":{"pickLockInRisk":6,"runnerUpLockInRisk":3.5,"scale":"0–10 stored curated estimate; higher = more lock-in (worse)","pickExitSignals":["self-hostable (provider tag `self-host`)"],"runnerUpExitSignals":["serves open-weight models (provider tag `open-models`)"],"pickNotes":[{"text":"Portable across GPU clouds","field":"strengths"},{"text":"Choose when you self-host inference on NVIDIA GPUs and want blessed containers.","field":"scores.notes"}],"selfHostFallback":[],"migration":"Runner-up Hugging Face Inference has lower stored lock-in risk (3.5 vs 6, 0–10, higher = more lock-in). Pick exit signals: self-hostable (provider tag `self-host`).","migrationReason":null,"derivedFrom":"stored lockInRisk scores, provider tags (oss, self-host, openai-compat, open-models), free rows that list this job, and verbatim provider notes. No migration guide was invented."}},"freshness":{"pick":{"score":{"asOf":"2026-10-19","ageDays":8,"stale":false,"staleAfterDays":30,"reason":null},"lastReviewed":{"asOf":"2026-10-19","ageDays":8,"stale":false,"staleAfterDays":30,"reason":null},"sourceCheck":{"checkedAt":"2026-10-27","sourceUrls":3,"sourcesReachable":3,"pricingRows":0,"pricingRowsReconfirmed":0,"note":"A source re-check confirms the page is reachable and, for pricing rows, that the stored amount and SKU name appear on it. It does not re-derive or change the score.","reason":null}}},"depotPick":{"id":"nvidia-nim","slug":"nvidia-nim","name":"NVIDIA NIM / NGC","tagline":"Choose when you self-host inference on NVIDIA GPUs and want blessed containers. For serverless tokens use…","overall":7.83},"runnersUp":[{"id":"huggingface-inference","slug":"huggingface-inference","name":"Hugging Face Inference","tagline":"Perfect for Hub-native workflows and custom models. For hard production latency, graduate to…","overall":7.93},{"id":"amazon-bedrock","slug":"amazon-bedrock","name":"Amazon Bedrock","tagline":"Enterprise multi-model switchboard. Great when AWS is mandatory; mediocre when you just want the best Claude…","overall":8.04},{"id":"azure-openai","slug":"azure-openai","name":"Azure OpenAI","tagline":"Pick when IT already standardized on Azure and needs VNET/private endpoints. Otherwise go direct OpenAI and…","overall":7.9}]}