{"subject":{"id":"nvidia-nim","slug":"nvidia-nim","name":"NVIDIA NIM / NGC","tagline":"Choose when you self-host inference on NVIDIA GPUs and want blessed containers. For serverless tokens use…","website":"https://www.nvidia.com/en-us/ai/","status":"active","overall":7.66,"scoreKind":"curated_estimate","confidence":"medium","scoreAsOf":"2026-10-19","lastReviewed":"2026-10-19","categoryIds":["cat-inference-apis","cat-gpu-cloud","cat-train-finetune"],"regions":["global","us"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"unavailable","normalizationReason":"no_sourced_price","shape":"prose_notes_only","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[],"notesExcerpt":"As of 2026-10-24 (nvidia.com/en-us/ai-data-science/products/nim-microservices, fetched 2026-10-24; NVIDIA publishes no NIM price page, and this product page states no price figures, so production licence price stays null — 'Contact Sales'): hosted prototyping 'Start Prototyping f…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-10-19","scoreAsOf":"2026-10-19","website":"https://www.nvidia.com/en-us/ai/","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"No sourced price row for this provider. pricingNotes stay prose. See research/gaps.md."}},"relatedJtbdSlugs":["open-model-inference","enterprise-gpu","production-inference-fleet","self-host-nim","air-gapped-model-serve"],"alternatives":[{"id":"fireworks","slug":"fireworks","name":"Fireworks AI","tagline":"Top pick for production open-model serving with real DX. Prefer over random GPU DIY when you want tokens not…","website":"https://fireworks.ai","status":"active","overall":8.35,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-09-14","deltaOverallVsSubject":0.69,"roles":["same_jtbd_pick","same_jtbd_runner"],"sharedJtbdSlugs":["open-model-inference","self-host-nim"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"ambiguous","normalizationReason":"multiple_sourced_token_skus","shape":"sourced_rows","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[{"id":"fireworks-embed-to-150m","providerId":"fireworks","sku":"Embeddings up to 150M params","unit":"usd_per_million_input_tokens","amountUsd":0.008,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.008,"normalizationReason":"embedding_sku_excluded_from_provider_sort","priceSortEligible":false,"qualifier":"parameter-count bucket, not a named chat model"},{"id":"fireworks-embed-150-350m","providerId":"fireworks","sku":"Embeddings 150M-350M params","unit":"usd_per_million_input_tokens","amountUsd":0.016,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.016,"normalizationReason":"embedding_sku_excluded_from_provider_sort","priceSortEligible":false,"qualifier":"parameter-count bucket"},{"id":"fireworks-embed-qwen3-8b","providerId":"fireworks","sku":"Qwen3 8B","unit":"usd_per_million_input_tokens","amountUsd":0.1,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.1,"normalizationReason":"embedding_sku_excluded_from_provider_sort","priceSortEligible":false,"qualifier":"listed in the embeddings section after the parameter buckets"},{"id":"fireworks-train-lora-sft-to-16b","providerId":"fireworks","sku":"Managed training LoRA SFT up to 16B","unit":"usd_per_million_train_tokens","amountUsd":0.5,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.5,"normalizationReason":"training_token_price_not_inference","priceSortEligible":false,"qualifier":"per 1M training tokens"},{"id":"fireworks-gpu-h100","providerId":"fireworks","sku":"H100 80 GB","unit":"usd_per_gpu_hour","amountUsd":8,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"on-demand deployments; per-minute column also shown and not converted; reconfirmed 2026-10-27 (v0.12.139): page says 'Region-restricted deployments are priced at a 1.5x premium' (not stored as a separate row)"},{"id":"fireworks-gpu-h200","providerId":"fireworks","sku":"H200 141 GB","unit":"usd_per_gpu_hour","amountUsd":8,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"on-demand deployments; per-minute column also shown and not converted; reconfirmed 2026-10-27 (v0.12.139): page says 'Region-restricted deployments are priced at a 1.5x premium' (not stored as a separate row)"},{"id":"fireworks-gpu-b200","providerId":"fireworks","sku":"B200 180 GB","unit":"usd_per_gpu_hour","amountUsd":13,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"on-demand deployments; per-minute column also shown and not converted; reconfirmed 2026-10-27 (v0.12.139): page says 'Region-restricted deployments are priced at a 1.5x premium' (not stored as a separate row)"},{"id":"fireworks-gpu-b300","providerId":"fireworks","sku":"B300 288 GB","unit":"usd_per_gpu_hour","amountUsd":15,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"on-demand deployments; per-minute column also shown and not converted; reconfirmed 2026-10-27 (v0.12.139): page says 'Region-restricted deployments are priced at a 1.5x premium' (not stored as a separate row)"},{"id":"fireworks-gpu-gb300","providerId":"fireworks","sku":"GB300 288 GB","unit":"usd_per_gpu_hour","amountUsd":20,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"on-demand deployments; per-minute column also shown and not converted; reconfirmed 2026-10-27 (v0.12.139): page says 'Region-restricted deployments are priced at a 1.5x premium' (not stored as a separate row)"},{"id":"fireworks-serverless-chat-unavailable","providerId":"fireworks","sku":"serverless chat models","unit":"usd_per_million_input_tokens","amountUsd":null,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-03","normalizationStatus":"ambiguous","normalizedUsdPerMillionTokens":null,"normalizationReason":"page_points_elsewhere_for_serverless_chat_matrix","priceSortEligible":false,"qualifier":"fireworks.ai/pricing says to visit full pricing documentation for Standard/Priority/Fast serverless token rates. Those figures were not on this page and were not guessed."}],"notesExcerpt":"Serverless per-token + on-demand GPU; day-0 OSS model support; post-training stack. Free credits often available.","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://fireworks.ai","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=open-model-inference","human":"/providers/fireworks","compare":"/compare/nvidia-nim-vs-fireworks"},{"id":"coreweave","slug":"coreweave","name":"CoreWeave","tagline":"Enterprise training/inference fleet pick. Skip if you just need a single H100 for an afternoon — use RunPod.","website":"https://www.coreweave.com","status":"active","overall":7.71,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-10-19","deltaOverallVsSubject":0.05,"roles":["same_jtbd_pick","same_jtbd_runner"],"sharedJtbdSlugs":["enterprise-gpu","production-inference-fleet"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"unit_mismatch","normalizationReason":"unit_mismatch","shape":"sourced_rows","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[{"id":"coreweave-gpu-gh200","providerId":"coreweave","sku":"NVIDIA GH200 (1 GPU instance)","unit":"usd_per_gpu_hour","amountUsd":6.5,"currency":"USD","sourceUrl":"https://www.coreweave.com/pricing","asOf":"2026-10-19","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_hour","priceSortEligible":false,"qualifier":"On-demand price per hour for a 1-GPU instance (North America). 8-GPU HGX instance prices were not divided per GPU."},{"id":"coreweave-inference-single-gpu-h100","providerId":"coreweave","sku":"NVIDIA HGX H100 inference single GPU","unit":"usd_per_gpu_hour","amountUsd":6.16,"currency":"USD","sourceUrl":"https://www.coreweave.com/pricing","asOf":"2026-10-19","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_hour","priceSortEligible":false,"qualifier":"Column 'Inference Single GPU Price (Per Hour)' (footnote 2; footnote text not shown on the rendered page). Not the 8-GPU instance price."},{"id":"coreweave-inference-single-gpu-h200","providerId":"coreweave","sku":"NVIDIA HGX H200 inference single GPU","unit":"usd_per_gpu_hour","amountUsd":6.31,"currency":"USD","sourceUrl":"https://www.coreweave.com/pricing","asOf":"2026-10-19","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_hour","priceSortEligible":false,"qualifier":"Column 'Inference Single GPU Price (Per Hour)' (footnote 2; footnote text not shown on the rendered page). Not the 8-GPU instance price."},{"id":"coreweave-inference-single-gpu-b200","providerId":"coreweave","sku":"NVIDIA HGX B200 inference single GPU","unit":"usd_per_gpu_hour","amountUsd":8.6,"currency":"USD","sourceUrl":"https://www.coreweave.com/pricing","asOf":"2026-10-19","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_hour","priceSortEligible":false,"qualifier":"Column 'Inference Single GPU Price (Per Hour)' (footnote 2; footnote text not shown on the rendered page). Not the 8-GPU instance price."}],"notesExcerpt":"On-demand H100 ~$6+/hr class historically; B200 higher; Kubernetes-native (CKS); often sales for large capacity. Public company.","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-10-19","scoreAsOf":"2026-10-19","website":"https://www.coreweave.com","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=enterprise-gpu","human":"/providers/coreweave","compare":"/compare/nvidia-nim-vs-coreweave"},{"id":"runpod","slug":"runpod","name":"RunPod","tagline":"Depot default for self-serve GPUs. Secure Cloud for anything customer-facing; Community/spot for batch.","website":"https://www.runpod.io","status":"active","overall":8.32,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-10-19","deltaOverallVsSubject":0.66,"roles":["same_jtbd_pick"],"sharedJtbdSlugs":["production-inference-fleet"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"unit_mismatch","normalizationReason":"unit_mismatch","shape":"sourced_rows","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[{"id":"runpod-pod-h100-sxm-secure","providerId":"runpod","sku":"H100 SXM Pod (Secure Cloud)","unit":"usd_per_gpu_hour","amountUsd":3.99,"currency":"USD","sourceUrl":"https://www.runpod.io/pricing","asOf":"2026-10-19","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_hour","priceSortEligible":false,"qualifier":"On-demand Pod, Secure Cloud, per GPU per hour (page default view). Not converted to $/1M."},{"id":"runpod-pod-h100-sxm-community","providerId":"runpod","sku":"H100 SXM Pod (Community Cloud)","unit":"usd_per_gpu_hour","amountUsd":2.69,"currency":"USD","sourceUrl":"https://www.runpod.io/pricing","asOf":"2026-10-19","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_hour","priceSortEligible":false,"qualifier":"On-demand Pod, Community Cloud (third-party hosts), per GPU per hour. Not converted to $/1M."},{"id":"runpod-pod-h200-secure","providerId":"runpod","sku":"H200 Pod (Secure Cloud)","unit":"usd_per_gpu_hour","amountUsd":5.29,"currency":"USD","sourceUrl":"https://www.runpod.io/pricing","asOf":"2026-10-19","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_hour","priceSortEligible":false,"qualifier":"On-demand Pod, Secure Cloud, per GPU per hour (page default view). Not converted to $/1M."},{"id":"runpod-pod-h200-community","providerId":"runpod","sku":"H200 Pod (Community Cloud)","unit":"usd_per_gpu_hour","amountUsd":3.59,"currency":"USD","sourceUrl":"https://www.runpod.io/pricing","asOf":"2026-10-19","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_hour","priceSortEligible":false,"qualifier":"On-demand Pod, Community Cloud (third-party hosts), per GPU per hour. Not converted to $/1M."},{"id":"runpod-pod-b200-secure","providerId":"runpod","sku":"B200 Pod (Secure Cloud)","unit":"usd_per_gpu_hour","amountUsd":7.99,"currency":"USD","sourceUrl":"https://www.runpod.io/pricing","asOf":"2026-10-19","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_hour","priceSortEligible":false,"qualifier":"On-demand Pod, Secure Cloud, per GPU per hour (page default view). Not converted to $/1M."},{"id":"runpod-pod-b200-community","providerId":"runpod","sku":"B200 Pod (Community Cloud)","unit":"usd_per_gpu_hour","amountUsd":5.98,"currency":"USD","sourceUrl":"https://www.runpod.io/pricing","asOf":"2026-10-19","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_hour","priceSortEligible":false,"qualifier":"On-demand Pod, Community Cloud (third-party hosts), per GPU per hour. Not converted to $/1M."},{"id":"runpod-pod-a100-sxm-secure","providerId":"runpod","sku":"A100 SXM Pod (Secure Cloud)","unit":"usd_per_gpu_hour","amountUsd":1.79,"currency":"USD","sourceUrl":"https://www.runpod.io/pricing","asOf":"2026-10-19","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_hour","priceSortEligible":false,"qualifier":"On-demand Pod, Secure Cloud, per GPU per hour (page default view). Not converted to $/1M."},{"id":"runpod-pod-a100-sxm-community","providerId":"runpod","sku":"A100 SXM Pod (Community Cloud)","unit":"usd_per_gpu_hour","amountUsd":1.39,"currency":"USD","sourceUrl":"https://www.runpod.io/pricing","asOf":"2026-10-19","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_hour","priceSortEligible":false,"qualifier":"On-demand Pod, Community Cloud (third-party hosts), per GPU per hour. Not converted to $/1M."},{"id":"runpod-pod-l40s-secure","providerId":"runpod","sku":"L40S Pod (Secure Cloud)","unit":"usd_per_gpu_hour","amountUsd":1.09,"currency":"USD","sourceUrl":"https://www.runpod.io/pricing","asOf":"2026-10-19","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_hour","priceSortEligible":false,"qualifier":"On-demand Pod, Secure Cloud, per GPU per hour (page default view). Not converted to $/1M."},{"id":"runpod-pod-l40s-community","providerId":"runpod","sku":"L40S Pod (Community Cloud)","unit":"usd_per_gpu_hour","amountUsd":0.79,"currency":"USD","sourceUrl":"https://www.runpod.io/pricing","asOf":"2026-10-19","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_hour","priceSortEligible":false,"qualifier":"On-demand Pod, Community Cloud (third-party hosts), per GPU per hour. Not converted to $/1M."},{"id":"runpod-pod-rtx-4090-secure","providerId":"runpod","sku":"RTX 4090 Pod (Secure Cloud)","unit":"usd_per_gpu_hour","amountUsd":0.89,"currency":"USD","sourceUrl":"https://www.runpod.io/pricing","asOf":"2026-10-19","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_hour","priceSortEligible":false,"qualifier":"On-demand Pod, Secure Cloud, per GPU per hour (page default view). Not converted to $/1M."},{"id":"runpod-pod-rtx-4090-community","providerId":"runpod","sku":"RTX 4090 Pod (Community Cloud)","unit":"usd_per_gpu_hour","amountUsd":0.34,"currency":"USD","sourceUrl":"https://www.runpod.io/pricing","asOf":"2026-10-19","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_hour","priceSortEligible":false,"qualifier":"On-demand Pod, Community Cloud (third-party hosts), per GPU per hour. Not converted to $/1M."}],"notesExcerpt":"Secure Cloud + Community Cloud; serverless per-second; H100 often ~$2–3+/hr depending tier; spot cheaper.","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-10-19","scoreAsOf":"2026-10-19","website":"https://www.runpod.io","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=production-inference-fleet","human":"/providers/runpod","compare":"/compare/nvidia-nim-vs-runpod"},{"id":"friendli","slug":"friendli","name":"FriendliAI","tagline":"Open-model production peer when latency/tool-calling matter. Fireworks remains depot open-model default…","website":"https://friendli.ai","status":"active","overall":8.03,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-10-01","deltaOverallVsSubject":0.37,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["open-model-inference","production-inference-fleet"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"ambiguous","normalizationReason":"input_output_split_not_a_single_rate","shape":"sourced_rows","filterable":false,"priceSortEligible":true,"priceSortKeyUsdPerMillionInputTokens":0.14,"rows":[{"id":"friendli-gpu-a100","providerId":"friendli","sku":"A100 80GB","unit":"usd_per_gpu_hour","amountUsd":4,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated on-demand; billed per second. Matches pricing-watch 2026-10-01 step-up."},{"id":"friendli-gpu-h100","providerId":"friendli","sku":"H100 80GB","unit":"usd_per_gpu_hour","amountUsd":5,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated on-demand; billed per second. Matches pricing-watch 2026-10-01 step-up."},{"id":"friendli-gpu-h200","providerId":"friendli","sku":"H200 141GB","unit":"usd_per_gpu_hour","amountUsd":7,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated on-demand; billed per second. Matches pricing-watch 2026-10-01 step-up."},{"id":"friendli-gpu-b200","providerId":"friendli","sku":"B200 180GB","unit":"usd_per_gpu_hour","amountUsd":9,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated on-demand; billed per second. Matches pricing-watch 2026-10-01 step-up."},{"id":"friendli-gpu-b300","providerId":"friendli","sku":"B300 288GB","unit":"usd_per_gpu_hour","amountUsd":12,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated on-demand; billed per second. Matches pricing-watch 2026-10-01 step-up."},{"id":"friendli-glm-53-flash-input","providerId":"friendli","sku":"GLM-5.3-Flash","unit":"usd_per_million_input_tokens","amountUsd":0.15,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.15,"normalizationReason":null,"priceSortEligible":true,"qualifier":"model API $/1M tokens"},{"id":"friendli-glm-53-flash-output","providerId":"friendli","sku":"GLM-5.3-Flash","unit":"usd_per_million_output_tokens","amountUsd":0.5,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.5,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-glm-53-flash-cached","providerId":"friendli","sku":"GLM-5.3-Flash","unit":"usd_per_million_cached_input_tokens","amountUsd":0.03,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.03,"normalizationReason":"cached_input_not_a_single_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-glm-52-input","providerId":"friendli","sku":"GLM-5.2","unit":"usd_per_million_input_tokens","amountUsd":1.4,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.4,"normalizationReason":null,"priceSortEligible":true,"qualifier":"model API $/1M tokens"},{"id":"friendli-glm-52-output","providerId":"friendli","sku":"GLM-5.2","unit":"usd_per_million_output_tokens","amountUsd":4.4,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":4.4,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-glm-52-cached","providerId":"friendli","sku":"GLM-5.2","unit":"usd_per_million_cached_input_tokens","amountUsd":0.26,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.26,"normalizationReason":"cached_input_not_a_single_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-glm-51-input","providerId":"friendli","sku":"GLM-5.1","unit":"usd_per_million_input_tokens","amountUsd":1.4,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.4,"normalizationReason":null,"priceSortEligible":true,"qualifier":"model API $/1M tokens"},{"id":"friendli-glm-51-output","providerId":"friendli","sku":"GLM-5.1","unit":"usd_per_million_output_tokens","amountUsd":4.4,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":4.4,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-glm-51-cached","providerId":"friendli","sku":"GLM-5.1","unit":"usd_per_million_cached_input_tokens","amountUsd":0.26,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.26,"normalizationReason":"cached_input_not_a_single_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-gemma-4-31b-it-input","providerId":"friendli","sku":"gemma-4-31B-it","unit":"usd_per_million_input_tokens","amountUsd":0.14,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.14,"normalizationReason":null,"priceSortEligible":true,"qualifier":"model API $/1M tokens"},{"id":"friendli-gemma-4-31b-it-output","providerId":"friendli","sku":"gemma-4-31B-it","unit":"usd_per_million_output_tokens","amountUsd":0.4,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.4,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-deepseek-v32-input","providerId":"friendli","sku":"DeepSeek-V3.2","unit":"usd_per_million_input_tokens","amountUsd":0.5,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.5,"normalizationReason":null,"priceSortEligible":true,"qualifier":"model API $/1M tokens"},{"id":"friendli-deepseek-v32-output","providerId":"friendli","sku":"DeepSeek-V3.2","unit":"usd_per_million_output_tokens","amountUsd":1.5,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.5,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-deepseek-v32-cached","providerId":"friendli","sku":"DeepSeek-V3.2","unit":"usd_per_million_cached_input_tokens","amountUsd":0.25,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.25,"normalizationReason":"cached_input_not_a_single_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-minimax-m25-input","providerId":"friendli","sku":"MiniMax-M2.5","unit":"usd_per_million_input_tokens","amountUsd":0.3,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.3,"normalizationReason":null,"priceSortEligible":false,"qualifier":"model API $/1M tokens","sourceStatus":"unverified","sourceStatusReason":"model_not_on_source_page: on 2026-10-25 the Pay per token table on https://friendli.ai/pricing lists GLM-5.3, GLM-5.3-Flash, GLM-5.2, GLM-5.1, gemma-4-31B-it and DeepSeek-V3.2 (plus whisper-large-v3 under Speech to text); MiniMax-M2.5 is no longer in the table (MiniMax appears only in a generic overview sentence without an amount). Kept for history, never ranked.","sourceStatusCheckedOn":"2026-10-25"},{"id":"friendli-minimax-m25-output","providerId":"friendli","sku":"MiniMax-M2.5","unit":"usd_per_million_output_tokens","amountUsd":1.2,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.2,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null,"sourceStatus":"unverified","sourceStatusReason":"model_not_on_source_page: on 2026-10-25 the Pay per token table on https://friendli.ai/pricing lists GLM-5.3, GLM-5.3-Flash, GLM-5.2, GLM-5.1, gemma-4-31B-it and DeepSeek-V3.2 (plus whisper-large-v3 under Speech to text); MiniMax-M2.5 is no longer in the table (MiniMax appears only in a generic overview sentence without an amount). Kept for history, never ranked.","sourceStatusCheckedOn":"2026-10-25"},{"id":"friendli-minimax-m25-cached","providerId":"friendli","sku":"MiniMax-M2.5","unit":"usd_per_million_cached_input_tokens","amountUsd":0.06,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.06,"normalizationReason":"cached_input_not_a_single_rate","priceSortEligible":false,"qualifier":null,"sourceStatus":"unverified","sourceStatusReason":"model_not_on_source_page: on 2026-10-25 the Pay per token table on https://friendli.ai/pricing lists GLM-5.3, GLM-5.3-Flash, GLM-5.2, GLM-5.1, gemma-4-31B-it and DeepSeek-V3.2 (plus whisper-large-v3 under Speech to text); MiniMax-M2.5 is no longer in the table (MiniMax appears only in a generic overview sentence without an amount). Kept for history, never ranked.","sourceStatusCheckedOn":"2026-10-25"},{"id":"friendli-glm-53-ambiguous","providerId":"friendli","sku":"GLM-5.3","unit":"usd_per_million_input_tokens","amountUsd":null,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"ambiguous","normalizedUsdPerMillionTokens":null,"normalizationReason":"promo_and_list_price_adjacent","priceSortEligible":false,"qualifier":"Page shows 10% OFF and both $1.26 and $1.40 input (cached $0.234/$0.26, output $3.96/$4.40). No single figure selected."}],"notesExcerpt":"As of 2026-10-01 (friendli.ai/pricing live): Dedicated Endpoints on-demand step-up **is live** — A100 **$4.0**/hr, H100 **$5.0**/hr, H200 **$7.0**/hr, B200 **$9.0**/hr, B300 $12.0/hr (was through-Sep-30: A100 $2.9, H100 $3.9, H200 $4.5, B200 $8.9, B300 $12.0). Billed per second; …","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-10-01","scoreAsOf":"2026-10-01","website":"https://friendli.ai","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=open-model-inference","human":"/providers/friendli","compare":"/compare/nvidia-nim-vs-friendli"},{"id":"baseten","slug":"baseten","name":"Baseten","tagline":"Strong custom-model serving alternative to Replicate/Modal when you bring your own model.","website":"https://www.baseten.co","status":"active","overall":7.99,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-09-14","deltaOverallVsSubject":0.33,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["production-inference-fleet","self-host-nim"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"ambiguous","normalizationReason":"input_output_split_not_a_single_rate","shape":"sourced_rows","filterable":false,"priceSortEligible":true,"priceSortKeyUsdPerMillionInputTokens":0.1,"rows":[{"id":"baseten-gpt-oss-120b-in","providerId":"baseten","sku":"GPT OSS 120B","unit":"usd_per_million_input_tokens","amountUsd":0.1,"currency":"USD","sourceUrl":"https://www.baseten.co/pricing/","asOf":"2026-10-19","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.1,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Model APIs, price per 1M input tokens."},{"id":"baseten-gpt-oss-120b-out","providerId":"baseten","sku":"GPT OSS 120B","unit":"usd_per_million_output_tokens","amountUsd":0.5,"currency":"USD","sourceUrl":"https://www.baseten.co/pricing/","asOf":"2026-10-19","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.5,"normalizationReason":null,"priceSortEligible":false,"qualifier":"Model APIs, price per 1M output tokens."},{"id":"baseten-glm-5-3-flash-in","providerId":"baseten","sku":"GLM-5.3-Flash","unit":"usd_per_million_input_tokens","amountUsd":0.15,"currency":"USD","sourceUrl":"https://www.baseten.co/pricing/","asOf":"2026-10-19","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.15,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Model APIs, price per 1M input tokens."},{"id":"baseten-glm-5-3-flash-out","providerId":"baseten","sku":"GLM-5.3-Flash","unit":"usd_per_million_output_tokens","amountUsd":0.5,"currency":"USD","sourceUrl":"https://www.baseten.co/pricing/","asOf":"2026-10-19","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.5,"normalizationReason":null,"priceSortEligible":false,"qualifier":"Model APIs, price per 1M output tokens."},{"id":"baseten-deepseek-v4-1-flash-in","providerId":"baseten","sku":"DeepSeek V4.1 Flash","unit":"usd_per_million_input_tokens","amountUsd":0.3,"currency":"USD","sourceUrl":"https://www.baseten.co/pricing/","asOf":"2026-10-19","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.3,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Model APIs, price per 1M input tokens."},{"id":"baseten-deepseek-v4-1-flash-out","providerId":"baseten","sku":"DeepSeek V4.1 Flash","unit":"usd_per_million_output_tokens","amountUsd":1.2,"currency":"USD","sourceUrl":"https://www.baseten.co/pricing/","asOf":"2026-10-19","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.2,"normalizationReason":null,"priceSortEligible":false,"qualifier":"Model APIs, price per 1M output tokens."},{"id":"baseten-kimi-k3-in","providerId":"baseten","sku":"Kimi K3","unit":"usd_per_million_input_tokens","amountUsd":3,"currency":"USD","sourceUrl":"https://www.baseten.co/pricing/","asOf":"2026-10-19","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":3,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Model APIs, price per 1M input tokens."},{"id":"baseten-kimi-k3-out","providerId":"baseten","sku":"Kimi K3","unit":"usd_per_million_output_tokens","amountUsd":15,"currency":"USD","sourceUrl":"https://www.baseten.co/pricing/","asOf":"2026-10-19","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":15,"normalizationReason":null,"priceSortEligible":false,"qualifier":"Model APIs, price per 1M output tokens."}],"notesExcerpt":"As of 2026-09-14 (baseten.co/pricing live): Model APIs + dedicated Truss deploys. Token examples: GLM-5.3-Flash $0.15/$0.50 per 1M (stored row). Per baseten.co/pricing as of 2026-10-21 (not stored as rows): GLM-5.3 and GLM-5.2 each input $1.40, cache input $0.14, output $4.40 per…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://www.baseten.co","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=production-inference-fleet","human":"/providers/baseten","compare":"/compare/nvidia-nim-vs-baseten"},{"id":"huggingface-inference","slug":"huggingface-inference","name":"Hugging Face Inference","tagline":"Perfect for Hub-native workflows and custom models. For hard production latency, graduate to…","website":"https://endpoints.huggingface.co","status":"active","overall":7.95,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-09-14","deltaOverallVsSubject":0.29,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["open-model-inference","air-gapped-model-serve"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"unit_mismatch","normalizationReason":"unit_mismatch","shape":"sourced_rows","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[{"id":"huggingface-inference-aws-nvidia-t4-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-t4 x1","unit":"usd_per_gpu_hour","amountUsd":0.5,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-t4-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-t4 x4","unit":"usd_per_instance_hour","amountUsd":3,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-t4 x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-l4-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-l4 x1","unit":"usd_per_gpu_hour","amountUsd":0.8,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-l4-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-l4 x4","unit":"usd_per_instance_hour","amountUsd":3.8,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-l4 x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-a10g-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-a10g x1","unit":"usd_per_gpu_hour","amountUsd":1,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-a10g-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-a10g x4","unit":"usd_per_instance_hour","amountUsd":5,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-a10g x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-l40s-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-l40s x1","unit":"usd_per_gpu_hour","amountUsd":1.8,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-l40s-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-l40s x4","unit":"usd_per_instance_hour","amountUsd":8.3,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-l40s x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-l40s-x8-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-l40s x8","unit":"usd_per_instance_hour","amountUsd":23.5,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-l40s x8 instance (8 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 8. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-a100-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-a100 x1","unit":"usd_per_gpu_hour","amountUsd":2.5,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-a100-x2-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-a100 x2","unit":"usd_per_instance_hour","amountUsd":5,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-a100 x2 instance (2 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 2. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-a100-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-a100 x4","unit":"usd_per_instance_hour","amountUsd":10,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-a100 x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-a100-x8-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-a100 x8","unit":"usd_per_instance_hour","amountUsd":20,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-a100 x8 instance (8 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 8. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-h200-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-h200 x1","unit":"usd_per_gpu_hour","amountUsd":5,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-h200-x2-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-h200 x2","unit":"usd_per_instance_hour","amountUsd":10,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-h200 x2 instance (2 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 2. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-h200-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-h200 x4","unit":"usd_per_instance_hour","amountUsd":20,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-h200 x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-h200-x8-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-h200 x8","unit":"usd_per_instance_hour","amountUsd":40,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-h200 x8 instance (8 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 8. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-t4-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-t4 x1","unit":"usd_per_gpu_hour","amountUsd":0.5,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-l4-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-l4 x1","unit":"usd_per_gpu_hour","amountUsd":0.7,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-l4-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-l4 x4","unit":"usd_per_instance_hour","amountUsd":3.8,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole gcp nvidia-l4 x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-a100-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-a100 x1","unit":"usd_per_gpu_hour","amountUsd":3.6,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-a100-x2-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-a100 x2","unit":"usd_per_instance_hour","amountUsd":7.2,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole gcp nvidia-a100 x2 instance (2 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 2. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-a100-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-a100 x4","unit":"usd_per_instance_hour","amountUsd":14.4,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole gcp nvidia-a100 x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-a100-x8-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-a100 x8","unit":"usd_per_instance_hour","amountUsd":28.8,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole gcp nvidia-a100 x8 instance (8 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 8. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-h100-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-h100 x1","unit":"usd_per_gpu_hour","amountUsd":10,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-h100-x2-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-h100 x2","unit":"usd_per_instance_hour","amountUsd":20,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole gcp nvidia-h100 x2 instance (2 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 2. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-h100-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-h100 x4","unit":"usd_per_instance_hour","amountUsd":40,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole gcp nvidia-h100 x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-h100-x8-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-h100 x8","unit":"usd_per_instance_hour","amountUsd":80,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole gcp nvidia-h100 x8 instance (8 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 8. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-inf2-x1-usd-per-hour","providerId":"huggingface-inference","sku":"aws inf2 x1","unit":"usd_per_hour","amountUsd":0.75,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_hour","priceSortEligible":false,"qualifier":"Inferentia2 accelerator hour. Not a token price. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-tpu-v5e-1x1-usd-per-hour","providerId":"huggingface-inference","sku":"gcp tpu v5e 1x1","unit":"usd_per_hour","amountUsd":1.2,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_hour","priceSortEligible":false,"qualifier":"TPU v5e accelerator hour. Not a token price. Re-checked on the page 2026-10-27."}],"notesExcerpt":"Inference Providers (pay-as-you-go access to partner inference providers plus Hugging Face's own hf-inference provider) + dedicated Inference Endpoints ('Pay for what you use, per minute' per https://endpoints.huggingface.co, fetched 2026-10-25; instance rates are the price rows:…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://endpoints.huggingface.co","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=open-model-inference","human":"/providers/huggingface-inference","compare":"/compare/nvidia-nim-vs-huggingface-inference"},{"id":"aws-gpu","slug":"aws-gpu","name":"AWS GPU (EC2/P5/SageMaker)","tagline":"Use when AWS is destiny. For greenfield agent GPUs, neoclouds win on price and speed-to-pod.","website":"https://aws.amazon.com/ec2/instance-types/","status":"active","overall":7.72,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-09-14","deltaOverallVsSubject":0.06,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["enterprise-gpu","production-inference-fleet"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"unavailable","normalizationReason":"no_sourced_price","shape":"prose_notes_only","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[],"notesExcerpt":"P5/P4d etc. often $4–7+/GPU-hr on-demand; Savings Plans/spot help; SageMaker adds managed tax.","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://aws.amazon.com/ec2/instance-types/","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"No sourced price row for this provider. pricingNotes stay prose. See research/gaps.md."},"decideHint":"/api/decide?jtbd=enterprise-gpu","human":"/providers/aws-gpu","compare":"/compare/nvidia-nim-vs-aws-gpu"},{"id":"modal","slug":"modal","name":"Modal","tagline":"Depot darling for Python agent backends and bursty GPU jobs. If you think in functions not VMs, start here.","website":"https://modal.com","status":"active","overall":8.44,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-10-19","deltaOverallVsSubject":0.78,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["production-inference-fleet"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"unit_mismatch","normalizationReason":"unit_mismatch","shape":"sourced_rows","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[{"id":"modal-nvidia-b300-usd-per-gpu-second","providerId":"modal","sku":"Nvidia B300","unit":"usd_per_gpu_second","amountUsd":0.001972,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-b200-usd-per-gpu-second","providerId":"modal","sku":"Nvidia B200","unit":"usd_per_gpu_second","amountUsd":0.001736,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-h200-sxm-usd-per-gpu-second","providerId":"modal","sku":"Nvidia H200 SXM","unit":"usd_per_gpu_second","amountUsd":0.001261,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-h100-sxm5-usd-per-gpu-second","providerId":"modal","sku":"Nvidia H100 SXM5","unit":"usd_per_gpu_second","amountUsd":0.001097,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-rtx-pro-6000-usd-per-gpu-second","providerId":"modal","sku":"Nvidia RTX PRO 6000","unit":"usd_per_gpu_second","amountUsd":0.000842,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-a100-80gb-usd-per-gpu-second","providerId":"modal","sku":"Nvidia A100 80GB","unit":"usd_per_gpu_second","amountUsd":0.000694,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-a100-40gb-usd-per-gpu-second","providerId":"modal","sku":"Nvidia A100 40GB","unit":"usd_per_gpu_second","amountUsd":0.000583,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-l40s-usd-per-gpu-second","providerId":"modal","sku":"Nvidia L40S","unit":"usd_per_gpu_second","amountUsd":0.000542,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-a10-usd-per-gpu-second","providerId":"modal","sku":"Nvidia A10","unit":"usd_per_gpu_second","amountUsd":0.000306,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-l4-usd-per-gpu-second","providerId":"modal","sku":"Nvidia L4","unit":"usd_per_gpu_second","amountUsd":0.000222,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-t4-usd-per-gpu-second","providerId":"modal","sku":"Nvidia T4","unit":"usd_per_gpu_second","amountUsd":0.000164,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-cpu-physical-core-usd-per-core-second","providerId":"modal","sku":"CPU physical core","unit":"usd_per_core_second","amountUsd":0.0000131,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_core_second","priceSortEligible":false,"qualifier":"Physical core (2 vCPU). Minimum 0.125 cores."},{"id":"modal-memory-usd-per-gib-second","providerId":"modal","sku":"Memory","unit":"usd_per_gib_second","amountUsd":0.00000222,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gib_second","priceSortEligible":false,"qualifier":"Container memory."},{"id":"modal-sandbox-cpu-usd-per-core-second","providerId":"modal","sku":"Sandbox CPU","unit":"usd_per_core_second","amountUsd":0.00003942,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_core_second","priceSortEligible":false,"qualifier":"Modal Sandbox rate (page: 'Modal Sandbox pricing', 'CPU (non-preemptible)'; 'Sandboxes are billed at non-preemptible rates of 3x list price'), separate from the default CPU rate."},{"id":"modal-sandbox-memory-usd-per-gib-second","providerId":"modal","sku":"Sandbox memory","unit":"usd_per_gib_second","amountUsd":0.00000667,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gib_second","priceSortEligible":false,"qualifier":"Sandbox memory (page: 'Memory (non-preemptible)' under 'Modal Sandbox pricing')."},{"id":"modal-volumes-usd-per-gib-month","providerId":"modal","sku":"Volumes","unit":"usd_per_gib_month","amountUsd":0.09,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gib_month","priceSortEligible":false,"qualifier":"Includes 1 TiB/mo free, not folded into this rate."},{"id":"modal-network-egress-usd-per-gib","providerId":"modal","sku":"Network egress","unit":"usd_per_gib","amountUsd":0.04,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gib","priceSortEligible":false,"qualifier":"See plan for included usage."},{"id":"modal-team-plan-usd-per-month","providerId":"modal","sku":"Team plan","unit":"usd_per_month","amountUsd":250,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_month","priceSortEligible":false,"qualifier":"Plus compute. $100/mo credits not subtracted."}],"notesExcerpt":"As of 2026-10-24 (modal.com/pricing, fetched 2026-10-24): Python-native serverless GPU/CPU billed per second of compute ('You never pay for idle resources'). GPU list rates per second: H100 SXM5 '$0.001097', H200 SXM '$0.001261', B200 '$0.001736', A100 80 GB '$0.000694', L40S '$0…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-10-19","scoreAsOf":"2026-10-19","website":"https://modal.com","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=production-inference-fleet","human":"/providers/modal","compare":"/compare/nvidia-nim-vs-modal"},{"id":"together","slug":"together","name":"Together AI","tagline":"Best catalog breadth for OSS models. Watch minimums and lifetime spend gates before you design around a gated…","website":"https://www.together.ai","status":"active","overall":8.2,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-09-14","deltaOverallVsSubject":0.54,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["open-model-inference"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"ambiguous","normalizationReason":"input_output_split_not_a_single_rate","shape":"sourced_rows","filterable":false,"priceSortEligible":true,"priceSortKeyUsdPerMillionInputTokens":0.15,"rows":[{"id":"together-llama-33-70b-input","providerId":"together","sku":"Llama 3.3 70B","unit":"usd_per_million_input_tokens","amountUsd":1.04,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.04,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Serverless price-per-1M-tokens table. A separate fine-tune table also lists Llama 3.3 70B at different numbers and was not used."},{"id":"together-llama-33-70b-output","providerId":"together","sku":"Llama 3.3 70B","unit":"usd_per_million_output_tokens","amountUsd":1.04,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.04,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"together-deepseek-v4-pro-0813-input","providerId":"together","sku":"DeepSeek V4 Pro 0813","unit":"usd_per_million_input_tokens","amountUsd":1.32,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.32,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Serverless price-per-1M-tokens table. A separate fine-tune table also lists Llama 3.3 70B at different numbers and was not used."},{"id":"together-deepseek-v4-pro-0813-output","providerId":"together","sku":"DeepSeek V4 Pro 0813","unit":"usd_per_million_output_tokens","amountUsd":3.96,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":3.96,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"together-deepseek-v4-pro-0813-cached","providerId":"together","sku":"DeepSeek V4 Pro 0813","unit":"usd_per_million_cached_input_tokens","amountUsd":0.13,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.13,"normalizationReason":"cached_input_not_a_single_rate","priceSortEligible":false,"qualifier":null},{"id":"together-gpt-oss-120b-input","providerId":"together","sku":"gpt-oss-120B","unit":"usd_per_million_input_tokens","amountUsd":0.15,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.15,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Serverless price-per-1M-tokens table. A separate fine-tune table also lists Llama 3.3 70B at different numbers and was not used."},{"id":"together-gpt-oss-120b-output","providerId":"together","sku":"gpt-oss-120B","unit":"usd_per_million_output_tokens","amountUsd":0.6,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.6,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"together-glm-53-flash-input","providerId":"together","sku":"GLM-5.3-Flash","unit":"usd_per_million_input_tokens","amountUsd":0.15,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.15,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Serverless price-per-1M-tokens table. A separate fine-tune table also lists Llama 3.3 70B at different numbers and was not used."},{"id":"together-glm-53-flash-output","providerId":"together","sku":"GLM-5.3-Flash","unit":"usd_per_million_output_tokens","amountUsd":0.5,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.5,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"together-glm-53-flash-cached","providerId":"together","sku":"GLM-5.3-Flash","unit":"usd_per_million_cached_input_tokens","amountUsd":0.03,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.03,"normalizationReason":"cached_input_not_a_single_rate","priceSortEligible":false,"qualifier":null}],"notesExcerpt":"As of 2026-09-14: Open-model inference + fine-tune on one OpenAI-compatible API; competitive per-token rates (often ~$0.15–$0.90/MTok class depending on model). Strong for Llama/Qwen/DeepSeek families; Dedicated endpoints available.","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://www.together.ai","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=open-model-inference","human":"/providers/together","compare":"/compare/nvidia-nim-vs-together"},{"id":"groq","slug":"groq","name":"Groq","tagline":"Use when latency is the product. Do not build your whole company on one Groq model SKU — they rotate.","website":"https://groq.com","status":"active","overall":7.95,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-09-14","deltaOverallVsSubject":0.29,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["open-model-inference"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"ambiguous","normalizationReason":"input_output_split_not_a_single_rate","shape":"sourced_rows","filterable":false,"priceSortEligible":true,"priceSortKeyUsdPerMillionInputTokens":0.075,"rows":[{"id":"groq-gpt-oss-120b-input","providerId":"groq","sku":"openai/gpt-oss-120b","unit":"usd_per_million_input_tokens","amountUsd":0.15,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.15,"normalizationReason":null,"priceSortEligible":true,"qualifier":"column header PRICE PER 1M TOKENS. Llama 3.1 8B and Llama 3.3 70B on the same page say Contact Sales and were omitted."},{"id":"groq-gpt-oss-120b-output","providerId":"groq","sku":"openai/gpt-oss-120b","unit":"usd_per_million_output_tokens","amountUsd":0.6,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.6,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"groq-gpt-oss-20b-input","providerId":"groq","sku":"openai/gpt-oss-20b","unit":"usd_per_million_input_tokens","amountUsd":0.075,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.075,"normalizationReason":null,"priceSortEligible":true,"qualifier":"column header PRICE PER 1M TOKENS. Llama 3.1 8B and Llama 3.3 70B on the same page say Contact Sales and were omitted."},{"id":"groq-gpt-oss-20b-output","providerId":"groq","sku":"openai/gpt-oss-20b","unit":"usd_per_million_output_tokens","amountUsd":0.3,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.3,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"groq-llama-prompt-guard-2-22m-input","providerId":"groq","sku":"meta-llama/llama-prompt-guard-2-22m","unit":"usd_per_million_input_tokens","amountUsd":0.03,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.03,"normalizationReason":"classifier_sku_excluded_from_provider_sort","priceSortEligible":false,"qualifier":"column header PRICE PER 1M TOKENS. Llama 3.1 8B and Llama 3.3 70B on the same page say Contact Sales and were omitted."},{"id":"groq-llama-prompt-guard-2-22m-output","providerId":"groq","sku":"meta-llama/llama-prompt-guard-2-22m","unit":"usd_per_million_output_tokens","amountUsd":0.03,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.03,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"groq-llama-prompt-guard-2-86m-input","providerId":"groq","sku":"meta-llama/llama-prompt-guard-2-86m","unit":"usd_per_million_input_tokens","amountUsd":0.04,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.04,"normalizationReason":"classifier_sku_excluded_from_provider_sort","priceSortEligible":false,"qualifier":"column header PRICE PER 1M TOKENS. Llama 3.1 8B and Llama 3.3 70B on the same page say Contact Sales and were omitted."},{"id":"groq-llama-prompt-guard-2-86m-output","providerId":"groq","sku":"meta-llama/llama-prompt-guard-2-86m","unit":"usd_per_million_output_tokens","amountUsd":0.04,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.04,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"groq-qwen3.8-27b-input","providerId":"groq","sku":"qwen/qwen3.8-27b","unit":"usd_per_million_input_tokens","amountUsd":0.8,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.8,"normalizationReason":null,"priceSortEligible":true,"qualifier":"column header PRICE PER 1M TOKENS. Llama 3.1 8B and Llama 3.3 70B on the same page say Contact Sales and were omitted."},{"id":"groq-qwen3.8-27b-output","providerId":"groq","sku":"qwen/qwen3.8-27b","unit":"usd_per_million_output_tokens","amountUsd":4,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":4,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"groq-whisper-v3","providerId":"groq","sku":"whisper-large-v3","unit":"usd_per_hour","amountUsd":0.111,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_hour","priceSortEligible":false,"qualifier":null},{"id":"groq-whisper-v3-turbo","providerId":"groq","sku":"whisper-large-v3-turbo","unit":"usd_per_hour","amountUsd":0.04,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_hour","priceSortEligible":false,"qualifier":null}],"notesExcerpt":"Per-token with free tier; LPU inference; narrow production model set (Llama/Qwen/GPT-OSS etc.); batch discounts. Llama Guard 4 12B (model id meta-llama/llama-guard-4-12b) is still documented at console.groq.com/docs/model/meta-llama/llama-guard-4-12b as an open safety classifier;…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://groq.com","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=open-model-inference","human":"/providers/groq","compare":"/compare/nvidia-nim-vs-groq"},{"id":"deepinfra","slug":"deepinfra","name":"DeepInfra","tagline":"Budget open-model workhorse and one of the cheapest large-catalog hosts. Great for evals and high-volume…","website":"https://deepinfra.com","status":"active","overall":7.95,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-09-14","deltaOverallVsSubject":0.29,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["open-model-inference"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"ambiguous","normalizationReason":"input_output_split_not_a_single_rate","shape":"sourced_rows","filterable":false,"priceSortEligible":true,"priceSortKeyUsdPerMillionInputTokens":0.1,"rows":[{"id":"deepinfra-llama-33-70b-turbo-input","providerId":"deepinfra","sku":"Llama-3.3-70B-Instruct-Turbo","unit":"usd_per_million_input_tokens","amountUsd":0.1,"currency":"USD","sourceUrl":"https://deepinfra.com/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.1,"normalizationReason":null,"priceSortEligible":true,"qualifier":"128k context row"},{"id":"deepinfra-llama-33-70b-turbo-output","providerId":"deepinfra","sku":"Llama-3.3-70B-Instruct-Turbo","unit":"usd_per_million_output_tokens","amountUsd":0.32,"currency":"USD","sourceUrl":"https://deepinfra.com/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.32,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"deepinfra-bge-base-en","providerId":"deepinfra","sku":"bge-base-en-v1.5","unit":"usd_per_million_input_tokens","amountUsd":0.005,"currency":"USD","sourceUrl":"https://deepinfra.com/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.005,"normalizationReason":"embedding_sku_excluded_from_provider_sort","priceSortEligible":false,"qualifier":"embeddings; input only"},{"id":"deepinfra-gpu-a100","providerId":"deepinfra","sku":"A100","unit":"usd_per_gpu_hour","amountUsd":1.49,"currency":"USD","sourceUrl":"https://deepinfra.com/pricing","asOf":"2026-10-20","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated GPU-hour"},{"id":"deepinfra-gpu-h100","providerId":"deepinfra","sku":"H100","unit":"usd_per_gpu_hour","amountUsd":2.9,"currency":"USD","sourceUrl":"https://deepinfra.com/pricing","asOf":"2026-10-20","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated GPU-hour"},{"id":"deepinfra-gpu-h200","providerId":"deepinfra","sku":"H200","unit":"usd_per_gpu_hour","amountUsd":3.49,"currency":"USD","sourceUrl":"https://deepinfra.com/pricing","asOf":"2026-10-20","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated GPU-hour"},{"id":"deepinfra-gpu-b200","providerId":"deepinfra","sku":"B200","unit":"usd_per_gpu_hour","amountUsd":4.89,"currency":"USD","sourceUrl":"https://deepinfra.com/pricing","asOf":"2026-10-20","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated GPU-hour"},{"id":"deepinfra-gpu-b300","providerId":"deepinfra","sku":"B300","unit":"usd_per_gpu_hour","amountUsd":5.89,"currency":"USD","sourceUrl":"https://deepinfra.com/pricing","asOf":"2026-10-20","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated GPU-hour"}],"notesExcerpt":"As of 2026-09-14: Broad OpenAI-compatible catalog with model-specific token rates (e.g. Llama-3.3-70B Turbo $0.10/$0.32 per 1M in/out; DeepSeek-V4-Flash input $0.09, cached input $0.018 and output $0.18 per 1M (deepinfra.com/pricing as of 2026-10-21; not stored as rows); embeddin…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://deepinfra.com","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=open-model-inference","human":"/providers/deepinfra","compare":"/compare/nvidia-nim-vs-deepinfra"},{"id":"replicate","slug":"replicate","name":"Replicate","tagline":"Ship a model demo by lunch. Migrate hot paths to Modal/RunPod/Fireworks when the bill hurts.","website":"https://replicate.com","status":"active","overall":7.82,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-09-14","deltaOverallVsSubject":0.16,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["self-host-nim"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"unavailable","normalizationReason":"no_sourced_price","shape":"prose_notes_only","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[],"notesExcerpt":"Run Cog models per-second; prediction-based billing; higher effective GPU cost, lowest friction.","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://replicate.com","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"No sourced price row for this provider. pricingNotes stay prose. See research/gaps.md."},"decideHint":"/api/decide?jtbd=self-host-nim","human":"/providers/replicate","compare":"/compare/nvidia-nim-vs-replicate"}],"rankContract":{"style":"editorial_weighted","notAnElo":true,"note":"deltaOverallVsSubject is Depot overall (0–10) minus the subject. It is not Arena Elo and not an Artificial Analysis index."},"freshness":{"scoreAsOfMin":"2026-09-14","scoreAsOfMax":"2026-10-19","contractAsOf":"2026-10-03"},"honesty":["Alternatives are other catalog providers that share a JTBD as pick or runner-up. If fewer than three exist, same-category active providers fill the list and are labeled same_category.","Overall deltas are catalog scores. kind=curated_estimate is not a lab measurement.","Pricing rows are sourced or explicitly null. Do not parse pricingNotes. A single normalized USD figure is set only for a provider with exactly one token row."],"links":{"human":"/alternatives/nvidia-nim","machine":"/api/alternatives?provider=nvidia-nim","provider":"/api/providers/nvidia-nim","canonical":"/api/canonical"}}