{"subject":{"id":"predibase","slug":"predibase","name":"Predibase","tagline":"Alive. Prefer when you serve dozens of LoRA adapters on shared GPUs. Together/Fireworks remain simpler…","website":"https://predibase.com","status":"active","overall":7.89,"scoreKind":"curated_estimate","confidence":"medium","scoreAsOf":"2026-09-14","lastReviewed":"2026-09-14","categoryIds":["cat-train-finetune","cat-inference-apis"],"regions":["us","global"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"unavailable","normalizationReason":"no_sourced_price","shape":"prose_notes_only","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[],"notesExcerpt":"As of 2026-09-14: Active managed LoRA/QLoRA + RL fine-tune (Rubrik-era Predibase); LoRAX OSS multi-adapter serving. Public token rates still not a clean first-party matrix — secondary sources cite serverless from ~$0.20/M and A10G-class GPUs ~$1.82/hr. Enterprise/VPC sales-led. C…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://predibase.com","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"No sourced price row for this provider. pricingNotes stay prose. See research/gaps.md."}},"relatedJtbdSlugs":["open-model-inference","finetune","lora-serving-distillation"],"alternatives":[{"id":"fireworks","slug":"fireworks","name":"Fireworks AI","tagline":"Top pick for production open-model serving with real DX. Prefer over random GPU DIY when you want tokens not…","website":"https://fireworks.ai","status":"active","overall":8.35,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-09-14","deltaOverallVsSubject":0.46,"roles":["same_jtbd_pick","same_jtbd_runner"],"sharedJtbdSlugs":["open-model-inference","finetune","lora-serving-distillation"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"ambiguous","normalizationReason":"multiple_sourced_token_skus","shape":"sourced_rows","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[{"id":"fireworks-embed-to-150m","providerId":"fireworks","sku":"Embeddings up to 150M params","unit":"usd_per_million_input_tokens","amountUsd":0.008,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.008,"normalizationReason":"embedding_sku_excluded_from_provider_sort","priceSortEligible":false,"qualifier":"parameter-count bucket, not a named chat model"},{"id":"fireworks-embed-150-350m","providerId":"fireworks","sku":"Embeddings 150M-350M params","unit":"usd_per_million_input_tokens","amountUsd":0.016,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.016,"normalizationReason":"embedding_sku_excluded_from_provider_sort","priceSortEligible":false,"qualifier":"parameter-count bucket"},{"id":"fireworks-embed-qwen3-8b","providerId":"fireworks","sku":"Qwen3 8B","unit":"usd_per_million_input_tokens","amountUsd":0.1,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.1,"normalizationReason":"embedding_sku_excluded_from_provider_sort","priceSortEligible":false,"qualifier":"listed in the embeddings section after the parameter buckets"},{"id":"fireworks-train-lora-sft-to-16b","providerId":"fireworks","sku":"Managed training LoRA SFT up to 16B","unit":"usd_per_million_train_tokens","amountUsd":0.5,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.5,"normalizationReason":"training_token_price_not_inference","priceSortEligible":false,"qualifier":"per 1M training tokens"},{"id":"fireworks-gpu-h100","providerId":"fireworks","sku":"H100 80 GB","unit":"usd_per_gpu_hour","amountUsd":8,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"on-demand deployments; per-minute column also shown and not converted; reconfirmed 2026-10-27 (v0.12.139): page says 'Region-restricted deployments are priced at a 1.5x premium' (not stored as a separate row)"},{"id":"fireworks-gpu-h200","providerId":"fireworks","sku":"H200 141 GB","unit":"usd_per_gpu_hour","amountUsd":8,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"on-demand deployments; per-minute column also shown and not converted; reconfirmed 2026-10-27 (v0.12.139): page says 'Region-restricted deployments are priced at a 1.5x premium' (not stored as a separate row)"},{"id":"fireworks-gpu-b200","providerId":"fireworks","sku":"B200 180 GB","unit":"usd_per_gpu_hour","amountUsd":13,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"on-demand deployments; per-minute column also shown and not converted; reconfirmed 2026-10-27 (v0.12.139): page says 'Region-restricted deployments are priced at a 1.5x premium' (not stored as a separate row)"},{"id":"fireworks-gpu-b300","providerId":"fireworks","sku":"B300 288 GB","unit":"usd_per_gpu_hour","amountUsd":15,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"on-demand deployments; per-minute column also shown and not converted; reconfirmed 2026-10-27 (v0.12.139): page says 'Region-restricted deployments are priced at a 1.5x premium' (not stored as a separate row)"},{"id":"fireworks-gpu-gb300","providerId":"fireworks","sku":"GB300 288 GB","unit":"usd_per_gpu_hour","amountUsd":20,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"on-demand deployments; per-minute column also shown and not converted; reconfirmed 2026-10-27 (v0.12.139): page says 'Region-restricted deployments are priced at a 1.5x premium' (not stored as a separate row)"},{"id":"fireworks-serverless-chat-unavailable","providerId":"fireworks","sku":"serverless chat models","unit":"usd_per_million_input_tokens","amountUsd":null,"currency":"USD","sourceUrl":"https://fireworks.ai/pricing","asOf":"2026-10-03","normalizationStatus":"ambiguous","normalizedUsdPerMillionTokens":null,"normalizationReason":"page_points_elsewhere_for_serverless_chat_matrix","priceSortEligible":false,"qualifier":"fireworks.ai/pricing says to visit full pricing documentation for Standard/Priority/Fast serverless token rates. Those figures were not on this page and were not guessed."}],"notesExcerpt":"Serverless per-token + on-demand GPU; day-0 OSS model support; post-training stack. Free credits often available.","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://fireworks.ai","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=open-model-inference","human":"/providers/fireworks","compare":"/compare/predibase-vs-fireworks"},{"id":"together","slug":"together","name":"Together AI","tagline":"Best catalog breadth for OSS models. Watch minimums and lifetime spend gates before you design around a gated…","website":"https://www.together.ai","status":"active","overall":8.2,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-09-14","deltaOverallVsSubject":0.31,"roles":["same_jtbd_runner","same_jtbd_pick"],"sharedJtbdSlugs":["open-model-inference","finetune","lora-serving-distillation"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"ambiguous","normalizationReason":"input_output_split_not_a_single_rate","shape":"sourced_rows","filterable":false,"priceSortEligible":true,"priceSortKeyUsdPerMillionInputTokens":0.15,"rows":[{"id":"together-llama-33-70b-input","providerId":"together","sku":"Llama 3.3 70B","unit":"usd_per_million_input_tokens","amountUsd":1.04,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.04,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Serverless price-per-1M-tokens table. A separate fine-tune table also lists Llama 3.3 70B at different numbers and was not used."},{"id":"together-llama-33-70b-output","providerId":"together","sku":"Llama 3.3 70B","unit":"usd_per_million_output_tokens","amountUsd":1.04,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.04,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"together-deepseek-v4-pro-0813-input","providerId":"together","sku":"DeepSeek V4 Pro 0813","unit":"usd_per_million_input_tokens","amountUsd":1.32,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.32,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Serverless price-per-1M-tokens table. A separate fine-tune table also lists Llama 3.3 70B at different numbers and was not used."},{"id":"together-deepseek-v4-pro-0813-output","providerId":"together","sku":"DeepSeek V4 Pro 0813","unit":"usd_per_million_output_tokens","amountUsd":3.96,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":3.96,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"together-deepseek-v4-pro-0813-cached","providerId":"together","sku":"DeepSeek V4 Pro 0813","unit":"usd_per_million_cached_input_tokens","amountUsd":0.13,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.13,"normalizationReason":"cached_input_not_a_single_rate","priceSortEligible":false,"qualifier":null},{"id":"together-gpt-oss-120b-input","providerId":"together","sku":"gpt-oss-120B","unit":"usd_per_million_input_tokens","amountUsd":0.15,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.15,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Serverless price-per-1M-tokens table. A separate fine-tune table also lists Llama 3.3 70B at different numbers and was not used."},{"id":"together-gpt-oss-120b-output","providerId":"together","sku":"gpt-oss-120B","unit":"usd_per_million_output_tokens","amountUsd":0.6,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.6,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"together-glm-53-flash-input","providerId":"together","sku":"GLM-5.3-Flash","unit":"usd_per_million_input_tokens","amountUsd":0.15,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.15,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Serverless price-per-1M-tokens table. A separate fine-tune table also lists Llama 3.3 70B at different numbers and was not used."},{"id":"together-glm-53-flash-output","providerId":"together","sku":"GLM-5.3-Flash","unit":"usd_per_million_output_tokens","amountUsd":0.5,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.5,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"together-glm-53-flash-cached","providerId":"together","sku":"GLM-5.3-Flash","unit":"usd_per_million_cached_input_tokens","amountUsd":0.03,"currency":"USD","sourceUrl":"https://www.together.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.03,"normalizationReason":"cached_input_not_a_single_rate","priceSortEligible":false,"qualifier":null}],"notesExcerpt":"As of 2026-09-14: Open-model inference + fine-tune on one OpenAI-compatible API; competitive per-token rates (often ~$0.15–$0.90/MTok class depending on model). Strong for Llama/Qwen/DeepSeek families; Dedicated endpoints available.","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://www.together.ai","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=open-model-inference","human":"/providers/together","compare":"/compare/predibase-vs-together"},{"id":"unsloth","slug":"unsloth","name":"Unsloth","tagline":"Depot OSS fine-tune default. Hosted LoRA → Predibase/Fireworks/Together; dead OpenPipe → do not resurrect…","website":"https://unsloth.ai","status":"active","overall":8.52,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-09-14","deltaOverallVsSubject":0.63,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["finetune","lora-serving-distillation"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"unavailable","normalizationReason":"no_sourced_price","shape":"prose_notes_only","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[],"notesExcerpt":"As of 2026-09-14 (unsloth.ai/pricing): Free OSS local training (4/16-bit LoRA, Llama/Mistral/Gemma). Pro/Enterprise = contact-sales speed/VRAM multi-GPU claims (2.5×–30× marketing). No Unsloth-hosted GPU rate card — pair with HF Jobs / RunPod / Modal for cloud GPUs. HF blog docum…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://unsloth.ai","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"No sourced price row for this provider. pricingNotes stay prose. See research/gaps.md."},"decideHint":"/api/decide?jtbd=finetune","human":"/providers/unsloth","compare":"/compare/predibase-vs-unsloth"},{"id":"huggingface-inference","slug":"huggingface-inference","name":"Hugging Face Inference","tagline":"Perfect for Hub-native workflows and custom models. For hard production latency, graduate to…","website":"https://endpoints.huggingface.co","status":"active","overall":7.95,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-09-14","deltaOverallVsSubject":0.06,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["open-model-inference","finetune"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"unit_mismatch","normalizationReason":"unit_mismatch","shape":"sourced_rows","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[{"id":"huggingface-inference-aws-nvidia-t4-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-t4 x1","unit":"usd_per_gpu_hour","amountUsd":0.5,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-t4-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-t4 x4","unit":"usd_per_instance_hour","amountUsd":3,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-t4 x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-l4-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-l4 x1","unit":"usd_per_gpu_hour","amountUsd":0.8,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-l4-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-l4 x4","unit":"usd_per_instance_hour","amountUsd":3.8,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-l4 x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-a10g-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-a10g x1","unit":"usd_per_gpu_hour","amountUsd":1,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-a10g-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-a10g x4","unit":"usd_per_instance_hour","amountUsd":5,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-a10g x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-l40s-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-l40s x1","unit":"usd_per_gpu_hour","amountUsd":1.8,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-l40s-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-l40s x4","unit":"usd_per_instance_hour","amountUsd":8.3,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-l40s x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-l40s-x8-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-l40s x8","unit":"usd_per_instance_hour","amountUsd":23.5,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-l40s x8 instance (8 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 8. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-a100-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-a100 x1","unit":"usd_per_gpu_hour","amountUsd":2.5,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-a100-x2-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-a100 x2","unit":"usd_per_instance_hour","amountUsd":5,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-a100 x2 instance (2 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 2. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-a100-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-a100 x4","unit":"usd_per_instance_hour","amountUsd":10,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-a100 x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-a100-x8-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-a100 x8","unit":"usd_per_instance_hour","amountUsd":20,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-a100 x8 instance (8 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 8. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-h200-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-h200 x1","unit":"usd_per_gpu_hour","amountUsd":5,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-h200-x2-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-h200 x2","unit":"usd_per_instance_hour","amountUsd":10,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-h200 x2 instance (2 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 2. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-h200-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-h200 x4","unit":"usd_per_instance_hour","amountUsd":20,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-h200 x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-nvidia-h200-x8-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"aws nvidia-h200 x8","unit":"usd_per_instance_hour","amountUsd":40,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole aws nvidia-h200 x8 instance (8 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 8. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-t4-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-t4 x1","unit":"usd_per_gpu_hour","amountUsd":0.5,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-l4-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-l4 x1","unit":"usd_per_gpu_hour","amountUsd":0.7,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-l4-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-l4 x4","unit":"usd_per_instance_hour","amountUsd":3.8,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole gcp nvidia-l4 x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-a100-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-a100 x1","unit":"usd_per_gpu_hour","amountUsd":3.6,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-a100-x2-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-a100 x2","unit":"usd_per_instance_hour","amountUsd":7.2,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole gcp nvidia-a100 x2 instance (2 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 2. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-a100-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-a100 x4","unit":"usd_per_instance_hour","amountUsd":14.4,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole gcp nvidia-a100 x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-a100-x8-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-a100 x8","unit":"usd_per_instance_hour","amountUsd":28.8,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole gcp nvidia-a100 x8 instance (8 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 8. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-h100-x1-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-h100 x1","unit":"usd_per_gpu_hour","amountUsd":10,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Single-GPU (x1) instance: the instance-hour rate is the GPU-hour rate. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-h100-x2-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-h100 x2","unit":"usd_per_instance_hour","amountUsd":20,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole gcp nvidia-h100 x2 instance (2 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 2. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-h100-x4-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-h100 x4","unit":"usd_per_instance_hour","amountUsd":40,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole gcp nvidia-h100 x4 instance (4 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 4. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-nvidia-h100-x8-usd-per-gpu-hour","providerId":"huggingface-inference","sku":"gcp nvidia-h100 x8","unit":"usd_per_instance_hour","amountUsd":80,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_instance_hour","priceSortEligible":false,"qualifier":"Dedicated Inference Endpoints hourly rate for the whole gcp nvidia-h100 x8 instance (8 GPUs): the GPU Instances table prints 'Hourly rate' per instance next to a separate 'GPUs' column. Instance-hour price, not a per-GPU rate, never divided by 8. Billed per minute. CPU instance table not copied. Deprecated Ice Lake rows omitted. Unit label corrected 2026-10-27 (v0.12.138) from usd_per_gpu_hour; amount unchanged, re-checked on the page 2026-10-27."},{"id":"huggingface-inference-aws-inf2-x1-usd-per-hour","providerId":"huggingface-inference","sku":"aws inf2 x1","unit":"usd_per_hour","amountUsd":0.75,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_hour","priceSortEligible":false,"qualifier":"Inferentia2 accelerator hour. Not a token price. Re-checked on the page 2026-10-27."},{"id":"huggingface-inference-gcp-tpu-v5e-1x1-usd-per-hour","providerId":"huggingface-inference","sku":"gcp tpu v5e 1x1","unit":"usd_per_hour","amountUsd":1.2,"currency":"USD","sourceUrl":"https://huggingface.co/docs/inference-endpoints/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_hour","priceSortEligible":false,"qualifier":"TPU v5e accelerator hour. Not a token price. Re-checked on the page 2026-10-27."}],"notesExcerpt":"Inference Providers (pay-as-you-go access to partner inference providers plus Hugging Face's own hf-inference provider) + dedicated Inference Endpoints ('Pay for what you use, per minute' per https://endpoints.huggingface.co, fetched 2026-10-25; instance rates are the price rows:…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://endpoints.huggingface.co","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=open-model-inference","human":"/providers/huggingface-inference","compare":"/compare/predibase-vs-huggingface-inference"},{"id":"lightning-ai","slug":"lightning-ai","name":"Lightning AI","tagline":"Use when the team already lives in Lightning/PyTorch notebooks. Together/Unsloth remain Depot finetune…","website":"https://lightning.ai","status":"active","overall":7.93,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-09-14","deltaOverallVsSubject":0.04,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["finetune","lora-serving-distillation"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"unavailable","normalizationReason":"no_sourced_price","shape":"prose_notes_only","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[],"notesExcerpt":"As of 2026-09-14 (lightning.ai/pricing): Studio/cloud GPU hours on a public card — H100 New 80GB ~$4.50/hr on-demand (interruptible lower, ~$3.82–$4.58 class); T4/L4/A100 families also listed. Free Studio + credits to start. Team/seat SKUs (Pro/Teams) sit beside GPU-hour billing …","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://lightning.ai","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"No sourced price row for this provider. pricingNotes stay prose. See research/gaps.md."},"decideHint":"/api/decide?jtbd=finetune","human":"/providers/lightning-ai","compare":"/compare/predibase-vs-lightning-ai"},{"id":"modal","slug":"modal","name":"Modal","tagline":"Depot darling for Python agent backends and bursty GPU jobs. If you think in functions not VMs, start here.","website":"https://modal.com","status":"active","overall":8.44,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-10-19","deltaOverallVsSubject":0.55,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["finetune"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"unit_mismatch","normalizationReason":"unit_mismatch","shape":"sourced_rows","filterable":false,"priceSortEligible":false,"priceSortKeyUsdPerMillionInputTokens":null,"rows":[{"id":"modal-nvidia-b300-usd-per-gpu-second","providerId":"modal","sku":"Nvidia B300","unit":"usd_per_gpu_second","amountUsd":0.001972,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-b200-usd-per-gpu-second","providerId":"modal","sku":"Nvidia B200","unit":"usd_per_gpu_second","amountUsd":0.001736,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-h200-sxm-usd-per-gpu-second","providerId":"modal","sku":"Nvidia H200 SXM","unit":"usd_per_gpu_second","amountUsd":0.001261,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-h100-sxm5-usd-per-gpu-second","providerId":"modal","sku":"Nvidia H100 SXM5","unit":"usd_per_gpu_second","amountUsd":0.001097,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-rtx-pro-6000-usd-per-gpu-second","providerId":"modal","sku":"Nvidia RTX PRO 6000","unit":"usd_per_gpu_second","amountUsd":0.000842,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-a100-80gb-usd-per-gpu-second","providerId":"modal","sku":"Nvidia A100 80GB","unit":"usd_per_gpu_second","amountUsd":0.000694,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-a100-40gb-usd-per-gpu-second","providerId":"modal","sku":"Nvidia A100 40GB","unit":"usd_per_gpu_second","amountUsd":0.000583,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-l40s-usd-per-gpu-second","providerId":"modal","sku":"Nvidia L40S","unit":"usd_per_gpu_second","amountUsd":0.000542,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-a10-usd-per-gpu-second","providerId":"modal","sku":"Nvidia A10","unit":"usd_per_gpu_second","amountUsd":0.000306,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-l4-usd-per-gpu-second","providerId":"modal","sku":"Nvidia L4","unit":"usd_per_gpu_second","amountUsd":0.000222,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-nvidia-t4-usd-per-gpu-second","providerId":"modal","sku":"Nvidia T4","unit":"usd_per_gpu_second","amountUsd":0.000164,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gpu_second","priceSortEligible":false,"qualifier":"Per-second rate shown with the per-second toggle. Not multiplied into an hour. Reconfirmed 2026-10-27 (v0.12.140): page also says 'Region selection 1.15 - 1.75x base prices' and 'Non-preemptible execution 3x base prices' (not stored as separate rows)."},{"id":"modal-cpu-physical-core-usd-per-core-second","providerId":"modal","sku":"CPU physical core","unit":"usd_per_core_second","amountUsd":0.0000131,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_core_second","priceSortEligible":false,"qualifier":"Physical core (2 vCPU). Minimum 0.125 cores."},{"id":"modal-memory-usd-per-gib-second","providerId":"modal","sku":"Memory","unit":"usd_per_gib_second","amountUsd":0.00000222,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gib_second","priceSortEligible":false,"qualifier":"Container memory."},{"id":"modal-sandbox-cpu-usd-per-core-second","providerId":"modal","sku":"Sandbox CPU","unit":"usd_per_core_second","amountUsd":0.00003942,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_core_second","priceSortEligible":false,"qualifier":"Modal Sandbox rate (page: 'Modal Sandbox pricing', 'CPU (non-preemptible)'; 'Sandboxes are billed at non-preemptible rates of 3x list price'), separate from the default CPU rate."},{"id":"modal-sandbox-memory-usd-per-gib-second","providerId":"modal","sku":"Sandbox memory","unit":"usd_per_gib_second","amountUsd":0.00000667,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gib_second","priceSortEligible":false,"qualifier":"Sandbox memory (page: 'Memory (non-preemptible)' under 'Modal Sandbox pricing')."},{"id":"modal-volumes-usd-per-gib-month","providerId":"modal","sku":"Volumes","unit":"usd_per_gib_month","amountUsd":0.09,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gib_month","priceSortEligible":false,"qualifier":"Includes 1 TiB/mo free, not folded into this rate."},{"id":"modal-network-egress-usd-per-gib","providerId":"modal","sku":"Network egress","unit":"usd_per_gib","amountUsd":0.04,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_gib","priceSortEligible":false,"qualifier":"See plan for included usage."},{"id":"modal-team-plan-usd-per-month","providerId":"modal","sku":"Team plan","unit":"usd_per_month","amountUsd":250,"currency":"USD","sourceUrl":"https://modal.com/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_month","priceSortEligible":false,"qualifier":"Plus compute. $100/mo credits not subtracted."}],"notesExcerpt":"As of 2026-10-24 (modal.com/pricing, fetched 2026-10-24): Python-native serverless GPU/CPU billed per second of compute ('You never pay for idle resources'). GPU list rates per second: H100 SXM5 '$0.001097', H200 SXM '$0.001261', B200 '$0.001736', A100 80 GB '$0.000694', L40S '$0…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-10-19","scoreAsOf":"2026-10-19","website":"https://modal.com","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=finetune","human":"/providers/modal","compare":"/compare/predibase-vs-modal"},{"id":"friendli","slug":"friendli","name":"FriendliAI","tagline":"Open-model production peer when latency/tool-calling matter. Fireworks remains depot open-model default…","website":"https://friendli.ai","status":"active","overall":8.03,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-10-01","deltaOverallVsSubject":0.14,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["open-model-inference"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"ambiguous","normalizationReason":"input_output_split_not_a_single_rate","shape":"sourced_rows","filterable":false,"priceSortEligible":true,"priceSortKeyUsdPerMillionInputTokens":0.14,"rows":[{"id":"friendli-gpu-a100","providerId":"friendli","sku":"A100 80GB","unit":"usd_per_gpu_hour","amountUsd":4,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated on-demand; billed per second. Matches pricing-watch 2026-10-01 step-up."},{"id":"friendli-gpu-h100","providerId":"friendli","sku":"H100 80GB","unit":"usd_per_gpu_hour","amountUsd":5,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated on-demand; billed per second. Matches pricing-watch 2026-10-01 step-up."},{"id":"friendli-gpu-h200","providerId":"friendli","sku":"H200 141GB","unit":"usd_per_gpu_hour","amountUsd":7,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated on-demand; billed per second. Matches pricing-watch 2026-10-01 step-up."},{"id":"friendli-gpu-b200","providerId":"friendli","sku":"B200 180GB","unit":"usd_per_gpu_hour","amountUsd":9,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated on-demand; billed per second. Matches pricing-watch 2026-10-01 step-up."},{"id":"friendli-gpu-b300","providerId":"friendli","sku":"B300 288GB","unit":"usd_per_gpu_hour","amountUsd":12,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated on-demand; billed per second. Matches pricing-watch 2026-10-01 step-up."},{"id":"friendli-glm-53-flash-input","providerId":"friendli","sku":"GLM-5.3-Flash","unit":"usd_per_million_input_tokens","amountUsd":0.15,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.15,"normalizationReason":null,"priceSortEligible":true,"qualifier":"model API $/1M tokens"},{"id":"friendli-glm-53-flash-output","providerId":"friendli","sku":"GLM-5.3-Flash","unit":"usd_per_million_output_tokens","amountUsd":0.5,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.5,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-glm-53-flash-cached","providerId":"friendli","sku":"GLM-5.3-Flash","unit":"usd_per_million_cached_input_tokens","amountUsd":0.03,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.03,"normalizationReason":"cached_input_not_a_single_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-glm-52-input","providerId":"friendli","sku":"GLM-5.2","unit":"usd_per_million_input_tokens","amountUsd":1.4,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.4,"normalizationReason":null,"priceSortEligible":true,"qualifier":"model API $/1M tokens"},{"id":"friendli-glm-52-output","providerId":"friendli","sku":"GLM-5.2","unit":"usd_per_million_output_tokens","amountUsd":4.4,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":4.4,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-glm-52-cached","providerId":"friendli","sku":"GLM-5.2","unit":"usd_per_million_cached_input_tokens","amountUsd":0.26,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.26,"normalizationReason":"cached_input_not_a_single_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-glm-51-input","providerId":"friendli","sku":"GLM-5.1","unit":"usd_per_million_input_tokens","amountUsd":1.4,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.4,"normalizationReason":null,"priceSortEligible":true,"qualifier":"model API $/1M tokens"},{"id":"friendli-glm-51-output","providerId":"friendli","sku":"GLM-5.1","unit":"usd_per_million_output_tokens","amountUsd":4.4,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":4.4,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-glm-51-cached","providerId":"friendli","sku":"GLM-5.1","unit":"usd_per_million_cached_input_tokens","amountUsd":0.26,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.26,"normalizationReason":"cached_input_not_a_single_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-gemma-4-31b-it-input","providerId":"friendli","sku":"gemma-4-31B-it","unit":"usd_per_million_input_tokens","amountUsd":0.14,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.14,"normalizationReason":null,"priceSortEligible":true,"qualifier":"model API $/1M tokens"},{"id":"friendli-gemma-4-31b-it-output","providerId":"friendli","sku":"gemma-4-31B-it","unit":"usd_per_million_output_tokens","amountUsd":0.4,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.4,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-deepseek-v32-input","providerId":"friendli","sku":"DeepSeek-V3.2","unit":"usd_per_million_input_tokens","amountUsd":0.5,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.5,"normalizationReason":null,"priceSortEligible":true,"qualifier":"model API $/1M tokens"},{"id":"friendli-deepseek-v32-output","providerId":"friendli","sku":"DeepSeek-V3.2","unit":"usd_per_million_output_tokens","amountUsd":1.5,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.5,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-deepseek-v32-cached","providerId":"friendli","sku":"DeepSeek-V3.2","unit":"usd_per_million_cached_input_tokens","amountUsd":0.25,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.25,"normalizationReason":"cached_input_not_a_single_rate","priceSortEligible":false,"qualifier":null},{"id":"friendli-minimax-m25-input","providerId":"friendli","sku":"MiniMax-M2.5","unit":"usd_per_million_input_tokens","amountUsd":0.3,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.3,"normalizationReason":null,"priceSortEligible":false,"qualifier":"model API $/1M tokens","sourceStatus":"unverified","sourceStatusReason":"model_not_on_source_page: on 2026-10-25 the Pay per token table on https://friendli.ai/pricing lists GLM-5.3, GLM-5.3-Flash, GLM-5.2, GLM-5.1, gemma-4-31B-it and DeepSeek-V3.2 (plus whisper-large-v3 under Speech to text); MiniMax-M2.5 is no longer in the table (MiniMax appears only in a generic overview sentence without an amount). Kept for history, never ranked.","sourceStatusCheckedOn":"2026-10-25"},{"id":"friendli-minimax-m25-output","providerId":"friendli","sku":"MiniMax-M2.5","unit":"usd_per_million_output_tokens","amountUsd":1.2,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.2,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null,"sourceStatus":"unverified","sourceStatusReason":"model_not_on_source_page: on 2026-10-25 the Pay per token table on https://friendli.ai/pricing lists GLM-5.3, GLM-5.3-Flash, GLM-5.2, GLM-5.1, gemma-4-31B-it and DeepSeek-V3.2 (plus whisper-large-v3 under Speech to text); MiniMax-M2.5 is no longer in the table (MiniMax appears only in a generic overview sentence without an amount). Kept for history, never ranked.","sourceStatusCheckedOn":"2026-10-25"},{"id":"friendli-minimax-m25-cached","providerId":"friendli","sku":"MiniMax-M2.5","unit":"usd_per_million_cached_input_tokens","amountUsd":0.06,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.06,"normalizationReason":"cached_input_not_a_single_rate","priceSortEligible":false,"qualifier":null,"sourceStatus":"unverified","sourceStatusReason":"model_not_on_source_page: on 2026-10-25 the Pay per token table on https://friendli.ai/pricing lists GLM-5.3, GLM-5.3-Flash, GLM-5.2, GLM-5.1, gemma-4-31B-it and DeepSeek-V3.2 (plus whisper-large-v3 under Speech to text); MiniMax-M2.5 is no longer in the table (MiniMax appears only in a generic overview sentence without an amount). Kept for history, never ranked.","sourceStatusCheckedOn":"2026-10-25"},{"id":"friendli-glm-53-ambiguous","providerId":"friendli","sku":"GLM-5.3","unit":"usd_per_million_input_tokens","amountUsd":null,"currency":"USD","sourceUrl":"https://friendli.ai/pricing","asOf":"2026-10-03","normalizationStatus":"ambiguous","normalizedUsdPerMillionTokens":null,"normalizationReason":"promo_and_list_price_adjacent","priceSortEligible":false,"qualifier":"Page shows 10% OFF and both $1.26 and $1.40 input (cached $0.234/$0.26, output $3.96/$4.40). No single figure selected."}],"notesExcerpt":"As of 2026-10-01 (friendli.ai/pricing live): Dedicated Endpoints on-demand step-up **is live** — A100 **$4.0**/hr, H100 **$5.0**/hr, H200 **$7.0**/hr, B200 **$9.0**/hr, B300 $12.0/hr (was through-Sep-30: A100 $2.9, H100 $3.9, H200 $4.5, B200 $8.9, B300 $12.0). Billed per second; …","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-10-01","scoreAsOf":"2026-10-01","website":"https://friendli.ai","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=open-model-inference","human":"/providers/friendli","compare":"/compare/predibase-vs-friendli"},{"id":"groq","slug":"groq","name":"Groq","tagline":"Use when latency is the product. Do not build your whole company on one Groq model SKU — they rotate.","website":"https://groq.com","status":"active","overall":7.95,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-09-14","deltaOverallVsSubject":0.06,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["open-model-inference"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"ambiguous","normalizationReason":"input_output_split_not_a_single_rate","shape":"sourced_rows","filterable":false,"priceSortEligible":true,"priceSortKeyUsdPerMillionInputTokens":0.075,"rows":[{"id":"groq-gpt-oss-120b-input","providerId":"groq","sku":"openai/gpt-oss-120b","unit":"usd_per_million_input_tokens","amountUsd":0.15,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.15,"normalizationReason":null,"priceSortEligible":true,"qualifier":"column header PRICE PER 1M TOKENS. Llama 3.1 8B and Llama 3.3 70B on the same page say Contact Sales and were omitted."},{"id":"groq-gpt-oss-120b-output","providerId":"groq","sku":"openai/gpt-oss-120b","unit":"usd_per_million_output_tokens","amountUsd":0.6,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.6,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"groq-gpt-oss-20b-input","providerId":"groq","sku":"openai/gpt-oss-20b","unit":"usd_per_million_input_tokens","amountUsd":0.075,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.075,"normalizationReason":null,"priceSortEligible":true,"qualifier":"column header PRICE PER 1M TOKENS. Llama 3.1 8B and Llama 3.3 70B on the same page say Contact Sales and were omitted."},{"id":"groq-gpt-oss-20b-output","providerId":"groq","sku":"openai/gpt-oss-20b","unit":"usd_per_million_output_tokens","amountUsd":0.3,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.3,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"groq-llama-prompt-guard-2-22m-input","providerId":"groq","sku":"meta-llama/llama-prompt-guard-2-22m","unit":"usd_per_million_input_tokens","amountUsd":0.03,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.03,"normalizationReason":"classifier_sku_excluded_from_provider_sort","priceSortEligible":false,"qualifier":"column header PRICE PER 1M TOKENS. Llama 3.1 8B and Llama 3.3 70B on the same page say Contact Sales and were omitted."},{"id":"groq-llama-prompt-guard-2-22m-output","providerId":"groq","sku":"meta-llama/llama-prompt-guard-2-22m","unit":"usd_per_million_output_tokens","amountUsd":0.03,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.03,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"groq-llama-prompt-guard-2-86m-input","providerId":"groq","sku":"meta-llama/llama-prompt-guard-2-86m","unit":"usd_per_million_input_tokens","amountUsd":0.04,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.04,"normalizationReason":"classifier_sku_excluded_from_provider_sort","priceSortEligible":false,"qualifier":"column header PRICE PER 1M TOKENS. Llama 3.1 8B and Llama 3.3 70B on the same page say Contact Sales and were omitted."},{"id":"groq-llama-prompt-guard-2-86m-output","providerId":"groq","sku":"meta-llama/llama-prompt-guard-2-86m","unit":"usd_per_million_output_tokens","amountUsd":0.04,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.04,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"groq-qwen3.8-27b-input","providerId":"groq","sku":"qwen/qwen3.8-27b","unit":"usd_per_million_input_tokens","amountUsd":0.8,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.8,"normalizationReason":null,"priceSortEligible":true,"qualifier":"column header PRICE PER 1M TOKENS. Llama 3.1 8B and Llama 3.3 70B on the same page say Contact Sales and were omitted."},{"id":"groq-qwen3.8-27b-output","providerId":"groq","sku":"qwen/qwen3.8-27b","unit":"usd_per_million_output_tokens","amountUsd":4,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":4,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"groq-whisper-v3","providerId":"groq","sku":"whisper-large-v3","unit":"usd_per_hour","amountUsd":0.111,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_hour","priceSortEligible":false,"qualifier":null},{"id":"groq-whisper-v3-turbo","providerId":"groq","sku":"whisper-large-v3-turbo","unit":"usd_per_hour","amountUsd":0.04,"currency":"USD","sourceUrl":"https://console.groq.com/docs/models","asOf":"2026-10-03","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_hour","priceSortEligible":false,"qualifier":null}],"notesExcerpt":"Per-token with free tier; LPU inference; narrow production model set (Llama/Qwen/GPT-OSS etc.); batch discounts. Llama Guard 4 12B (model id meta-llama/llama-guard-4-12b) is still documented at console.groq.com/docs/model/meta-llama/llama-guard-4-12b as an open safety classifier;…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://groq.com","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=open-model-inference","human":"/providers/groq","compare":"/compare/predibase-vs-groq"},{"id":"deepinfra","slug":"deepinfra","name":"DeepInfra","tagline":"Budget open-model workhorse and one of the cheapest large-catalog hosts. Great for evals and high-volume…","website":"https://deepinfra.com","status":"active","overall":7.95,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-09-14","deltaOverallVsSubject":0.06,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["open-model-inference"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"ambiguous","normalizationReason":"input_output_split_not_a_single_rate","shape":"sourced_rows","filterable":false,"priceSortEligible":true,"priceSortKeyUsdPerMillionInputTokens":0.1,"rows":[{"id":"deepinfra-llama-33-70b-turbo-input","providerId":"deepinfra","sku":"Llama-3.3-70B-Instruct-Turbo","unit":"usd_per_million_input_tokens","amountUsd":0.1,"currency":"USD","sourceUrl":"https://deepinfra.com/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.1,"normalizationReason":null,"priceSortEligible":true,"qualifier":"128k context row"},{"id":"deepinfra-llama-33-70b-turbo-output","providerId":"deepinfra","sku":"Llama-3.3-70B-Instruct-Turbo","unit":"usd_per_million_output_tokens","amountUsd":0.32,"currency":"USD","sourceUrl":"https://deepinfra.com/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.32,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":null},{"id":"deepinfra-bge-base-en","providerId":"deepinfra","sku":"bge-base-en-v1.5","unit":"usd_per_million_input_tokens","amountUsd":0.005,"currency":"USD","sourceUrl":"https://deepinfra.com/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.005,"normalizationReason":"embedding_sku_excluded_from_provider_sort","priceSortEligible":false,"qualifier":"embeddings; input only"},{"id":"deepinfra-gpu-a100","providerId":"deepinfra","sku":"A100","unit":"usd_per_gpu_hour","amountUsd":1.49,"currency":"USD","sourceUrl":"https://deepinfra.com/pricing","asOf":"2026-10-20","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated GPU-hour"},{"id":"deepinfra-gpu-h100","providerId":"deepinfra","sku":"H100","unit":"usd_per_gpu_hour","amountUsd":2.9,"currency":"USD","sourceUrl":"https://deepinfra.com/pricing","asOf":"2026-10-20","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated GPU-hour"},{"id":"deepinfra-gpu-h200","providerId":"deepinfra","sku":"H200","unit":"usd_per_gpu_hour","amountUsd":3.49,"currency":"USD","sourceUrl":"https://deepinfra.com/pricing","asOf":"2026-10-20","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated GPU-hour"},{"id":"deepinfra-gpu-b200","providerId":"deepinfra","sku":"B200","unit":"usd_per_gpu_hour","amountUsd":4.89,"currency":"USD","sourceUrl":"https://deepinfra.com/pricing","asOf":"2026-10-20","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated GPU-hour"},{"id":"deepinfra-gpu-b300","providerId":"deepinfra","sku":"B300","unit":"usd_per_gpu_hour","amountUsd":5.89,"currency":"USD","sourceUrl":"https://deepinfra.com/pricing","asOf":"2026-10-20","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_gpu_hour","priceSortEligible":false,"qualifier":"dedicated GPU-hour"}],"notesExcerpt":"As of 2026-09-14: Broad OpenAI-compatible catalog with model-specific token rates (e.g. Llama-3.3-70B Turbo $0.10/$0.32 per 1M in/out; DeepSeek-V4-Flash input $0.09, cached input $0.018 and output $0.18 per 1M (deepinfra.com/pricing as of 2026-10-21; not stored as rows); embeddin…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://deepinfra.com","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=open-model-inference","human":"/providers/deepinfra","compare":"/compare/predibase-vs-deepinfra"},{"id":"chutes","slug":"chutes","name":"Chutes","tagline":"Budget open-model overflow with a now-pinned public TEE matrix. Depot open-model production pick stays…","website":"https://chutes.ai","status":"active","overall":7.29,"scoreKind":"curated_estimate","confidence":"high","scoreAsOf":"2026-09-14","deltaOverallVsSubject":-0.6,"roles":["same_jtbd_runner"],"sharedJtbdSlugs":["open-model-inference"],"pricing":{"normalizedUsdPerMillionTokens":null,"normalizationStatus":"ambiguous","normalizationReason":"input_output_split_not_a_single_rate","shape":"sourced_rows","filterable":false,"priceSortEligible":true,"priceSortKeyUsdPerMillionInputTokens":0.039,"rows":[{"id":"chutes-mistral-nemo-instruct-2407-unsloth-mistral-nemo-instruct-2407-tee-in","providerId":"chutes","sku":"Mistral-Nemo-Instruct-2407 (unsloth/Mistral-Nemo-Instruct-2407-TEE)","unit":"usd_per_million_input_tokens","amountUsd":0.0245,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.0245,"normalizationReason":null,"priceSortEligible":false,"qualifier":"Public TEE inference, USD per 1M tokens. Workload estimate on the same card was not used. TAO column not used. Not on chutes.ai/pricing 2026-10-27 (v0.12.141): the Model pricing table no longer lists this model; amount kept from 2026-10-03, not reconfirmed (asOf unchanged).","sourceStatus":"unverified","sourceStatusReason":"model_not_on_source_page: on 2026-10-27 the Model pricing table lists gemma-4-31B-turbo, Qwen3.8-27B, Qwen3.6-27B, DeepSeek-V4-Flash-0731, Kimi K2.6, Qwen 3.5, DeepSeek-V3.2, GLM-5.1, GLM-5.2 and Kimi-K3 (re-checked twice, also absent in the 2026-10-27 06:06 ET fetch); Mistral-Nemo-Instruct-2407 is no longer on https://chutes.ai/pricing (no occurrence of the name anywhere in the page text). Kept for history, never ranked.","sourceStatusCheckedOn":"2026-10-27"},{"id":"chutes-mistral-nemo-instruct-2407-unsloth-mistral-nemo-instruct-2407-tee-out","providerId":"chutes","sku":"Mistral-Nemo-Instruct-2407 (unsloth/Mistral-Nemo-Instruct-2407-TEE)","unit":"usd_per_million_output_tokens","amountUsd":0.0978,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.0978,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":"Public TEE inference output per 1M tokens. Not on chutes.ai/pricing 2026-10-27 (v0.12.141): the Model pricing table no longer lists this model; amount kept from 2026-10-03, not reconfirmed (asOf unchanged).","sourceStatus":"unverified","sourceStatusReason":"model_not_on_source_page: on 2026-10-27 the Model pricing table lists gemma-4-31B-turbo, Qwen3.8-27B, Qwen3.6-27B, DeepSeek-V4-Flash-0731, Kimi K2.6, Qwen 3.5, DeepSeek-V3.2, GLM-5.1, GLM-5.2 and Kimi-K3 (re-checked twice, also absent in the 2026-10-27 06:06 ET fetch); Mistral-Nemo-Instruct-2407 is no longer on https://chutes.ai/pricing (no occurrence of the name anywhere in the page text). Kept for history, never ranked.","sourceStatusCheckedOn":"2026-10-27"},{"id":"chutes-nemotron-3-nano-omni-30b-nemotron-3-nano-omni-30b-tee-in","providerId":"chutes","sku":"Nemotron-3-Nano-Omni-30B (Nemotron-3-Nano-Omni-30B-TEE)","unit":"usd_per_million_input_tokens","amountUsd":0.0245,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.0245,"normalizationReason":null,"priceSortEligible":false,"qualifier":"Public TEE inference, USD per 1M tokens. Workload estimate on the same card was not used. TAO column not used. Not on chutes.ai/pricing 2026-10-27 (v0.12.141): the Model pricing table no longer lists this model; amount kept from 2026-10-03, not reconfirmed (asOf unchanged).","sourceStatus":"unverified","sourceStatusReason":"model_not_on_source_page: on 2026-10-27 the Model pricing table lists gemma-4-31B-turbo, Qwen3.8-27B, Qwen3.6-27B, DeepSeek-V4-Flash-0731, Kimi K2.6, Qwen 3.5, DeepSeek-V3.2, GLM-5.1, GLM-5.2 and Kimi-K3 (re-checked twice, also absent in the 2026-10-27 06:06 ET fetch); Nemotron-3-Nano-Omni-30B is no longer on https://chutes.ai/pricing (no occurrence of the name anywhere in the page text). Kept for history, never ranked.","sourceStatusCheckedOn":"2026-10-27"},{"id":"chutes-nemotron-3-nano-omni-30b-nemotron-3-nano-omni-30b-tee-out","providerId":"chutes","sku":"Nemotron-3-Nano-Omni-30B (Nemotron-3-Nano-Omni-30B-TEE)","unit":"usd_per_million_output_tokens","amountUsd":0.0978,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.0978,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":"Public TEE inference output per 1M tokens. Not on chutes.ai/pricing 2026-10-27 (v0.12.141): the Model pricing table no longer lists this model; amount kept from 2026-10-03, not reconfirmed (asOf unchanged).","sourceStatus":"unverified","sourceStatusReason":"model_not_on_source_page: on 2026-10-27 the Model pricing table lists gemma-4-31B-turbo, Qwen3.8-27B, Qwen3.6-27B, DeepSeek-V4-Flash-0731, Kimi K2.6, Qwen 3.5, DeepSeek-V3.2, GLM-5.1, GLM-5.2 and Kimi-K3 (re-checked twice, also absent in the 2026-10-27 06:06 ET fetch); Nemotron-3-Nano-Omni-30B is no longer on https://chutes.ai/pricing (no occurrence of the name anywhere in the page text). Kept for history, never ranked.","sourceStatusCheckedOn":"2026-10-27"},{"id":"chutes-qwen3-32b-qwen-qwen3-32b-tee-in","providerId":"chutes","sku":"Qwen3-32B (Qwen/Qwen3-32B-TEE)","unit":"usd_per_million_input_tokens","amountUsd":0.104,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.104,"normalizationReason":null,"priceSortEligible":false,"qualifier":"Public TEE inference, USD per 1M tokens. Workload estimate on the same card was not used. TAO column not used. Not on chutes.ai/pricing 2026-10-27 (v0.12.141): the Model pricing table no longer lists this model; amount kept from 2026-10-03, not reconfirmed (asOf unchanged).","sourceStatus":"unverified","sourceStatusReason":"model_not_on_source_page: on 2026-10-27 the Model pricing table lists gemma-4-31B-turbo, Qwen3.8-27B, Qwen3.6-27B, DeepSeek-V4-Flash-0731, Kimi K2.6, Qwen 3.5, DeepSeek-V3.2, GLM-5.1, GLM-5.2 and Kimi-K3 (re-checked twice, also absent in the 2026-10-27 06:06 ET fetch); Qwen3-32B is no longer on https://chutes.ai/pricing (no occurrence of the name anywhere in the page text). Kept for history, never ranked.","sourceStatusCheckedOn":"2026-10-27"},{"id":"chutes-qwen3-32b-qwen-qwen3-32b-tee-out","providerId":"chutes","sku":"Qwen3-32B (Qwen/Qwen3-32B-TEE)","unit":"usd_per_million_output_tokens","amountUsd":0.416,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.416,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":"Public TEE inference output per 1M tokens. Not on chutes.ai/pricing 2026-10-27 (v0.12.141): the Model pricing table no longer lists this model; amount kept from 2026-10-03, not reconfirmed (asOf unchanged).","sourceStatus":"unverified","sourceStatusReason":"model_not_on_source_page: on 2026-10-27 the Model pricing table lists gemma-4-31B-turbo, Qwen3.8-27B, Qwen3.6-27B, DeepSeek-V4-Flash-0731, Kimi K2.6, Qwen 3.5, DeepSeek-V3.2, GLM-5.1, GLM-5.2 and Kimi-K3 (re-checked twice, also absent in the 2026-10-27 06:06 ET fetch); Qwen3-32B is no longer on https://chutes.ai/pricing (no occurrence of the name anywhere in the page text). Kept for history, never ranked.","sourceStatusCheckedOn":"2026-10-27"},{"id":"chutes-gemma-4-31b-turbo-google-gemma-4-31b-turbo-tee-in","providerId":"chutes","sku":"gemma-4-31B-turbo (google/gemma-4-31B-turbo-TEE)","unit":"usd_per_million_input_tokens","amountUsd":0.12,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.12,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Public TEE inference, USD per 1M tokens. Workload estimate on the same card was not used. TAO column not used. Reconfirmed 2026-10-27 (v0.12.141). The page says per-model rates are 'pulled live from our pricing API'; cached-input rate on the same card not stored."},{"id":"chutes-gemma-4-31b-turbo-google-gemma-4-31b-turbo-tee-out","providerId":"chutes","sku":"gemma-4-31B-turbo (google/gemma-4-31B-turbo-TEE)","unit":"usd_per_million_output_tokens","amountUsd":0.37,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.37,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":"Public TEE inference output per 1M tokens. Reconfirmed 2026-10-27 (v0.12.141). The page says per-model rates are 'pulled live from our pricing API'; cached-input rate on the same card not stored."},{"id":"chutes-qwen3-235b-a22b-thinking-2507-qwen-qwen3-235b-a22b-thinking-2507-tee-in","providerId":"chutes","sku":"Qwen3-235B-A22B-Thinking-2507 (Qwen/Qwen3-235B-A22B-Thinking-2507-TEE)","unit":"usd_per_million_input_tokens","amountUsd":0.2989,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.2989,"normalizationReason":null,"priceSortEligible":false,"qualifier":"Public TEE inference, USD per 1M tokens. Workload estimate on the same card was not used. TAO column not used. Not on chutes.ai/pricing 2026-10-27 (v0.12.141): the Model pricing table no longer lists this model; amount kept from 2026-10-03, not reconfirmed (asOf unchanged).","sourceStatus":"unverified","sourceStatusReason":"model_not_on_source_page: on 2026-10-27 the Model pricing table lists gemma-4-31B-turbo, Qwen3.8-27B, Qwen3.6-27B, DeepSeek-V4-Flash-0731, Kimi K2.6, Qwen 3.5, DeepSeek-V3.2, GLM-5.1, GLM-5.2 and Kimi-K3 (re-checked twice, also absent in the 2026-10-27 06:06 ET fetch); Qwen3-235B-A22B-Thinking-2507 is no longer on https://chutes.ai/pricing (no occurrence of the name anywhere in the page text). Kept for history, never ranked.","sourceStatusCheckedOn":"2026-10-27"},{"id":"chutes-qwen3-235b-a22b-thinking-2507-qwen-qwen3-235b-a22b-thinking-2507-tee-out","providerId":"chutes","sku":"Qwen3-235B-A22B-Thinking-2507 (Qwen/Qwen3-235B-A22B-Thinking-2507-TEE)","unit":"usd_per_million_output_tokens","amountUsd":1.1957,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-03","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.1957,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":"Public TEE inference output per 1M tokens. Not on chutes.ai/pricing 2026-10-27 (v0.12.141): the Model pricing table no longer lists this model; amount kept from 2026-10-03, not reconfirmed (asOf unchanged).","sourceStatus":"unverified","sourceStatusReason":"model_not_on_source_page: on 2026-10-27 the Model pricing table lists gemma-4-31B-turbo, Qwen3.8-27B, Qwen3.6-27B, DeepSeek-V4-Flash-0731, Kimi K2.6, Qwen 3.5, DeepSeek-V3.2, GLM-5.1, GLM-5.2 and Kimi-K3 (re-checked twice, also absent in the 2026-10-27 06:06 ET fetch); Qwen3-235B-A22B-Thinking-2507 is no longer on https://chutes.ai/pricing (no occurrence of the name anywhere in the page text). Kept for history, never ranked.","sourceStatusCheckedOn":"2026-10-27"},{"id":"chutes-qwen3-8-27b-qwen-qwen3-8-27b-tee-in","providerId":"chutes","sku":"Qwen3.8-27B (Qwen/Qwen3.8-27B-TEE)","unit":"usd_per_million_input_tokens","amountUsd":0.039,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.039,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Public TEE inference, USD per 1M tokens. Workload estimate on the same card was not used. TAO column not used. Reconfirmed 2026-10-27 (v0.12.141). The page says per-model rates are 'pulled live from our pricing API'; cached-input rate on the same card not stored."},{"id":"chutes-qwen3-8-27b-qwen-qwen3-8-27b-tee-out","providerId":"chutes","sku":"Qwen3.8-27B (Qwen/Qwen3.8-27B-TEE)","unit":"usd_per_million_output_tokens","amountUsd":1.25,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.25,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":"Public TEE inference output per 1M tokens. Reconfirmed 2026-10-27 (v0.12.141). The page says per-model rates are 'pulled live from our pricing API'; cached-input rate on the same card not stored."},{"id":"chutes-qwen3-6-27b-qwen-qwen3-6-27b-tee-in","providerId":"chutes","sku":"Qwen3.6-27B (Qwen/Qwen3.6-27B-TEE)","unit":"usd_per_million_input_tokens","amountUsd":0.25,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.25,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Public TEE inference, USD per 1M tokens. Workload estimate on the same card was not used. TAO column not used. Reconfirmed 2026-10-27 (v0.12.141). The page says per-model rates are 'pulled live from our pricing API'; cached-input rate on the same card not stored."},{"id":"chutes-qwen3-6-27b-qwen-qwen3-6-27b-tee-out","providerId":"chutes","sku":"Qwen3.6-27B (Qwen/Qwen3.6-27B-TEE)","unit":"usd_per_million_output_tokens","amountUsd":2,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":2,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":"Public TEE inference output per 1M tokens. Reconfirmed 2026-10-27 (v0.12.141). The page says per-model rates are 'pulled live from our pricing API'; cached-input rate on the same card not stored."},{"id":"chutes-deepseek-v4-flash-0731-deepseek-ai-deepseek-v4-flash-0731-tee-in","providerId":"chutes","sku":"DeepSeek-V4-Flash-0731 (deepseek-ai/DeepSeek-V4-Flash-0731-TEE)","unit":"usd_per_million_input_tokens","amountUsd":0.44,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.44,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Public TEE inference, USD per 1M tokens. Workload estimate on the same card was not used. TAO column not used. Reconfirmed 2026-10-27 (v0.12.141). The page says per-model rates are 'pulled live from our pricing API'; cached-input rate on the same card not stored."},{"id":"chutes-deepseek-v4-flash-0731-deepseek-ai-deepseek-v4-flash-0731-tee-out","providerId":"chutes","sku":"DeepSeek-V4-Flash-0731 (deepseek-ai/DeepSeek-V4-Flash-0731-TEE)","unit":"usd_per_million_output_tokens","amountUsd":1.32,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.32,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":"Public TEE inference output per 1M tokens. Reconfirmed 2026-10-27 (v0.12.141). The page says per-model rates are 'pulled live from our pricing API'; cached-input rate on the same card not stored."},{"id":"chutes-qwen-3-5-qwen-qwen3-5-397b-a17b-tee-in","providerId":"chutes","sku":"Qwen 3.5 (Qwen/Qwen3.5-397B-A17B-TEE)","unit":"usd_per_million_input_tokens","amountUsd":0.45,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.45,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Public TEE inference, USD per 1M tokens. Workload estimate on the same card was not used. TAO column not used. Reconfirmed 2026-10-27 (v0.12.141). The page says per-model rates are 'pulled live from our pricing API'; cached-input rate on the same card not stored."},{"id":"chutes-qwen-3-5-qwen-qwen3-5-397b-a17b-tee-out","providerId":"chutes","sku":"Qwen 3.5 (Qwen/Qwen3.5-397B-A17B-TEE)","unit":"usd_per_million_output_tokens","amountUsd":3,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":3,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":"Public TEE inference output per 1M tokens. Reconfirmed 2026-10-27 (v0.12.141). The page says per-model rates are 'pulled live from our pricing API'; cached-input rate on the same card not stored."},{"id":"chutes-kimi-k2-6-moonshotai-kimi-k2-6-tee-in","providerId":"chutes","sku":"Kimi K2.6 (moonshotai/Kimi-K2.6-TEE)","unit":"usd_per_million_input_tokens","amountUsd":0.39,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.39,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Public TEE inference, USD per 1M tokens. Workload estimate on the same card was not used. TAO column not used. Re-priced 2026-10-27 (v0.12.141): 0.45 -> 0.39 USD per 1M input tokens from the page's Model pricing table. The page says per-model rates are 'pulled live from our pricing API', so they can move; cached-input rate on the same card not stored."},{"id":"chutes-kimi-k2-6-moonshotai-kimi-k2-6-tee-out","providerId":"chutes","sku":"Kimi K2.6 (moonshotai/Kimi-K2.6-TEE)","unit":"usd_per_million_output_tokens","amountUsd":1.8,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.8,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":"Public TEE inference output per 1M tokens. Re-priced 2026-10-27 (v0.12.141): 1.95 -> 1.8 USD per 1M output tokens from the page's Model pricing table. The page says per-model rates are 'pulled live from our pricing API', so they can move; cached-input rate on the same card not stored."},{"id":"chutes-deepseek-v3-2-deepseek-ai-deepseek-v3-2-tee-in","providerId":"chutes","sku":"DeepSeek-V3.2 (deepseek-ai/DeepSeek-V3.2-TEE)","unit":"usd_per_million_input_tokens","amountUsd":1,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Public TEE inference, USD per 1M tokens. Workload estimate on the same card was not used. TAO column not used. Reconfirmed 2026-10-27 (v0.12.141). The page says per-model rates are 'pulled live from our pricing API'; cached-input rate on the same card not stored."},{"id":"chutes-deepseek-v3-2-deepseek-ai-deepseek-v3-2-tee-out","providerId":"chutes","sku":"DeepSeek-V3.2 (deepseek-ai/DeepSeek-V3.2-TEE)","unit":"usd_per_million_output_tokens","amountUsd":1,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":"Public TEE inference output per 1M tokens. Reconfirmed 2026-10-27 (v0.12.141). The page says per-model rates are 'pulled live from our pricing API'; cached-input rate on the same card not stored."},{"id":"chutes-glm-5-1-zai-org-glm-5-1-tee-in","providerId":"chutes","sku":"GLM-5.1 (zai-org/GLM-5.1-TEE)","unit":"usd_per_million_input_tokens","amountUsd":0.9,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":0.9,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Public TEE inference, USD per 1M tokens. Workload estimate on the same card was not used. TAO column not used. Re-priced 2026-10-27 (v0.12.141): 0.98 -> 0.9 USD per 1M input tokens from the page's Model pricing table. The page says per-model rates are 'pulled live from our pricing API', so they can move; cached-input rate on the same card not stored."},{"id":"chutes-glm-5-1-zai-org-glm-5-1-tee-out","providerId":"chutes","sku":"GLM-5.1 (zai-org/GLM-5.1-TEE)","unit":"usd_per_million_output_tokens","amountUsd":2.9,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":2.9,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":"Public TEE inference output per 1M tokens. Re-priced 2026-10-27 (v0.12.141): 3.08 -> 2.9 USD per 1M output tokens from the page's Model pricing table. The page says per-model rates are 'pulled live from our pricing API', so they can move; cached-input rate on the same card not stored."},{"id":"chutes-glm-5-2-zai-org-glm-5-2-tee-in","providerId":"chutes","sku":"GLM-5.2 (zai-org/GLM-5.2-TEE)","unit":"usd_per_million_input_tokens","amountUsd":1.25,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.25,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Public TEE inference, USD per 1M tokens. Workload estimate on the same card was not used. TAO column not used. Reconfirmed 2026-10-27 (v0.12.141). The page says per-model rates are 'pulled live from our pricing API'; cached-input rate on the same card not stored."},{"id":"chutes-glm-5-2-zai-org-glm-5-2-tee-out","providerId":"chutes","sku":"GLM-5.2 (zai-org/GLM-5.2-TEE)","unit":"usd_per_million_output_tokens","amountUsd":3.95,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":3.95,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":"Public TEE inference output per 1M tokens. Reconfirmed 2026-10-27 (v0.12.141). The page says per-model rates are 'pulled live from our pricing API'; cached-input rate on the same card not stored."},{"id":"chutes-kimi-k3-moonshotai-kimi-k3-tee-in","providerId":"chutes","sku":"Kimi-K3 (moonshotai/Kimi-K3-TEE)","unit":"usd_per_million_input_tokens","amountUsd":1.85,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":1.85,"normalizationReason":null,"priceSortEligible":true,"qualifier":"Public TEE inference, USD per 1M tokens. Workload estimate on the same card was not used. TAO column not used. Reconfirmed 2026-10-27 (v0.12.141). The page says per-model rates are 'pulled live from our pricing API'; cached-input rate on the same card not stored."},{"id":"chutes-kimi-k3-moonshotai-kimi-k3-tee-out","providerId":"chutes","sku":"Kimi-K3 (moonshotai/Kimi-K3-TEE)","unit":"usd_per_million_output_tokens","amountUsd":9.5,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"sourced_token_price","normalizedUsdPerMillionTokens":9.5,"normalizationReason":"output_token_price_not_a_single_blended_rate","priceSortEligible":false,"qualifier":"Public TEE inference output per 1M tokens. Reconfirmed 2026-10-27 (v0.12.141). The page says per-model rates are 'pulled live from our pricing API'; cached-input rate on the same card not stored."},{"id":"chutes-rtx-pro-6000-96gb-usd-per-gpu-hour","providerId":"chutes","sku":"RTX Pro 6000 96GB","unit":"usd_per_gpu_hour","amountUsd":1.8,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"gpu_hour_not_coerced_to_per_million_tokens","priceSortEligible":false,"qualifier":"Self-serve TEE GPU hourly rate. Not converted from per-second. Reconfirmed 2026-10-27 (v0.12.140): page adds a 'One-time deployment fee $5.40 = 3× hourly rate' (not stored as a row) and 'Billed by the second at the GPU's hourly rate'."},{"id":"chutes-private-chute-deployment-fee-usd-one-time","providerId":"chutes","sku":"Private chute deployment fee","unit":"usd_one_time","amountUsd":5.4,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-27","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_one_time_fee","priceSortEligible":false,"qualifier":"Page states one-time fee equals 3× the $1.80 hourly rate ($5.40) for this GPU class. Reconfirmed 2026-10-27 (v0.12.141): page prints 'One-time deployment fee $5.40 = 3× hourly rate' next to the $1.80 / hour RTX Pro 6000 96 GB self-serve TEE rate."},{"id":"chutes-plus-usd-per-month","providerId":"chutes","sku":"Plus","unit":"usd_per_month","amountUsd":10,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-03","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_month","priceSortEligible":false,"qualifier":"Optional plan. 6% off PAYG was not applied to token rows. chutes.ai/pricing 2026-10-27 (v0.12.141) FAQ: 'Monthly plans are no longer sold on chutes.ai' (existing plans run to the end of the current billing period, then usage is pay-as-you-go); amount kept from 2026-10-03, not reconfirmed (asOf unchanged).","sourceStatus":"unverified","sourceStatusReason":"plan_no_longer_sold: on 2026-10-27 the https://chutes.ai/pricing FAQ says 'Monthly plans are no longer sold on chutes.ai. If you already have one, it stays active until the end of your current billing period' (re-checked twice, same as the 2026-10-27 06:06 ET fetch); the page shows no Plus plan or $10 amount. Kept for history, never ranked.","sourceStatusCheckedOn":"2026-10-27"},{"id":"chutes-pro-usd-per-month","providerId":"chutes","sku":"Pro","unit":"usd_per_month","amountUsd":20,"currency":"USD","sourceUrl":"https://chutes.ai/pricing","asOf":"2026-10-03","normalizationStatus":"unit_mismatch","normalizedUsdPerMillionTokens":null,"normalizationReason":"unit_mismatch_per_month","priceSortEligible":false,"qualifier":"Optional plan. 10% off PAYG was not applied to token rows. chutes.ai/pricing 2026-10-27 (v0.12.141) FAQ: 'Monthly plans are no longer sold on chutes.ai' (existing plans run to the end of the current billing period, then usage is pay-as-you-go); amount kept from 2026-10-03, not reconfirmed (asOf unchanged).","sourceStatus":"unverified","sourceStatusReason":"plan_no_longer_sold: on 2026-10-27 the https://chutes.ai/pricing FAQ says 'Monthly plans are no longer sold on chutes.ai. If you already have one, it stays active until the end of your current billing period' (re-checked twice, same as the 2026-10-27 06:06 ET fetch); the page shows no Pro plan or $20 amount. Kept for history, never ranked.","sourceStatusCheckedOn":"2026-10-27"}],"notesExcerpt":"As of 2026-10-27 (chutes.ai/pricing, fetched twice 2026-10-27): Public TEE inference PAYG per 1M tokens, input/output (the page says per-model rates are 'pulled live from our pricing API'): gemma-4-31B-turbo $0.12/$0.37; Qwen3.8-27B $0.039/$1.25; Qwen3.6-27B $0.25/$2.00; DeepSeek…","notesCheck":{"status":"no_known_contradiction","pairs":[],"review":null,"note":null},"lastReviewed":"2026-09-14","scoreAsOf":"2026-09-14","website":"https://chutes.ai","doNotParse":"Do not parse pricingNotes. Use rows only. normalizedUsdPerMillionTokens is a single number only when this provider has exactly one sourced token row. Input/output, context tiers, and non-token units stay null at this level.","gap":"Partial coverage. Providers without a fetched SKU are omitted. See GET /api/pricing."},"decideHint":"/api/decide?jtbd=open-model-inference","human":"/providers/chutes","compare":"/compare/predibase-vs-chutes"}],"rankContract":{"style":"editorial_weighted","notAnElo":true,"note":"deltaOverallVsSubject is Depot overall (0–10) minus the subject. It is not Arena Elo and not an Artificial Analysis index."},"freshness":{"scoreAsOfMin":"2026-09-14","scoreAsOfMax":"2026-10-19","contractAsOf":"2026-10-03"},"honesty":["Alternatives are other catalog providers that share a JTBD as pick or runner-up. If fewer than three exist, same-category active providers fill the list and are labeled same_category.","Overall deltas are catalog scores. kind=curated_estimate is not a lab measurement.","Pricing rows are sourced or explicitly null. Do not parse pricingNotes. A single normalized USD figure is set only for a provider with exactly one token row."],"links":{"human":"/alternatives/predibase","machine":"/api/alternatives?provider=predibase","provider":"/api/providers/predibase","canonical":"/api/canonical"}}