Groq

Use when latency is the product. Do not build your whole company on one Groq model SKU — they rotate.

Listing status · Claim or correct this listing

Use when latency is the product. Do not build your whole company on one Groq model SKU — they rotate. Strengths: Blazing tokens/sec latency; Simple API and free tier for prototypes; Great for real-time agent loops on supported models.

Overall

8.0

curated_estimate

confidence: high · as of 2026-09-14

Capability fit

7.8

Price / performance

9.0

Latency / reliability

8.2

Developer & agent DX

8.8

Privacy / data retention

7.0

Lock-in risk (higher = worse)

5.0

Maturity / track record

7.8

Lock-in risk: higher = more lock-in (worse). Overall already inverts this dimension.

Sources: Groq: https://groq.com · GroqCloud: https://console.groq.com · Groq Llama Guard 4 docs: https://console.groq.com/docs/model/meta-llama/llama-guard-4-12b

Use when latency is the product. Do not build your whole company on one Groq model SKU — they rotate.

Strengths

· Blazing tokens/sec latency
· Simple API and free tier for prototypes
· Great for real-time agent loops on supported models

Weaknesses

· Limited model variety
· Aggressive model deprecations
· Not for frontier closed models

Pricing notes

Per-token with free tier; LPU inference; narrow production model set (Llama/Qwen/GPT-OSS etc.); batch discounts. Llama Guard 4 12B (model id meta-llama/llama-guard-4-12b) is still documented at console.groq.com/docs/model/meta-llama/llama-guard-4-12b as an open safety classifier; its per-token price figure was removed because it couldn't be re-sourced on 2026-10-21 (no price on that page or on console.groq.com/docs/models as of 2026-10-21). See the stored rows for sourced Groq prices, including the Llama Prompt Guard 2 classifiers.

Regions: us, globalLast reviewed: 2026-09-14Status: active

Sourced pricing

Contract status ambiguous · input_output_split_not_a_single_rate. Single normalized $/1M: null. Machine list: /api/pricing?provider=groq

openai/gpt-oss-120b · usd_per_million_input_tokens · $0.15 · sourced_token_price
openai/gpt-oss-120b · usd_per_million_output_tokens · $0.6 · sourced_token_price
openai/gpt-oss-20b · usd_per_million_input_tokens · $0.075 · sourced_token_price
openai/gpt-oss-20b · usd_per_million_output_tokens · $0.3 · sourced_token_price
meta-llama/llama-prompt-guard-2-22m · usd_per_million_input_tokens · $0.03 · sourced_token_price
meta-llama/llama-prompt-guard-2-22m · usd_per_million_output_tokens · $0.03 · sourced_token_price
meta-llama/llama-prompt-guard-2-86m · usd_per_million_input_tokens · $0.04 · sourced_token_price
meta-llama/llama-prompt-guard-2-86m · usd_per_million_output_tokens · $0.04 · sourced_token_price
qwen/qwen3.8-27b · usd_per_million_input_tokens · $0.8 · sourced_token_price
qwen/qwen3.8-27b · usd_per_million_output_tokens · $4 · sourced_token_price
whisper-large-v3 · usd_per_hour · $0.111 · unit_mismatch · normalized null
whisper-large-v3-turbo · usd_per_hour · $0.04 · unit_mismatch · normalized null

Community signals

Insight claims only — never mutate official scores. Outside reports: 0; seed examples: 1.

0 insights

No insights yet. Submit a production claim →

All insights for this provider →