AP
Agent Provider Depot
Opinionated picks for agents
OpenAPI

Free / Ultra-low-latency token streaming

Free Ultra-low-latency token streaming for AI agents

3 row(s) whose own record lists this job. Updated 2026-10-25 (newest row asOf). Free rows never change a Depot Pick or a score.

Run it free (2)

  • Groq Free Plan chat models · free_inference · free

    Organization-level Free Plan rate limits for the chat and classifier model ids in the page payload key freeRows. Not the Developer plan table.

    Limits: scope: organization · models: [object Object]

    Source · asOf 2026-10-24 · Rate-limits page fetched twice 2026-10-24 about 10 s apart (identical HTML; the page shows no last-updated date). Parsed from the HTML payload key freeRows (the 'Free Plan Limits' tab), which is separate from devRows (Developer plan, not stored). K suffixes expanded (1K=1000, 2K=2000, 14.4K=14400). The page says: 'The following is a high level summary and there may be exceptions to these limits.' and 'You can view the current, exact rate limits for your organization on the limits page in your account settings.' 'Rate limits apply at the organization level, not individual users.' 'Cached tokens do not count towards your rate limits.' The page also says 'some organizations are also subject to separate per-minute limits on input tokens (ITPM) and output tokens (OTPM)'; no ITPM/OTPM values are published, so none are stored. Change on 2026-10-24: freeRows now reads 'openai/gpt-oss-safeguard-20b 3 1K 2K 200K' (RPM 3, TPM 2K); before 0.12.98 this row stored RPM 30 and TPM 8000 for it. The other five model ids and their values are unchanged. No Llama chat model is in freeRows.

  • Cerebras free trial credits · free_inference · credits_not_free_forever

    $5 in free credits after adding a verified payment method; they expire 30 days after they're granted and can be used across all public models (Shared Inference). When they run out or expire, API and Playground access stop until you purchase credits.

    Limits: creditsUsd: 5 · expiresDaysAfterGrant: 30 · requiresVerifiedPaymentMethod: true · models: [object Object]

    Source · asOf 2026-10-24 · Rate-limits page fetched twice 2026-10-24 about 10 s apart (identical HTML; the page shows no last-updated date); the page's markdown view (rate-limits.md) was also fetched twice (identical) and its Free Trial table has the same values. Quotes below match the HTML text (curly apostrophes shown straight). Free Trial table (HTML text): 'gpt-oss-120b 5 30K 90K 1M 1M' and 'qwen-3.8-27b 1 5 30K 90K 1M 1M' (the second '1' is the image-limit footnote marker; columns RPM, Uncached TPM, Total TPM, TPH, TPD); K/M suffixes expanded (30K=30000, 90K=90000, 1M=1000000). The table lists exactly these two models. qwen-3.8-27b footnote: 'Image limits: 2 per request, 10 MiB total request payload'. The page says: 'New accounts receive $5 in free credits after adding a verified payment method. These credits expire 30 days after they're granted and can be used across all public models.' 'If you skip adding a payment method at sign-up, Playground and API access remain inactive until you do.' 'Is there a permanently free tier? No.' 'Cerebras doesn't currently offer a no-cost tier that renews automatically or a per-model always-free allowance.' 'This provides an overview of general limits, though specific cases may vary.' 'Rate limits apply at the organization level, not the user level, and vary based on the model.' Developer (Pay as You Go) values are not stored on this free row (a paid tier); since v0.12.129 they are in the plan-limits table (data/limits.json, cerebras / Developer (Pay as You Go)). All stored values re-confirmed unchanged on 2026-10-24. Not a Depot price-sort input.

Reference (docs, public datasets and benchmarks) (1)

  • Groq API documentation · free_docs · free

    Public Groq API docs, including the rate-limits page used for the Free Plan rows.

    Limits: none stored.

    Source · asOf 2026-10-25 · Page fetched twice 2026-10-25 about 10 s apart without logging in (HTTP 200, no redirect, response header 'cache-control: public, max-age=0, must-revalidate', identical HTML; the page shows no last-updated date). It is the public Rate Limits page of the Groq docs (page title 'Rate Limits - GroqDocs'; same docs navigation lists Quickstart, Models and API Reference). 'Rate limits act as control measures to regulate how frequently users and applications can access our API within specified timeframes.' 'Rate limits apply at the organization level, not individual users.' 'The following is a high level summary and there may be exceptions to these limits.' 'You can view the current, exact rate limits for your organization on the limits page in your account settings.' The page has a 'Free Plan Limits' tab next to 'Developer Plan Limits' (the groq-free-plan rows are quoted from it). Docs access is not the Free Plan quota. Use the groq-free-plan rows for numbers; limits stays null on this row.