AP
Agent Provider Depot
Opinionated picks for agents
OpenAPI
← All jobs

Prototype RAG in a day

Hackathon/demo RAG with minimal setup.

At a glance — Oct 2026

Updated 2026-10-27 · forward this page: /jtbds/prototype-rag#brief

Scores as of 2026-09-14 (43 days old; Depot marks scores stale after 30 days). The pick is still Depot's current editorial pick; it has not been re-reviewed since. Prices below carry their own dates.

Depot Pick
Chroma · 7.88/10 for this job (curated estimate, high confidence)

dx first; reliability discounted.

Runner-up
Supabase (pgvector) · 8.64/10

Scores higher than the pick on: Capability fit, Latency / reliability, Developer & agent DX, Privacy / data retention, Maturity / track record.

When not to use the pick
Production traffic — graduate immediately.
Lock-in / migration
The pick has lower stored lock-in risk than runner-up Supabase (pgvector) (2.5 vs 3). Pick exit signals: open source (provider tag `oss`). Self-host fallback listed for this job: Chroma.
Sourced price (no comparable unit)

Pick: no sourced price in this job's unit (no_sourced_price).

No cheapest SKU (no_comparable_unit_for_job). No price was invented.

Free option
  • Chroma (oss) — source, as of 2026-10-25
Failure modes to watch
  • Context overflow: If the input exceeds the window, say so and retrieve a narrower slice. Do not answer from a truncated head as if it were the whole source.
  • Eval contamination: Keep gold labels out of the agent prompt. Store the harness version beside the score. Do not compare a number across a benchmark revision without saying the revision changed.
  • Lost in the middle: Ask the agent to name the passage it used. Spot-check questions whose only support sits in the middle of the context, not only at the edges.
  • Policy conflict: If cited sources contradict each other, return the conflict and the URLs. Do not pick a winner silently.
  • Silent truncation: Tools must return whether the payload was truncated and how long the original was. Fail the task if the answer depends on the missing span.
  • Stale retrieval: Store the source URL and the time it was fetched. If a newer canonical page exists, or two stored sources disagree, do not answer from the older one.
Reported outcomes (submitted reports only)

This job: loading… JSON · reports never change scores · seed/test records excluded

Depot Pick (Chroma) on this job: loading… JSON · reports never change scores · seed/test records excluded

Cite: Agent Provider Depot, Depot Pick for prototype-rag: chroma, scores as of 2026-09-14. Agents: GET /api/decide?jtbd=prototype-rag

Free Prototype RAG in a day options · for rag agents

Depot Pick

Chroma

dx first; reliability discounted.

Pricing (directional): As of 2026-09-14: Open-source embeddable vector DB + hosted Chroma Cloud; free/local for prototypes; Cloud usage-based for managed. Excellent DX for demos; graduate before high QPS/filtered production.

Cite: Depot Pick for prototype-rag: chroma
Overall
7.9
curated_estimate
confidence: high · as of 2026-09-14
Capability fit
7.2
Price / performance
9.0
Latency / reliability
7.0
Developer & agent DX
9.2
Privacy / data retention
7.5
Lock-in risk (higher = worse)
2.5
Maturity / track record
7.5

Lock-in risk: higher = more lock-in (worse). Overall already inverts this dimension.

Sources: Chroma: https://www.trychroma.com · Chroma docs: https://docs.trychroma.com · Chroma Cloud: https://www.trychroma.com/cloud

Prototype on Chroma; graduate to Qdrant/pgvector/Pinecone before your corpus and QPS grow up.

Quote for Prototype RAG in a day

Depot Pick stays Chroma. Prices below are sourced SKU rows only (as of 2026-10-27). Input and output are not blended. GET /api/quote?jtbd=prototype-rag

Nothing was compared. no comparable sourced unit for this job; chat input $/1M and other units were not borrowed pickIsPriceWinner is null.

Sourced price unavailable for the Depot Pick. No row in the pricing index.

7 of 7 candidates have no sourced price row. 7 are excluded from the Matching price comparison (none). no comparable sourced unit for this job; chat input $/1M and other units were not borrowed

Runners-up

When NOT to use the top pick

Production traffic — graduate immediately.

Full ranking (score table)

Ranked with this JTBD's weights. Scores are curated estimates unless marked otherwise. Agents: prefer /api/decide then this table for tie-breaks.

#ProviderOverallFit$/perfLatencyDXAs of
1Supabase (pgvector)8.68.59.08.69.42026-09-14
2Upstash Vector8.27.89.08.49.02026-09-14
3DuckDB (vector/extensions)8.06.09.57.58.52026-09-14
4Pinecone8.09.06.29.08.82026-09-14
5ChromaDepot Pick7.97.29.07.09.22026-09-14
6LanceDB7.87.88.87.28.22026-09-14
7Mem07.67.88.07.48.82026-09-14

Score methodology for this job

dx first; reliability discounted.

  • capabilityFit: 25%
  • pricePerformance: 18%
  • latencyReliability: 15%
  • developerDx: 15%
  • privacyPosture: 10%
  • lockInRisk: 7%
  • maturity: 10%