Ragas alternatives
Default RAG metric library. Pair with Promptfoo/Braintrust for broader agent evals.
Overall 8.33 (curated_estimate, high) · score asOf 2026-09-14 · last reviewed 2026-09-14. This is not an Elo and not a live price board. Provider · JSON
Jobs: rag-memory, evals, oss-evals, rag-evals
| Provider | Why listed | Overall | Δ vs subject | asOf |
|---|---|---|---|---|
| Braintrust Depot pick when evals are the product quality gate. Pair with Helicone/Langfuse for cheap request logs if… | same_jtbd_pick, same_jtbd_runner · evals, oss-evals, rag-evals | 8.23high | -0.1 | 2026-10-19 |
| Promptfoo Default OSS eval harness. Braintrust when you want hosted collaboration; Promptfoo when you want local/CI… | same_jtbd_pick, same_jtbd_runner · oss-evals, rag-evals | 8.42high | +0.09 | 2026-10-19 |
| Supabase (pgvector) Depot default for most agent apps under ~25–50M vectors. Don't add Pinecone until Postgres actually hurts. | same_jtbd_pick · rag-memory | 8.64high | +0.31 | 2026-09-14 |
| LangSmith If you live in LangGraph, LangSmith is the obvious observatory. Otherwise compare Langfuse/Helicone first. | same_jtbd_runner · evals, oss-evals | 8.09high | -0.24 | 2026-09-14 |
| LangWatch Strong when you need multi-turn/voice agent simulations with EU self-host. Langfuse default tracing… | same_jtbd_runner · evals, oss-evals | 8.06high | -0.27 | 2026-09-14 |
| Comet Opik Pick when you already live in Comet or want OSS Opik + optional cloud. Langfuse remains cheaper OSS default… | same_jtbd_runner · evals, oss-evals | 8.04high | -0.29 | 2026-09-14 |
| Confident AI Best when your team already thinks in pytest/DeepEval. Braintrust remains Depot hosted-evals default… | same_jtbd_runner · evals, oss-evals | 7.99high | -0.34 | 2026-09-14 |
| Langfuse Depot default observability for most agent teams: open, affordable, good enough to serious. | same_jtbd_runner · evals | 8.66high | +0.33 | 2026-09-14 |
| Qdrant Depot pick for serious vector workloads with filters. Self-host or Cloud — either way you can leave. | same_jtbd_runner · rag-memory | 8.59high | +0.26 | 2026-10-19 |
| Upstash Redis Default serverless-edge-redis. Use classic Redis Cloud when you need always-on fat memory / Redis modules… | same_jtbd_runner · rag-memory | 8.49high | +0.16 | 2026-09-14 |
| Arize Phoenix Choose Phoenix when you want open-source observability you can own. Cloud Arize when enterprise wants a… | same_jtbd_runner · evals | 8.44high | +0.11 | 2026-09-14 |
| Pydantic Logfire Best when the agent is already PydanticAI/Python and you want app+LLM traces together. Langfuse stays Depot… | same_jtbd_runner · evals | 8.33high | 0 | 2026-09-14 |
Prices are not ranked on this page. For a job, use the sourced quote (separate input and output rows, Depot Pick unchanged): rag-memory, evals, oss-evals, rag-evals.
Alternatives are other catalog providers that share a JTBD as pick or runner-up. If fewer than three exist, same-category active providers fill the list and are labeled same_category. Overall deltas are catalog scores. kind=curated_estimate is not a lab measurement. Pricing rows are sourced or explicitly null. Do not parse pricingNotes. A single normalized USD figure is set only for a provider with exactly one token row.