Ragas

Default RAG metric library. Pair with Promptfoo/Braintrust for broader agent evals.

Listing status · Claim or correct this listing

Default RAG metric library. Pair with Promptfoo/Braintrust for broader agent evals. Strengths: RAG-specific metrics; Free/OSS; Python-native.

Overall

8.3

curated_estimate

confidence: high · as of 2026-09-14

Capability fit

8.0

Price / performance

9.5

Latency / reliability

7.5

Developer & agent DX

8.2

Privacy / data retention

9.2

Lock-in risk (higher = worse)

2.0

Maturity / track record

7.8

Lock-in risk: higher = more lock-in (worse). Overall already inverts this dimension.

Sources: Ragas docs: https://docs.ragas.io · Ragas GitHub: https://github.com/explodinggradients/ragas · Best LLM eval tools 2026: https://deploybase.ai/articles/best-llm-evaluation-tools

Default RAG metric library. Pair with Promptfoo/Braintrust for broader agent evals.

Strengths

· RAG-specific metrics
· Free/OSS
· Python-native

Weaknesses

· Not a full agent-trace platform
· You operate harness
· Less red-team than Promptfoo

Pricing notes

As of 2026-09-14: Free open-source RAG evaluation library; cost is judge-LLM tokens only (~$0.50–$2 per 100 queries with cheap judges). No hosted SaaS required. Deep LangChain/LlamaIndex integration.

Regions: global, usLast reviewed: 2026-09-14Status: active

Sourced pricing

Contract status unavailable · no_sourced_price. Single normalized $/1M: null. Machine list: /api/pricing?provider=ragas

No sourced SKU row. Notes above stay prose.

Community signals

Insight claims only — never mutate official scores. Outside reports: 0; seed examples: 0.

0 insights

No insights yet. Submit a production claim →

All insights for this provider →