Galileo alternatives
Pick for production hallucination measurement + guardrails. Braintrust/Promptfoo for lighter eval loops.
Overall 7.45 (curated_estimate, high) · score asOf 2026-09-14 · last reviewed 2026-09-14. This is not an Elo and not a live price board. Provider · JSON
Jobs: llm-tracing, evals, cost-monitoring, rag-evals, production-guardrail-evals, llm-input-guardrails, adversarial-red-team-evals
| Provider | Why listed | Overall | Δ vs subject | asOf |
|---|---|---|---|---|
| Langfuse Depot default observability for most agent teams: open, affordable, good enough to serious. | same_jtbd_pick, same_jtbd_runner · llm-tracing, evals, cost-monitoring | 8.66high | +1.21 | 2026-09-14 |
| Braintrust Depot pick when evals are the product quality gate. Pair with Helicone/Langfuse for cheap request logs if… | same_jtbd_pick, same_jtbd_runner · evals, rag-evals, production-guardrail-evals | 8.23high | +0.78 | 2026-10-19 |
| Promptfoo Default OSS eval harness. Braintrust when you want hosted collaboration; Promptfoo when you want local/CI… | same_jtbd_runner, same_jtbd_pick · rag-evals, adversarial-red-team-evals | 8.42high | +0.97 | 2026-10-19 |
| Ragas Default RAG metric library. Pair with Promptfoo/Braintrust for broader agent evals. | same_jtbd_pick · rag-evals | 8.33high | +0.88 | 2026-09-14 |
| NVIDIA NeMo Guardrails When OpenAI Moderation taxonomy is not enough and you need programmable rails. Host Llama Guard on Groq for… | same_jtbd_pick · llm-input-guardrails | 7.87high | +0.42 | 2026-09-14 |
| LangSmith If you live in LangGraph, LangSmith is the obvious observatory. Otherwise compare Langfuse/Helicone first. | same_jtbd_runner · llm-tracing, evals, production-guardrail-evals | 8.09high | +0.64 | 2026-09-14 |
| HoneyHive Use the free Developer tier to stand up agent evals/traces in a day; Enterprise when you need self-host… | same_jtbd_runner · llm-tracing, evals, production-guardrail-evals | 8.02high | +0.57 | 2026-09-14 |
| Confident AI Best when your team already thinks in pytest/DeepEval. Braintrust remains Depot hosted-evals default… | same_jtbd_runner · evals, production-guardrail-evals, adversarial-red-team-evals | 7.99high | +0.54 | 2026-09-14 |
| Arize Phoenix Choose Phoenix when you want open-source observability you can own. Cloud Arize when enterprise wants a… | same_jtbd_runner · llm-tracing, evals | 8.44high | +0.99 | 2026-09-14 |
| Pydantic Logfire Best when the agent is already PydanticAI/Python and you want app+LLM traces together. Langfuse stays Depot… | same_jtbd_runner · llm-tracing, evals | 8.33high | +0.88 | 2026-09-14 |
| Portkey Depot pick for production AI gateway (fallbacks, virtual keys, budgets). OpenRouter when you want a model… | same_jtbd_runner · llm-tracing, cost-monitoring | 8.31high | +0.86 | 2026-09-14 |
| Lakera Guard Depot pick for a dedicated prompt-injection firewall in front of any LLM. NeMo when you need programmable… | same_jtbd_runner · llm-input-guardrails, adversarial-red-team-evals | 8.21high | +0.76 | 2026-09-14 |
Prices are not ranked on this page. For a job, use the sourced quote (separate input and output rows, Depot Pick unchanged): llm-tracing, evals, cost-monitoring, rag-evals.
Alternatives are other catalog providers that share a JTBD as pick or runner-up. If fewer than three exist, same-category active providers fill the list and are labeled same_category. Overall deltas are catalog scores. kind=curated_estimate is not a lab measurement. Pricing rows are sourced or explicitly null. Do not parse pricingNotes. A single normalized USD figure is set only for a provider with exactly one token row.