AP
Agent Provider Depot
Opinionated picks for agents
OpenAPI
← All jobs

Billion-scale vector search

ANN at enormous scale with serious indexing.

At a glance — Oct 2026

Updated 2026-10-27 · forward this page: /jtbds/billion-scale-vector#brief

Scores as of 2026-09-14 (43 days old; Depot marks scores stale after 30 days). The pick is still Depot's current editorial pick; it has not been re-reviewed since. Prices below carry their own dates.

Depot Pick
Zilliz (Milvus) · 8.10/10 for this job (curated estimate, high confidence)

capability scale + maturity.

Runner-up
Qdrant · 8.57/10

Scores higher than the pick on: Price / performance, Latency / reliability, Developer & agent DX, Privacy / data retention, Lock-in risk (higher = worse).

When not to use the pick
Under ~50–100M vectors — don't pay the complexity tax.
Lock-in / migration
Runner-up Qdrant has lower stored lock-in risk (3 vs 3.5, 0–10, higher = more lock-in). Pick exit signals: open source (provider tag `oss`). Self-host fallback listed for this job: Milvus.
Sourced price (no comparable unit)

Pick: no sourced price in this job's unit (no_sourced_price).

No cheapest SKU (no_comparable_unit_for_job). No price was invented.

Free option
  • Milvus (oss) — source, as of 2026-10-25
Failure modes to watch
  • Stale retrieval: Store the source URL and the time it was fetched. If a newer canonical page exists, or two stored sources disagree, do not answer from the older one.
Reported outcomes (submitted reports only)

This job: loading… JSON · reports never change scores · seed/test records excluded

Depot Pick (Zilliz (Milvus)) on this job: loading… JSON · reports never change scores · seed/test records excluded

Cite: Agent Provider Depot, Depot Pick for billion-scale-vector: zilliz, scores as of 2026-09-14. Agents: GET /api/decide?jtbd=billion-scale-vector

Free Billion-scale vector search options

Depot Pick

Zilliz (Milvus)

capability scale + maturity.

Pricing (directional): Managed Milvus (Zilliz Cloud); open-source Milvus for self-host; designed for large-scale ANN.

Cite: Depot Pick for billion-scale-vector: zilliz
Overall
8.1
curated_estimate
confidence: high · as of 2026-09-14
Capability fit
9.2
Price / performance
7.8
Latency / reliability
8.4
Developer & agent DX
7.2
Privacy / data retention
7.8
Lock-in risk (higher = worse)
3.5
Maturity / track record
8.8

Lock-in risk: higher = more lock-in (worse). Overall already inverts this dimension.

Sources: Zilliz: https://zilliz.com · Milvus: https://milvus.io

When you're truly at massive scale, Milvus/Zilliz earns its complexity. Don't start here for a chatbot MVP.

Quote for Billion-scale vector search

Depot Pick stays Zilliz (Milvus). Prices below are sourced SKU rows only (as of 2026-10-27). Input and output are not blended. GET /api/quote?jtbd=billion-scale-vector

Nothing was compared. no comparable sourced unit for this job; chat input $/1M and other units were not borrowed pickIsPriceWinner is null.

Sourced price unavailable for the Depot Pick. No row in the pricing index.

5 of 5 candidates have no sourced price row. 5 are excluded from the Matching price comparison (none). no comparable sourced unit for this job; chat input $/1M and other units were not borrowed

Runners-up

When NOT to use the top pick

Under ~50–100M vectors — don't pay the complexity tax.

Full ranking (score table)

Ranked with this JTBD's weights. Scores are curated estimates unless marked otherwise. Agents: prefer /api/decide then this table for tie-breaks.

#ProviderOverallFit$/perfLatencyDXAs of
1Qdrant8.69.28.88.68.42026-10-19
2Turbopuffer8.28.69.48.28.52026-09-14
3Zilliz (Milvus)Depot Pick8.19.27.88.47.22026-09-14
4Pinecone7.99.06.29.08.82026-09-14
5DataStax Astra DB7.98.47.48.87.62026-09-14

Score methodology for this job

capability scale + maturity.

  • capabilityFit: 24%
  • pricePerformance: 18%
  • latencyReliability: 18%
  • developerDx: 16%
  • privacyPosture: 10%
  • lockInRisk: 8%
  • maturity: 6%