Agent classes / Data and ETL agent / Parse documents into LLM-ready chunks
Parse documents into LLM-ready chunks for a data and etl agent
Updated 2026-10-27 (newest stored date on this page) · score asOf 2026-09-14 (stale)
The class: Moves or reshapes records between files, tables, and documents, and reports rows that did not match the schema.
- A schema for the destination
- A row-level error report
Depot Pick: LlamaParse
When not to use it: Need connector-heavy ETL / VPC pipelines or OSS self-host partitioner — Unstructured; agentic forms/tables still fail LlamaParse bake-off — Reducto; you only have URLs not files — Firecrawl/Jina Reader.
Runner-up: Unstructured.
Cheapest matching sourced SKU (usd_per_1k_pages): Reducto r-1 Parse API $10 — source, asOf 2026-10-19. All sourced prices
Failure modes this class and job share (6)
- Collateral side effects: Snapshot the workspace or app state, then diff it against an allowlist. A passing check plus an unexpected diff is a failure.
- Hallucinated tool arguments: Reject a call that fails the current schema or names an unknown id, and do that before the tool runs a side effect.
- Partial tool success: Require a per-item status and a failure count. Success for the task requires the failed count to be zero or explicitly handed to a retry queue.
- Schema drift: Validate every tool call and every loaded table against the current schema. Quarantine mismatches instead of coercing them.
- Silent truncation: Tools must return whether the payload was truncated and how long the original was. Fail the task if the answer depends on the missing span.
- Stale retrieval: Store the source URL and the time it was fetched. If a newer canonical page exists, or two stored sources disagree, do not answer from the older one.
Free options this class uses (7)
- PaddleOCR (free_ocr, oss) — source, asOf 2026-10-25
- EasyOCR (free_ocr, oss) — source, asOf 2026-10-25
- Tesseract (free_ocr, oss) — source, asOf 2026-10-25
- Docling (free_ocr, oss) — source, asOf 2026-10-25
- Marker (free_ocr, oss) — source, asOf 2026-10-25
- MinerU (free_ocr, free) — source, asOf 2026-10-25
- Unstructured (free_ocr, oss) — source, asOf 2026-10-25