4 docs tagged with "chunker"

Split JSONL records into smaller chunks using an LLM-driven chunking method.

Deterministically split text into fixed-size character chunks with optional overlap.

Split markdown text along heading boundaries into size-bounded chunks.

Deterministically split text by trying separators from coarsest to finest until chunks fit a size budget.