applications
Chunking
The process of splitting large documents into smaller, semantically coherent segments for storage and retrieval in RAG systems. Effective chunking balances between preserving context and maintaining relevance for search queries.
In practice
A 100-page manual might be chunked into 500-token segments, with overlap between chunks to preserve context at boundaries.