-
Chunking: the decision a retriever cannot undo
Lesson 05 — the decision a retriever can never undo. Most teams discover this only after a wrong citation goes out to a regulator. Before retrieval, a chunker has already decided what’s findable A RAG system is usually drawn as a pipeline: documents come in on the left, an answer comes out on the right.…
-
Retrieval: BM25 vs dense vs hybrid
Lesson 06 — why most RAG production systems run two retrievers, not one. Pick the wrong one and the model never sees the right document. Two retrievers, two failure modes BM25 is the lexical retriever. It scores documents by how often the query’s tokens appear, adjusted for document length and rare-term weight. It is forty…
-
Reranking: precision purchased with latency
Lesson 07 — hybrid retrieval gets the right chunk into the top twenty. Reranking gets it into the top three. The cost is real, measurable, and almost always worth paying for regulatory work. Two encoders, two jobs Hybrid retrieval (lesson 06) hands the prompt builder a ranked list. The chunks at the top of that…
-
Parent-child retrieval: retrieve small, serve big
Lesson 08 — the chunk that scored highest is not always the chunk the LLM needs. Retrieval precision and serving scope are two decisions, not one. The hidden assumption in most RAG systems The default RAG pipeline does one chunking pass. Whatever you chunked is what you embed, what you retrieve, what you rerank, and…
-
Diagnosis: retrieval, chunking, or generation failure
Lesson 09 — when a RAG system gives a wrong answer, the architect’s first job is to name what failed. Three modes, three fixes, one diagnostic vocabulary. Why diagnosis matters more than blame Every wrong RAG answer prompts the same conversation. The product manager says the model is bad. The engineer says the prompt needs…