Efficient knowledge base design for RAG systems
Dumping PDFs into a vector store is why RAG systems hallucinate and cost too much. This covers curating the source data, chunking by meaning, quantizing vectors, mixing BM25 with vector search through RRF, and testing retrieval with DeepEval.