Where to cache in a RAG pipeline besides the prompt
Prompt caching gets all the attention while the expensive work happens before the model sees a token. Five places to cache in a RAG pipeline, from query embeddings to full query-response pairs, with a transients example for WordPress.