LLM hallucinations come from the architecture, not your data
Cleaning the dataset will not stop LLM hallucinations. Inside a transformer the right token is there in the early layers, and the model rotates away from it in the middle ones. What that means for monitoring an AI feature in production.