This report explains why hallucinations happen from training objectives and inference behavior, compares benchmark evaluation with practical evaluation, and outlines what RAG, verification, citations, and tools can and cannot fix.
#rag
A practical guide to the difference between pretraining, fine-tuning, prompting, RAG, tool use, and agents, framed by what each one changes and when to use it.