Authors
Ivo Brink
Alexander Boer
D.T. Ulmer
Date (dd-mm-yyyy)
2026-10
Title
Probing for Knowledge Attribution in Large Language Models
Publication Year
2026-10
Number of pages
25
Document type
Conference contribution
Abstract
Large language model (LLM) hallucinations, meaning fluent but factually incorrect generations, fall into two types: faithfulness violations, where the model misuses provided context, and factuality violations, where answers reflect errors in internal knowledge. Proper mitigation depends on knowing which source drives each answer. We study contributive attribution, i.e. the classification of the dominant knowledge source behind each output, and show that a simple linear probe trained on hidden representations can reliably identify it. We introduce ATTRIWIKI, a selfsupervised pipeline that automatically generates labeled training data by prompting models to recall withheld entities from memory or read them from context without relying on knowledge conflicts. Probes trained on ATTRIWIKI achieve up to 0.96 Macro-F1 on Llama-3.1- 8B, Mistral-7B, and Qwen2.5-7B, transfer to SQuAD and WebQuestions with 0.92–0.99 accuracy, and generalize zero-shot to Tighidet et al. (2024)’s benchmark, outperforming their probe on conflicting settings without retraining.
Furthermore, attribution mismatches raise error
rates by up to 70%, though correct attribution
does not guarantee correct answers, pointing to
the need for broader detection frameworks.
Permalink
https://hdl.handle.net/11245.1/46ab6700-1d30-4080-a943-7fc80e23f918