← Toutes les offres
AG

Truth probes follow the persona, but the answer doesn't go through them

Aniket Ghosh

Global
Publié le 21 novembre 2026

Description du poste

I am fairly confident about the effect for a range of models (at least 4 model families). I am less certain about the mechanism and results are only for linear probes. Reason for BeliefIf a model has a "truth" direction along which its representations vary with whether it believes a statement to be true, this may provide a useful mechanism for lie detection. However, this assumes the generated answer will also be impacted by the truth value, and this has rarely been checked. Models, given a persona, tend to say various things that are not true, and the truth probe shifts toward "true" on these. SummaryWhen asked to take on the persona of a European scholar living in 1500, Qwen, Llama, Gemma, and OLMo all shift their truth-probe readings accordingly and say that 41% to 89% of the falsehoods believed in 1500 are true (baseline 3-6%). Knocking out the truth directions for these models resulted in an effect that was reduced by 0-13%. So some other feature in the representation caused by the persona is responsible, located at the position of the generated answer. A truth probe located at the position of the generated answer (correlated between 0.82 to 0.94 with the generated answer) is also only responsible for 1-18% of the effect. Similar results for full sentence generation and LoRA. Code · Full writeup Figure 0. Two routes to the answer. The probe reads the blue one; the orange one does most of the work. If a persona causes false answers to be generated, then there are three possibilities. The truth probe is unaffected by the persona (A); The truth probe is shifted by the persona and is responsible for generating false answers (B); or the truth probe is shifted by the persona, but other features are responsible for generating the false answer (C). To distinguish between (B) and (C) requires an intervention. I added causal experiments to those previously reported. These include: personas as a 1500s scholar (Sturgeon et al. 2026), a partisan (Kozlowski et al. 2026), alw