A misinformation playbook sharpens judgement without breeding cynicism
Source note: Preprints on societal impact.
arXiv:2610.22724v1 Announce Type: new Abstract: Misinformation harms public health and democracy, and generative artificial intelligence now writes falsehoods as persuasive as people's. Defences range from fact-checking individual claims to training people to resist falsehoods. Yet many claims are too new to check, and interventions that teach doubt can reduce belief in truth too. We propose a defence that targets not the facts of each claim but the persuasion strategies that recur across them. Here we show that learning misinformation's persuasion playbook, mapped from 214,646 fact-checked claims in 51 languages, can sharpen human and machine judgement of claims they know little about, without making either more cynical about true claims. The playbook spans social influence, information manipulation and emotional appeals, combined around a core of fear, conspiracy and fabrication. Briefed with it, plus a reminder that persuasion is not proof of falsehood, a language model better distinguished true from machine-generated false claims about events after its training data. In a pre-registered experiment, the same briefing improved people's discernment of claims they reported as unfamiliar and left their belief in true claims unchanged. Averaged over all claims, the gain was not statistically significant. Because it targets what recurs, this defence need not wait for claim-specific fact-checks.
Every model that read this
| Model | Provider | Stage | Score | Conf. | Latency | Prompt | When |
|---|---|---|---|---|---|---|---|
| Llama 3.3 70B | Meta | analysis | +50 | 80% | 4548ms | v1.0.0 / m1.0.1 | 2026-10-19 05:41 |
| GPT-4.1 mini | OpenAI | consensus | +20 | 90% | 2673ms | v1.0.0 / m1.0.1 | 2026-10-19 05:44 |
| Claude Sonnet 5 | Anthropic | consensus | -100 | 60% | 8532ms | v1.0.0 / m1.0.1 | 2026-10-19 05:44 |
| Gemini 2.5 Flash | consensus | -100 | 90% | 2076ms | v1.0.0 / m1.0.1 | 2026-10-19 05:44 |
Misinformation harms public health and democracy, but proposed defence sharpens judgement without breeding cynicism.
This research shows a defense against AI-generated misinformation that improves discernment without increasing cynicism, which can positively impact public health and democracy. However, its overall effect was not statistically significant on average, indicating limited broad impact so far. The approach is promising but not yet transformative.
This is a modest, mixed-result research finding on a defensive tool against AI-generated misinformation, not a dramatic societal shift. The positive effect is narrow and the overall effect null, so the implication is mildly positive but should not be overstated.
This paper presents a novel approach to combating misinformation that shows promising results for both human and AI discernment. It addresses the growing challenge of AI-generated falsehoods by focusing on persuasion strategies rather than individual facts. The study indicates this method can improve judgment without the negative side effect of increasing cynicism towards true information.
Evidence extracted
- Misinformation harms public health and democracy.
- Generative AI writes falsehoods as persuasive as people's.
- Learning misinformation's persuasion playbook sharpens human and machine judgement.
SOURCE arXiv cs.CY (Computers and Society) (tier 1)
↓
DOCUMENT b9255571-e9d6-4a93-98b2-5e2de64503ad
https://arxiv.org/abs/2610.22724
↓
EVIDENCE 3 extracted excerpts
↓
MODEL RUN 4 runs, methodology 1.0.1
↓
SCORE -32 (Adverse)
↓
CONFIDENCE 80%