Provenance record

Does Multi-Agent Collaboration Reduce Hallucination in Clinical Tasks?

arXiv cs.AI (tier 1, academic) 2026-10-21T04:00:00.000Z Original ↗

Source note: Preprints. Not peer reviewed at time of posting.


Discourse valence
-50
Adverse
confidence 80% · 1 item
Adverse readingFavourable reading
Single-model reading. This item did not meet the threshold for a multi-model panel.
Evaluation and measurementMedicine and healthSynthetic media and manipulation
Excerpt as ingested

arXiv:2610.27027v1 Announce Type: new Abstract: Multi-agent LLM systems improve performance on clinical tasks, and that improvement is often read as evidence of a more trustworthy system. However, the two are not the same claim. A clinician acts on the stated reasoning and not only on the conclusion, so whether collaboration reduces hallucination, and what decides when it does, has to be measured in the reasoning too. Yet most evaluations score only the final answer. We evaluate four systems (a single-LLM baseline and three multi-agent topologies) across four models and three clinical tasks, scoring hallucination, under a factuality and faithfulness taxonomy, inside the rationale each system generates and reporting it alongside the task metric. We report that collaboration buys task performance but not lower hallucination as a rule, and no topology is reliably better than another. The effect differs by model: of the $36$ model--system--task comparisons, $12$ are large enough to resolve --- four decreases and eight increases, with no model on both sides. What sets the level, and the direction of any change, is the model rather than the topology or the number of agents. A self-correction experiment is consistent with this: shown its own flagged errors, every model except Llama-3.2-3B-Instruct reduces hallucination; the one model for which collaboration lowers hallucination gains the most, and Llama-3.2-3B-Instruct, the model whose hallucination it amplifies most, does not reduce its hallucination at all. We find that collaboration redistributes what its models can already do;

Every model that read this

ModelProviderStageScoreConf.LatencyPromptWhen
Llama 3.3 70BMetaanalysis -50 80%4151ms v1.0.0 / m1.0.1 2026-10-21 05:41
Llama 3.3 70B · reading

Collaboration does not reduce hallucination in clinical tasks, and may even increase it in some models.

evidence: primary horizon: n/a

Evidence extracted

The chain
SOURCE     arXiv cs.AI (tier 1)
   ↓
DOCUMENT   5000c95e-5f36-4d81-8a78-3c82f8259be6
           https://arxiv.org/abs/2610.27027
   ↓
EVIDENCE   3 extracted excerpts
   ↓
MODEL RUN  1 run, methodology 1.0.1
   ↓
SCORE      -50  (Adverse)
   ↓
CONFIDENCE 80%