Detecting Covert Collusion between AI Agents through Partner-Outsider Positive Listening
Source note: Preprints. Not peer reviewed at time of posting.
arXiv:2610.37849v1 Announce Type: new Abstract: AI agents that share a secret convention can coordinate through messages that look innocent, so a monitor that reads only the messages can miss them. We propose a behavioural test: a partner that uses a code reacts to the exact wording of a message, whereas an uninvolved agent placed in its seat does not. Partner--Outsider Positive Listening (PoPLi) is the difference between the two agents in how much their action changes when the message is reworded with its meaning kept, and it is computed after the fact by replaying logged prompts. In a simulated market with five conditions (no collusion, a joint reward with neutral messages, the same with an openly stated intention, a covert first-letter code, and the code with a stated intention), PoPLi is between 0.48 and 0.59 whenever the code is present (95% intervals all above 0.29) and between -0.10 and -0.01 without it. Message-only monitors did not separate the conditions: one reading the speaker's messages answered "no" in all 50 markets, and one reading every seller's messages flagged 9 of 10 markets with no collusion. PoPLi detects the use of a private channel, not collusion as such, and it cannot detect collusion through incentives alone or codes carried by meaning.
Every model that read this
| Model | Provider | Stage | Score | Conf. | Latency | Prompt | When |
|---|---|---|---|---|---|---|---|
| Llama 3.3 70B | Meta | analysis | -50 | 80% | 4772ms | v1.0.0 / m1.0.1 | 2026-10-31 05:40 |
Detecting covert collusion between AI agents implies potential for undetectable manipulation.
Evidence extracted
- PoPLi detects private channels between AI agents
- Message-only monitors miss covert collusion
SOURCE arXiv cs.AI (tier 1)
↓
DOCUMENT 12139aa8-01c2-4ec3-b0e0-5faef899424e
https://arxiv.org/abs/2610.37849
↓
EVIDENCE 2 extracted excerpts
↓
MODEL RUN 1 run, methodology 1.0.1
↓
SCORE -50 (Adverse)
↓
CONFIDENCE 80%