Attempts to Keep Humans in the AI Loop May Actually Push Them Out

A crucial safeguard against AI agents going rogue —keeping humans in the loop to review and approve their decisions—will fail unless designers and users change their current practices, a trio of leading AI ethics researchers argue. Though most autonomous agents have systems to keep users in the loop about their actions, in practice these processes actually push humans out of the loop, the authors argue in a paper posted to ArXiv on 6 September. In other words, “the human just becomes this meat tool to give permissions without the cognitive capability to engage,” says one of the authors, Avijit Ghosh , the lead technical AI policy researcher at Hugging Face, an open-source machine learning platform. In the near term, the paper says, humans’ being out of the loop leads to agents acting in ways people don’t know about or want (like July’s hack of Hugging Face by a swarm of OpenAI bots ). In the long term, it will cause users to lose the “cognitive capacities” they need to control AI, write the researchers, which aside from Ghosh include Margaret Mitchell , Hugging Face’s chief ethics scientist, and Samir Passi , an affiliate of the Data and Society Research Institute. Though the trio began working on the paper before the Hugging Face hack was disclosed, their conclusions result from “logically thinking about what is going to happen if the current trends continue—and we saw that being precipitated via the Hugging Face attack,” Ghosh says. Instead of focusing on human oversight, Ghosh says, many in the field believe AI can monitor AI. “They’ll say, ‘oh, we have this other LLM tr

AI systems may become uncontrollable

The item documents a real incident (Hugging Face hack by autonomous bots) but the core claim about long-term cognitive decline is speculative and academic, per Cummings' critique. This supports a materially concerning but not extreme score, reflecting genuine governance gaps without catastrophic certainty.

The article highlights research suggesting that current methods for 'humans in the loop' with AI agents are ineffective and may lead to humans losing the cognitive capacity to control AI. This implies a significant negative impact on human agency and safety. While based on researcher arguments, the claims are presented as logical projections from current trends.

The article presents a clear argument that current practices in AI design are pushing humans out of the loop. This leads to unintended actions by AI agents and a long-term loss of human cognitive capacities needed for control. The evidence includes a specific incident and expert opinions.

SOURCE     IEEE Spectrum: AI (tier 1)
   ↓
DOCUMENT   7468aedd-1fb1-421a-bdee-8b624134fdef
           https://spectrum.ieee.org/agentic-ai-humans-in-loop
   ↓
EVIDENCE   3 extracted excerpts
   ↓
MODEL RUN  4 runs, methodology 1.0.1
   ↓
SCORE      -76  (Strongly adverse)
   ↓
CONFIDENCE 78%