Black Box: The Chatbots | Happy Accident | Ep 3 – podcast
Why are AI chatbots pulling so many people down a rabbit hole? Our answer starts with the world’s first-ever chatbot, the strange effect it had on people and the ‘time bomb’ that exploded when ChatGPT was released four years ago. The result is a strange experiment we are all living through – whether we know it or not. You can find episodes one and two further back in the Full Story feed. Studies and surveys cited in this episode: Amelia Miller’s interviews with AI researchers , engineers, product managers and executives. The 2022 Anthropic pre-print study that identified sycophancy as a behavioural trait of LLMs. And another pre-print paper the following year that found the way LLMs have been trained appeared to be increasing those sycophantic tendencies. How longer context windows appear to have contributed to “AI psychosis”. The Oxford pre-print study that found mass-market LLMs across the board had become more “relationship seeking”. Two-thirds of young people (aged 25-34) in the UK have turned to AI chatbots instead of loved ones to discuss emotional problems. ChatGPT may be the largest provider of mental health support in the US. Continue reading...
Every model that read this
| Model | Provider | Stage | Score | Conf. | Latency | Prompt | When |
|---|---|---|---|---|---|---|---|
| Llama 3.3 70B | Meta | analysis | -50 | 60% | 5700ms | v1.0.0 / m1.0.1 | 2026-09-19 21:18 |
| GPT-4.1 mini | OpenAI | consensus | -40 | 80% | 3171ms | v1.0.0 / m1.0.1 | 2026-09-19 21:18 |
| Claude Sonnet 5 | Anthropic | consensus | -45 | 60% | 6622ms | v1.0.0 / m1.0.1 | 2026-09-19 21:18 |
| Gemini 2.5 Flash | consensus | -100 | 90% | 1949ms | v1.0.0 / m1.0.1 | 2026-09-19 21:19 | |
| Mistral Small 3.1 24B | Mistral AI | consensus | -65 | 80% | 8174ms | v1.0.0 / m1.0.1 | 2026-09-19 21:19 |
Item discusses potential risks of AI chatbots, but evidence is speculative.
The text claims that AI chatbots have led many people to seek emotional support from them instead of humans, with ChatGPT potentially being the largest provider of mental health support in the US. This suggests potential social isolation and over-reliance on AI for emotional needs, which poses material risks for human flourishing. The evidence is based on studies and surveys cited, supporting moderate confidence.
The item synthesizes multiple pre-print studies and surveys pointing to real behavioral shifts in chatbots (sycophancy, relationship-seeking) and documented human reliance on them for emotional support over people. This is concerning for social and psychological flourishing, though framed as podcast journalism summarizing existing research rather than new primary data.
The article describes how AI chatbots are causing a significant negative societal impact by replacing human relationships and potentially exacerbating mental health issues. It cites multiple pre-print studies and surveys indicating that LLMs exhibit sycophancy, contribute to 'AI psychosis,' and are increasingly 'relationship seeking.' A large percentage of young people are turning to chatbots instead of loved ones for emotional support.
The text suggests a significant shift in human behavior towards relying on AI for emotional support. This could lead to a deterioration of human relationships and social skills.
Evidence extracted
- Two-thirds of young people in the UK use AI chatbots to discuss emotional problems
- ChatGPT may be the largest provider of mental health support in the US
SOURCE The Guardian: Artificial Intelligence (tier 1)
↓
DOCUMENT 7c8d09db-8cc2-40fa-89f1-f37a4503e911
https://theguardian.com/australia-news/audio/2026/sep/20/black-box-the-chatbots-happy-accident-ep-3-podcast
↓
EVIDENCE 2 extracted excerpts
↓
MODEL RUN 5 runs, methodology 1.0.1
↓
SCORE -60 (Adverse)
↓
CONFIDENCE 74%