Anthropic gives outside AI watchdog “employee-like” access
Anthropic has granted external evaluators “employee-like access” to assess the risks of its models, following through on a commitment to increase safeguards over concerns the technology could run catastrophically out of control. METR, a nonprofit that has worked with leading labs including OpenAI, Anthropic, Google and Meta, now has a team embedded in the Claude maker’s office with access to its hardware and internal systems. A greater role for third-party evaluators is among the main concrete steps the labs have proposed in response to rising concern about the dangers more capable AI systems could pose to the economy, cyber security and humanity at large. Read full article Comments
Every model that read this
| Model | Provider | Stage | Score | Conf. | Latency | Prompt | When |
|---|---|---|---|---|---|---|---|
| Llama 3.3 70B | Meta | analysis | +50 | 80% | 3503ms | v1.0.0 / m1.0.1 | 2026-10-18 18:17 |
| GPT-4.1 mini | OpenAI | consensus | +20 | 80% | 3746ms | v1.0.0 / m1.0.1 | 2026-10-18 18:17 |
| Claude Sonnet 5 | Anthropic | consensus | +15 | 55% | 5610ms | v1.0.0 / m1.0.1 | 2026-10-18 18:17 |
| Gemini 2.5 Flash | consensus | -100 | 90% | 2485ms | v1.0.0 / m1.0.1 | 2026-10-18 18:18 | |
| Mistral Small 3.1 24B | Mistral AI | consensus | +65 | 90% | 9103ms | v1.0.0 / m1.0.1 | 2026-10-18 18:18 |
Granting access to assess risks implies acknowledging potential dangers.
Anthropic enabling deep external oversight improves transparency and risk management, potentially mitigating catastrophic AI risks. However, it also signals serious concerns about current AI safety, reflecting ongoing risks. The measure has moderate positive implications but does not eliminate underlying dangers.
Anthropic granted an external watchdog 'employee-like access' to its internal systems to assess AI risks. This action represents a concrete step towards mitigating potential catastrophic outcomes from advanced AI, indicating a materially optimistic implication for human safety and control over powerful AI systems. The commitment demonstrates a proactive approach to safeguard against future threats.
Anthropic's decision to grant external evaluators extensive access is a proactive measure to address AI risks. This step increases transparency and oversight, which can mitigate potential dangers.
Evidence extracted
- Anthropic grants outside AI watchdog employee-like access
- METR has access to Anthropic's hardware and internal systems
SOURCE Ars Technica: AI (tier 1)
↓
DOCUMENT aa63bb61-1484-4fc0-9eb0-6e9f0b037214
https://arstechnica.com/ai/2026/10/anthropic-gives-outside-ai-watchdog-employee-like-access
↓
EVIDENCE 2 extracted excerpts
↓
MODEL RUN 5 runs, methodology 1.0.1
↓
SCORE +10 (Mixed or uncertain)
↓
CONFIDENCE 79%