Provenance record

The Harness as the Only Mutable Surface: Compliance-Bounded Self-Evolution of LLM Agents in Credit Pipelines, with a Measured Admission Gate

arXiv cs.AI (tier 1, academic) 2026-10-09T04:00:00.000Z Original ↗

Source note: Preprints. Not peer reviewed at time of posting.


Discourse valence
-23
Adverse
confidence 72% · 3 items · range -100 to +20
Adverse readingFavourable reading
Consensus of 3 models from different labs. Spread 120 points, agreement low.
Existential and catastrophic riskLoss of control and alignmentScaling and architecture
Excerpt as ingested

arXiv:2610.10629v1 Announce Type: new Abstract: Self-improving LLM agents can adapt a credit pipeline to a changed rule, but an agent that rewrites itself destroys the artefact a supervisor reviews: a named change, a recorded test, an approval. We argue that self-evolution is reviewable only if it is confined to the runtime harness (instruction text, tool-call logic and primitive composition) while model weights stay fixed, so that every adaptation is a diff with a cause and a test attached. We give a dual-loop engine built on that bound, with one admission gate that writes a hash-chained record before deployment, and we measure the gate in simulation, with a simulated agent and a seeded-search proposer rather than language models. Across three families of supervisory re-interpretation at three severities, 10 seeds each, the gated loop admitted 144 of 7,449 candidate changes, none of which worsened error on held-out history, and restored the false-positive rate to the oracle level without raising missed flags in every low- and mid-severity cell. With the gate replaced by the check an unbounded system applies (fewer errors visible in recent traces), the same loops admitted 309 harmful changes and left missed flags above 10% in 49 of 90 runs: false positives fell because the screen was loosened. Evaluated on pre-shift labels, the gate rejected every candidate, so a re-interpretation must be encoded as a rule that relabels history. Parametric and scope shifts were repaired locally, a structural one only by primitive replacement; at the highest structural severity the gate's fi

Every model that read this

ModelProviderStageScoreConf.LatencyPromptWhen
Llama 3.3 70BMetaanalysis +20 70%4557ms v1.0.0 / m1.0.1 2026-10-09 05:41
Claude Sonnet 5Anthropicconsensus +12 55%9105ms v1.0.0 / m1.0.1 2026-10-09 05:43
Gemini 2.5 FlashGoogleconsensus -100 90%2770ms v1.0.0 / m1.0.1 2026-10-09 05:43
Llama 3.3 70B · reading

Item discusses a method for reviewable self-evolution of LLM agents, with measured results.

evidence: speculative horizon: n/a
Claude Sonnet 5 · reading

evidence: reported horizon: n/a
Gemini 2.5 Flash · reading

This paper presents a method for safely managing the self-evolution of LLM agents in critical financial systems. It provides empirical evidence that a constrained, gated approach prevents harmful changes, while an unconstrained system leads to significant negative outcomes. This offers a path to mitigate major risks associated with autonomous AI systems in high-stakes domains.

evidence: reported horizon: n/a

Evidence extracted

The chain
SOURCE     arXiv cs.AI (tier 1)
   ↓
DOCUMENT   a0138b61-d34f-43fd-9041-392857b5ced2
           https://arxiv.org/abs/2610.10629
   ↓
EVIDENCE   2 extracted excerpts
   ↓
MODEL RUN  3 runs, methodology 1.0.1
   ↓
SCORE      -23  (Adverse)
   ↓
CONFIDENCE 72%