The Harness as the Only Mutable Surface: Compliance-Bounded Self-Evolution of LLM Agents in Credit Pipelines, with a Measured Admission Gate
Source note: Preprints. Not peer reviewed at time of posting.
arXiv:2610.10629v1 Announce Type: new Abstract: Self-improving LLM agents can adapt a credit pipeline to a changed rule, but an agent that rewrites itself destroys the artefact a supervisor reviews: a named change, a recorded test, an approval. We argue that self-evolution is reviewable only if it is confined to the runtime harness (instruction text, tool-call logic and primitive composition) while model weights stay fixed, so that every adaptation is a diff with a cause and a test attached. We give a dual-loop engine built on that bound, with one admission gate that writes a hash-chained record before deployment, and we measure the gate in simulation, with a simulated agent and a seeded-search proposer rather than language models. Across three families of supervisory re-interpretation at three severities, 10 seeds each, the gated loop admitted 144 of 7,449 candidate changes, none of which worsened error on held-out history, and restored the false-positive rate to the oracle level without raising missed flags in every low- and mid-severity cell. With the gate replaced by the check an unbounded system applies (fewer errors visible in recent traces), the same loops admitted 309 harmful changes and left missed flags above 10% in 49 of 90 runs: false positives fell because the screen was loosened. Evaluated on pre-shift labels, the gate rejected every candidate, so a re-interpretation must be encoded as a rule that relabels history. Parametric and scope shifts were repaired locally, a structural one only by primitive replacement; at the highest structural severity the gate's fi
Every model that read this
| Model | Provider | Stage | Score | Conf. | Latency | Prompt | When |
|---|---|---|---|---|---|---|---|
| Llama 3.3 70B | Meta | analysis | +20 | 70% | 4557ms | v1.0.0 / m1.0.1 | 2026-10-09 05:41 |
| Claude Sonnet 5 | Anthropic | consensus | +12 | 55% | 9105ms | v1.0.0 / m1.0.1 | 2026-10-09 05:43 |
| Gemini 2.5 Flash | consensus | -100 | 90% | 2770ms | v1.0.0 / m1.0.1 | 2026-10-09 05:43 |
Item discusses a method for reviewable self-evolution of LLM agents, with measured results.
This paper presents a method for safely managing the self-evolution of LLM agents in critical financial systems. It provides empirical evidence that a constrained, gated approach prevents harmful changes, while an unconstrained system leads to significant negative outcomes. This offers a path to mitigate major risks associated with autonomous AI systems in high-stakes domains.
Evidence extracted
- Self-evolution of LLM agents is reviewable if confined to runtime harness
- Dual-loop engine with admission gate restores false-positive rate to oracle level
SOURCE arXiv cs.AI (tier 1)
↓
DOCUMENT a0138b61-d34f-43fd-9041-392857b5ced2
https://arxiv.org/abs/2610.10629
↓
EVIDENCE 2 extracted excerpts
↓
MODEL RUN 3 runs, methodology 1.0.1
↓
SCORE -23 (Adverse)
↓
CONFIDENCE 72%