# Recursive Self-Improvement on a Budget: Scoring Code Edits Before They Run

DevFeed: [Recursive Self-Improvement on a Budget: Scoring Code Edits Before They Run](<https://devfeed.tech/articles/recursive-self-improvement-on-a-budget-scoring-code-edits-before-they-run-94878.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2610.29121>)

Author: Erfan Darzi, Sree Bhargavi Balija, Sheng He

Published: 2026-10-22T04:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [thompson sampling](<https://devfeed.tech/topics/thompson-sampling.md>), [benchmark overfitting machine learning](<https://devfeed.tech/topics/benchmark-overfitting-machine-learning.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [linear-regression](<https://devfeed.tech/topics/linear-regression.md>)

Tags: [ablation](<https://devfeed.tech/tags/ablation.md>), [agent](<https://devfeed.tech/tags/agent.md>), [archive](<https://devfeed.tech/tags/archive.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [claude](<https://devfeed.tech/tags/claude.md>), [claude-sonnet](<https://devfeed.tech/tags/claude-sonnet.md>), [code](<https://devfeed.tech/tags/code.md>), [counts](<https://devfeed.tech/tags/counts.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [evaluations](<https://devfeed.tech/tags/evaluations.md>), [gpt](<https://devfeed.tech/tags/gpt.md>), [linear](<https://devfeed.tech/tags/linear.md>), [parent](<https://devfeed.tech/tags/parent.md>), [recursive-self-improvement](<https://devfeed.tech/tags/recursive-self-improvement.md>), [score](<https://devfeed.tech/tags/score.md>), [search](<https://devfeed.tech/tags/search.md>), [selection](<https://devfeed.tech/tags/selection.md>), [solve](<https://devfeed.tech/tags/solve.md>), [split](<https://devfeed.tech/tags/split.md>), [steering](<https://devfeed.tech/tags/steering.md>), [thompson-sampling](<https://devfeed.tech/tags/thompson-sampling.md>)

## AI overview

The method scores proposed scaffold edits before evaluation using a linear readout trained on the parent's solve rate and eight diff coordinates, calibrated from 96 edits, then freezes its coefficients. A steering split guides parent selection and node ranking; final results are measured on held-out instances. Across 12 GPT-4o runs on HumanEval+, the method's selected node scored 87.0%, compared with 84.2% for a parent-rate ablation, 85.1% for Huxley-Gödel Machine selection, 81.2% for the root, and 82.8% for the calibration-best edit. Claude Sonnet 4.5 scored 86.6%, close to Huxley-Gödel Machine selection at 86.5%. The supplied excerpt gives no Polyglot results.

## Source excerpt

arXiv:2610.29121v1 Announce Type: cross Abstract: A coding agent that rewrites its own scaffold has to choose which proposed edit to expand before that edit has been evaluated, and the search then has to return one agent. Each run fits one linear readout on the parent's steering-split solve rate and eight coordinates of the proposed diff, from 96 scaffold edits labeled by four evaluations of a 16-instance fit split, and then freezes the coefficients. HumanEval+ reserves 48 instances as the steering split and Polyglot reserves 64. That split scores parents and keeps an archive of four nodes. Huxley-G\"odel Machine selection draws a parent by Thompson sampling on the steering counts of nodes that have already been evaluated, and it expands the child that parent proposes. Every method then returns the earliest evaluated node whose steering-split solve count is maximal. The tables report the held-out score of that node on the other 100 HumanEval+ instances and the other 145 Polyglot instances, next to the root scaffold and the calibration edit with the highest fit-split label. Twelve runs of GPT-4o return a node at 87.0% on held-out HumanEval+, against 84.2% for the parent-rate ablation. On that split Huxley-G\"odel Machine selection returns 85.1%, the root is at 81.2%, and the calibration-best edit is at 82.8%. On the same split Claude Sonnet 4.5 returns 86.6%, beside 86.5% for Huxley-G\"odel Machine selection, 85.3% for the parent-rate ablation, and 85.1% for the calibration-best edit.