# MIT Researchers Used GPT-6 Astra To Edit Qwen's Open Weights Directly, Boosting Math Scores

DevFeed: [MIT Researchers Used GPT-6 Astra To Edit Qwen's Open Weights Directly, Boosting Math Scores](<https://devfeed.tech/articles/mit-researchers-used-gpt-6-astra-to-edit-qwen-s-open-weights-directly-boosting-math-scores-114833.md>)

Original publisher: [Read original article](<https://science.slashdot.org/story/26/11/03/0537252/mit-researchers-used-gpt-6-astra-to-edit-qwens-open-weights-directly-boosting-math-scores>)

Author: BeauHD

Published: 2026-11-03T16:00:00Z

Content type: news

Language: en

Sources: [Slashdot](<https://devfeed.tech/sources/slashdot.md>)

Topics: [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [gpt-6-astra](<https://devfeed.tech/topics/gpt-6-astra.md>), [qwen](<https://devfeed.tech/topics/qwen.md>), [Neural Network](<https://devfeed.tech/topics/neural-network.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Computer Science and Artificial Intelligence Laboratory (CSAIL)](<https://devfeed.tech/topics/computer-science-and-artificial-intelligence-laboratory-csail.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-systems](<https://devfeed.tech/tags/ai-systems.md>), [astra](<https://devfeed.tech/tags/astra.md>), [computer-science](<https://devfeed.tech/tags/computer-science.md>), [gpt](<https://devfeed.tech/tags/gpt.md>), [gpt-6](<https://devfeed.tech/tags/gpt-6.md>), [gpt-6-astra](<https://devfeed.tech/tags/gpt-6-astra.md>), [language-model](<https://devfeed.tech/tags/language-model.md>), [llm](<https://devfeed.tech/tags/llm.md>), [massachusetts-institute-of-technology](<https://devfeed.tech/tags/massachusetts-institute-of-technology.md>), [math](<https://devfeed.tech/tags/math.md>), [mit](<https://devfeed.tech/tags/mit.md>), [neural-networks](<https://devfeed.tech/tags/neural-networks.md>), [open](<https://devfeed.tech/tags/open.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [open-weights](<https://devfeed.tech/tags/open-weights.md>), [openai](<https://devfeed.tech/tags/openai.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [qwen3-5](<https://devfeed.tech/tags/qwen3-5.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>)

## AI overview

MIT CSAIL researchers report that GPT-6 Astra improved Qwen3.5-0.8B's MATH-500 score from 7.9% to 48.1% by directly editing about 0.016% of its weights, without conventional training procedures to generate the edits. They call this method "weight-space programming." The reported gain came primarily from correcting repetitive reasoning. The excerpt describes this as the strongest language-model example in broader experiments on using AI to inspect and alter neural networks; it does not provide further experimental details or establish how broadly the result generalizes.

## Source excerpt

An anonymous reader quotes a report from VentureBeat: Researchers from the Massachusetts Institute of Technology (MIT) Computer Science & Artificial Intelligence Laboratory (CSAIL) reported today that they used OpenAI's GPT-6 Astra language model to raise a small, open source Qwen model's math score roughly sixfold by directly editing its weights -- the numerical parameters that govern its behavior. Rikiya Takehi, Jayden Teoh, Alex Zhang and Omar Khattab described their work in a research blog post published November 2. They call the approach "weight-space programming" and tested Astra's ability to interpret and alter networks without using conventional training procedures to generate the edits. In the strongest language-model example, Astra's intervention raised Qwen3.5-0.8B's MATH-500 score from 7.9% to 48.1% while touching approximately 0.016% of its weights. The improvement came primarily from correcting repetitive reasoning--a distinction that shaped both the technical findings and the debate over their implications. Their experiments explored a broader possibility: AI systems that inspect, repair and construct other neural networks by working directly on their internal machinery. "This is cool as heck!" wrote Yuchen Jin, a technical staffer at Databricks and former co-founder and CTO of Hyperbolic Labs who was unaffiliated with the research, on X. "Imagine using a large LLM to directly edit a smaller model's weights and dramatically improve its capabilities. It's like gene editing for neural networks. Even cooler than distillation!" Voyage AI staff researcher Chandan Singh, formerly of Microsoft AI, also reacted to the findings: "For anyone questioning whether this post is overhyped, I think they are actually *underselling* the approach." Read more of this story at Slashdot.