# Math reasoning

Published articles for Math reasoning.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Diverse reasoning traces teach LLMs to make better decisions

DevFeed: [Diverse reasoning traces teach LLMs to make better decisions](<https://devfeed.tech/articles/diverse-reasoning-traces-teach-llms-to-make-better-decisions-7597.md>)

Original publisher: [Read original article](<https://www.amazon.science/blog/diverse-reasoning-traces-teach-llms-to-make-better-decisions>)

Author: Sheng Jia; Xiao Wang; Shiva Kasiviswanathan

Published: 2026-05-26T15:17:06Z

Content type: article

Language: en

Sources: [Amazon Science homepage](<https://devfeed.tech/sources/amazon-science-homepage.md>)

Topics: [Language models](<https://devfeed.tech/topics/language-models.md>)

Tags: [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [chain-of-thought](<https://devfeed.tech/tags/chain-of-thought.md>), [code-generation](<https://devfeed.tech/tags/code-generation.md>), [conversational-ai](<https://devfeed.tech/tags/conversational-ai.md>), [deep-learning](<https://devfeed.tech/tags/deep-learning.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [iclr](<https://devfeed.tech/tags/iclr.md>), [iclr-2026](<https://devfeed.tech/tags/iclr-2026.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>), [llms](<https://devfeed.tech/tags/llms.md>), [math-reasoning](<https://devfeed.tech/tags/math-reasoning.md>), [parallel-reasoning](<https://devfeed.tech/tags/parallel-reasoning.md>), [post-training](<https://devfeed.tech/tags/post-training.md>), [post-training-optimization](<https://devfeed.tech/tags/post-training-optimization.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [traces](<https://devfeed.tech/tags/traces.md>)

### AI overview

The article presents set-supervised fine tuning and global forking policy optimization to train LLMs on multiple distinct reasoning paths. It reports 5% to 7% single-shot accuracy gains on standard benchmarks.

### Source excerpt

How to train language models to generate diverse, accurate reasoning paths using tokens that control distinct reasoning strategies.

## DeepMath: A lightweight math reasoning Agent with smolagents

DevFeed: [DeepMath: A lightweight math reasoning Agent with smolagents](<https://devfeed.tech/articles/deepmath-a-lightweight-math-reasoning-agent-with-smolagents-7288.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/intel-deepmath>)

Author: Daniel Fleischer; Moshe Berchansky; Moshe Wasserblat

Published: 2025-12-04T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [smolagents](<https://devfeed.tech/topics/smolagents.md>), [math](<https://devfeed.tech/topics/math.md>), [grpo](<https://devfeed.tech/topics/grpo.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Python](<https://devfeed.tech/topics/python.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [vllm](<https://devfeed.tech/topics/vllm.md>), [trl](<https://devfeed.tech/topics/trl.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [grpo](<https://devfeed.tech/tags/grpo.md>), [inference](<https://devfeed.tech/tags/inference.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>), [llm](<https://devfeed.tech/tags/llm.md>), [math](<https://devfeed.tech/tags/math.md>), [math-reasoning](<https://devfeed.tech/tags/math-reasoning.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [python](<https://devfeed.tech/tags/python.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [sandbox](<https://devfeed.tech/tags/sandbox.md>), [smolagents](<https://devfeed.tech/tags/smolagents.md>), [trl](<https://devfeed.tech/tags/trl.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

### AI overview

DeepMath is a lightweight math reasoning agent built on Qwen3-4B Thinking and implemented with smolagents. It uses GRPO fine-tuning to encourage concise Python snippets for deterministic computation, executes those snippets in a constrained sandbox, and reintegrates the results into the reasoning process. Evaluation on MATH500, AIME, HMMT, and HLE reports shorter outputs and often improved accuracy.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.