# From Noise to Diversity: Random Embedding Injection in LLM Reasoning

DevFeed: [From Noise to Diversity: Random Embedding Injection in LLM Reasoning](<https://devfeed.tech/articles/from-noise-to-diversity-random-embedding-injection-in-llm-reasoning-131912.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2605.11936>)

Author: Heejun Kim, Seungpil Lee, Jewon Yeom, Jaewon Sok, Seonghyeon Park, Jeongjae Park, Taesup Kim, Sundong Kim

Published: 2026-11-13T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [Parallel reasoning](<https://devfeed.tech/topics/parallel-reasoning.md>), [prompt](<https://devfeed.tech/topics/prompt.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Temperature settings in AI](<https://devfeed.tech/topics/temperature-settings-in-ai.md>), [grpo](<https://devfeed.tech/topics/grpo.md>)

Tags: [attention](<https://devfeed.tech/tags/attention.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [diversity](<https://devfeed.tech/tags/diversity.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [inference](<https://devfeed.tech/tags/inference.md>), [llm](<https://devfeed.tech/tags/llm.md>), [noise](<https://devfeed.tech/tags/noise.md>), [prompt](<https://devfeed.tech/tags/prompt.md>), [random](<https://devfeed.tech/tags/random.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [sampling](<https://devfeed.tech/tags/sampling.md>), [training](<https://devfeed.tech/tags/training.md>)

## AI overview

Random Soft Prompts (RSPs) append a freshly sampled sequence of random embedding vectors to an LLM input, avoiding prompt training while reaching accuracy comparable to optimized soft prompts on math reasoning benchmarks in several settings. The vectors are drawn from an isotropic Gaussian fitted to the pretrained embedding table's entrywise mean and variance. The authors propose that attention to the unfamiliar positions flattens the distribution over early generated tokens, branching reasoning trajectories; that effect then dilutes as generation continues. At inference, RSPs increase early token diversity and, with temperature sampling, widen Pass@N--the chance that at least one of N attempts is correct. The authors also report practical gains when applying the effect in DAPO training. The supplied text does not specify benchmark names or numerical results.

## Source excerpt

arXiv:2605.11936v3 Announce Type: replace Abstract: Recent soft prompt research has tried to improve reasoning by inserting trained vectors into LLM inputs, yet whether the gain comes from the learned content or from the act of injection itself has not been carefully separated. We study Random Soft Prompts (RSPs), which drop the training step entirely and append a freshly drawn sequence of random embedding vectors to the input. Each RSP vector is sampled from an isotropic Gaussian fitted to the entrywise mean and variance of the pretrained embedding table; the sequence carries no learned content, and yet reaches accuracy comparable to optimized soft prompts on math reasoning benchmarks in several settings. The mechanism unfolds in two stages: because attention has to absorb a never-seen-before random position, the distribution over the first few generated tokens flattens and reasoning trajectories branch, and as generation continues this influence dilutes naturally so the response commits to a single completion. We show that during inference RSPs lift early-stage token diversity and, combined with temperature sampling, widen Pass@N, the probability that at least one out of N attempts is correct. Beyond inference, we carry the same effect into DAPO training and demonstrate practical gains. Our contributions are: (i) RSP isolates the simplest form of soft prompt -- training-free, freshly resampled -- providing a unified lens for the structural effect of injection that variants otherwise differing in training and form all share; (ii) a theoretical and empirical validation of the underlying mechanism; and (iii) an extension from inference to training.