# Trajectory as the Teacher: Few-Step Discrete Flow Matching via Energy-Navigated Distillation

DevFeed: [Trajectory as the Teacher: Few-Step Discrete Flow Matching via Energy-Navigated Distillation](<https://devfeed.tech/articles/trajectory-as-the-teacher-few-step-discrete-flow-matching-via-energy-navigated-distillation-31491.md>)

Original publisher: [Read original article](<https://machinelearning.apple.com/research/trajectory-teacher-flow-matching>)

Published: 2026-09-16T00:00:00Z

Content type: article

Language: en

Sources: [Apple Machine Learning Research](<https://devfeed.tech/sources/apple-machine-learning-research.md>)

Topics: [text-generation](<https://devfeed.tech/topics/text-generation.md>), [Algorithms](<https://devfeed.tech/topics/algorithms.md>), [Language models](<https://devfeed.tech/topics/language-models.md>), [Inference](<https://devfeed.tech/topics/inference.md>)

Tags: [inference](<https://devfeed.tech/tags/inference.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [performance](<https://devfeed.tech/tags/performance.md>), [perplexity](<https://devfeed.tech/tags/perplexity.md>), [research](<https://devfeed.tech/tags/research.md>), [text-generation](<https://devfeed.tech/tags/text-generation.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

## AI overview

The article introduces Trajectory-Shaped Discrete Flow Matching, a training method that guides intermediate trajectory decisions with an energy-based coherence measure. The authors argue that poor distillation trajectories, rather than insufficient student capacity, limit few-step generation. On a 170M-parameter language-modeling task, an 8-step student reportedly achieves lower perplexity than a 1,024-step teacher while reducing inference steps.

## Source excerpt

Discrete flow matching generates text by iteratively transforming noise tokens into coherent language, but may require hundreds of forward passes. Distillation uses the multi-step trajectory to train a student to reproduce the process in a few steps. When the student underperforms, the usual explanation is insufficient capacity. We argue the opposite: the trajectory is the bottleneck, not the student. Each training trajectory is built through a chain of blind stochastic jumps with no evaluation of sequence quality; a single bad decision at an early midpoint propagates through subsequent steps...