# Trajectory-Regularized Distribution Distillation for One-Step Generation

DevFeed: [Trajectory-Regularized Distribution Distillation for One-Step Generation](<https://devfeed.tech/articles/trajectory-regularized-distribution-distillation-for-one-step-generation-128223.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.12978>)

Author: An Zhao, Yixiang Zhou, Zejian Li, Yi Guo, Pei Chen, Lingyun Sun

Published: 2026-11-11T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Post-training optimization](<https://devfeed.tech/topics/post-training-optimization.md>), [stable-diffusion](<https://devfeed.tech/topics/stable-diffusion.md>)

Tags: [3](<https://devfeed.tech/tags/3.md>), [abstract](<https://devfeed.tech/tags/abstract.md>), [alignment](<https://devfeed.tech/tags/alignment.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [but](<https://devfeed.tech/tags/but.md>), [combines](<https://devfeed.tech/tags/combines.md>), [consistency](<https://devfeed.tech/tags/consistency.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [diffusion](<https://devfeed.tech/tags/diffusion.md>), [distillation](<https://devfeed.tech/tags/distillation.md>), [distilling](<https://devfeed.tech/tags/distilling.md>), [distribution](<https://devfeed.tech/tags/distribution.md>), [diversity](<https://devfeed.tech/tags/diversity.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [estimator](<https://devfeed.tech/tags/estimator.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [field](<https://devfeed.tech/tags/field.md>), [flow](<https://devfeed.tech/tags/flow.md>), [flow-matching](<https://devfeed.tech/tags/flow-matching.md>), [generation](<https://devfeed.tech/tags/generation.md>), [one](<https://devfeed.tech/tags/one.md>)

## AI overview

Trajectory-Regularized Distribution Distillation (TRD) combines trajectory supervision from a teacher's probability-flow ODE with direct distribution-level optimization. Its momentum-mixture policy is predicted in one student forward pass and serves as the generator, an estimator of the student's marginal velocity, and a time-dependent velocity field for trajectory supervision--avoiding the separate trainable score-tracking network typically used for distribution matching. On SANA-1.6B and Stable Diffusion 3.5, the authors report better generation quality and training efficiency than representative consistency and distribution-matching baselines for one-step and few-step generation, with a trade-off in sample diversity.

## Source excerpt

arXiv:2611.12978v1 Announce Type: cross Abstract: Distilling flow matching models for one-step generation generally follows two paradigms. Trajectory alignment supervises the student with the teacher's probability flow ODE, but its performance degrades under very small sampling budgets. Distribution matching directly optimizes the generated distribution, but estimating its reverse Kullback-Leibler gradient typically requires a separate network to track the evolving student score. We propose trajectory-regularized distribution distillation (TRD), which combines distribution-level and trajectory-level supervision through a momentum-mixture policy predicted in a single student forward pass. This policy serves simultaneously as a one-step generator, an estimator of the student's marginal velocity that removes the need for a second trainable network in distribution matching, and a closed-form time-dependent velocity field supervised along the teacher ODE trajectory. Experiments on SANA-1.6B and Stable Diffusion 3.5 show that TRD outperforms representative consistency and distribution matching baselines in generation quality and training efficiency for both one-step and few-step generation, with a trade-off in sample diversity.