# Learning Anisotropic Prediction Targets for Flow Models

DevFeed: [Learning Anisotropic Prediction Targets for Flow Models](<https://devfeed.tech/articles/learning-anisotropic-prediction-targets-for-flow-models-135825.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.17767>)

Author: Rayhan Zirvi, Hansheng Chen, Gordon Wetzstein, Leonidas Guibas

Published: 2026-11-16T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [ai-image-generator](<https://devfeed.tech/topics/ai-image-generator.md>), [Model Development](<https://devfeed.tech/topics/model-development.md>), [ImageNet](<https://devfeed.tech/topics/imagenet.md>)

Tags: [alignment](<https://devfeed.tech/tags/alignment.md>), [analyze](<https://devfeed.tech/tags/analyze.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [artifacts](<https://devfeed.tech/tags/artifacts.md>), [better](<https://devfeed.tech/tags/better.md>), [changes](<https://devfeed.tech/tags/changes.md>), [choice](<https://devfeed.tech/tags/choice.md>), [component](<https://devfeed.tech/tags/component.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [data](<https://devfeed.tech/tags/data.md>), [easier](<https://devfeed.tech/tags/easier.md>), [error](<https://devfeed.tech/tags/error.md>), [fixed](<https://devfeed.tech/tags/fixed.md>), [flow](<https://devfeed.tech/tags/flow.md>), [flow-matching](<https://devfeed.tech/tags/flow-matching.md>), [generation](<https://devfeed.tech/tags/generation.md>), [generative](<https://devfeed.tech/tags/generative.md>), [generative-models](<https://devfeed.tech/tags/generative-models.md>), [learning](<https://devfeed.tech/tags/learning.md>), [models](<https://devfeed.tech/tags/models.md>), [prediction](<https://devfeed.tech/tags/prediction.md>)

## AI overview

AnisoFlow learns the flow model's prediction target by assigning nonnegative noise weights to directions in a jointly learned basis. A closed-form map exactly recovers velocity, so the architecture, flow-matching loss, and sampler remain unchanged while training chooses a target that is easier to predict. The analysis predicts that preferred directional weights scale near-linearly with data variance, consistent with learned pixel-space weights. On ImageNet 256x256, the method improves FID from 1.90 to 1.55 over the JiT baseline without representation alignment or architectural changes. For pixel-space text-to-image generation, the abstract reports improved image quality and fewer patch-seam artifacts under reduced-precision inference, attributed to better-conditioned velocity recovery.

## Source excerpt

arXiv:2611.17767v1 Announce Type: cross Abstract: Flow-based generative models are trained on a hand-chosen prediction target, such as the velocity, the noise, or the clean data. This choice strongly affects training and sample quality. We introduce Anisotropic Flow Models (AnisoFlow), which replaces a fixed prediction target with a fully learnable one. AnisoFlow learns to scale the noise component of the target anisotropically, assigning a separate nonnegative weight to each direction in a jointly learned basis. A closed-form map recovers the velocity from the network's prediction, leaving the architecture, flow-matching loss, and sampler unchanged. Since recovery is exact, training optimizes the target purely to make it easier for the network to predict. We theoretically analyze the resulting prediction error and predict that the preferred noise weight in each direction scales near-linearly with data variance, in agreement with the weights learned empirically in pixel space. AnisoFlow improves FID from 1.90 to 1.55 over the JiT baseline on ImageNet 256$\times$256, by learning only the prediction target, without representation alignment or architectural changes. In pixel-space text-to-image generation, AnisoFlow improves image quality and, through better-conditioned velocity recovery, largely removes patch-seam artifacts under reduced-precision inference.