# Consistent Video-to-Video Translation via Explicit Correspondences

DevFeed: [Consistent Video-to-Video Translation via Explicit Correspondences](<https://devfeed.tech/articles/consistent-video-to-video-translation-via-explicit-correspondences-132330.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.17298>)

Author: Gaurav Parmar, Zhengqi Li, Richard Zhang, Jun-Yan Zhu, Srinivasa Narasimhan, Eli Shechtman, Yotam Nitzan

Published: 2026-11-13T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [multimodal-ai](<https://devfeed.tech/topics/multimodal-ai.md>), [generative-ai-tools](<https://devfeed.tech/topics/generative-ai-tools.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [applications](<https://devfeed.tech/tags/applications.md>), [approach](<https://devfeed.tech/tags/approach.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [attention](<https://devfeed.tech/tags/attention.md>), [based](<https://devfeed.tech/tags/based.md>), [compute](<https://devfeed.tech/tags/compute.md>), [condition](<https://devfeed.tech/tags/condition.md>), [consistency](<https://devfeed.tech/tags/consistency.md>), [context](<https://devfeed.tech/tags/context.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [cross](<https://devfeed.tech/tags/cross.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-gr](<https://devfeed.tech/tags/cs-gr.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [falls](<https://devfeed.tech/tags/falls.md>), [fixed](<https://devfeed.tech/tags/fixed.md>), [frame](<https://devfeed.tech/tags/frame.md>), [generation](<https://devfeed.tech/tags/generation.md>), [history](<https://devfeed.tech/tags/history.md>), [translation](<https://devfeed.tech/tags/translation.md>), [video](<https://devfeed.tech/tags/video.md>)

## AI overview

vid2vid-long aims to improve long-range consistency in real-time video-to-video translation, where fixed-length causal attention can lose relevant history. It finds patch-level correspondences in the input video, uses them to retrieve previously generated output patches from matching regions, and conditions generation on those patches through correspondence cross-attention. The excerpt reports improved long-range temporal consistency across recent video models while preserving generation quality and real-time performance; it provides no experimental details or quantitative results.

## Source excerpt

arXiv:2611.17298v1 Announce Type: cross Abstract: Interactive video-to-video applications require real-time generation while maintaining long-range temporal consistency. However, recent methods achieve speed by restricting attention to a fixed-length causal window. This limits long-range consistency whenever relevant history falls outside the context window. To address this limitation, we introduce vid2vid-long, a correspondence-based approach grounded in a simple observation. Video-to-video translation provides an explicit cross-frame reference: the regions that match in the input video should match in the output video too. Concretely, we compute patch-level correspondences in the input, guiding retrieval of previously generated outputs in the corresponding regions, and condition the model on these patches through correspondence cross-attention. Our experiments demonstrate that vid2vid-long consistently improves long-range temporal consistency across recent video models while preserving generation quality and real-time performance.