# wan-2-1

Published articles for wan-2-1.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Consistent Generative Video: Building Video Models That Remember

DevFeed: [Consistent Generative Video: Building Video Models That Remember](<https://devfeed.tech/articles/consistent-generative-video-building-video-models-that-remember-77966.md>)

Original publisher: [Read original article](<https://blog.hotstar.com/getting-past-the-first-frame-building-video-models-that-remember-31f03d0710e1?source=rss----dbc3fcbc7f07---4>)

Author: Yaswanth Karnati

Published: 2026-07-01T06:53:14Z

Content type: article

Language: en

Sources: [JioHotstar](<https://devfeed.tech/sources/jiohotstar.md>)

Topics: [lora](<https://devfeed.tech/topics/lora.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Generative AI](<https://devfeed.tech/topics/generative-ai.md>), [Advanced AI workflows](<https://devfeed.tech/topics/advanced-ai-workflows.md>), [multimodal-ai](<https://devfeed.tech/topics/multimodal-ai.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>)

Tags: [0-1](<https://devfeed.tech/tags/0-1.md>), [audio](<https://devfeed.tech/tags/audio.md>), [challenges](<https://devfeed.tech/tags/challenges.md>), [consistency](<https://devfeed.tech/tags/consistency.md>), [data](<https://devfeed.tech/tags/data.md>), [diffusion](<https://devfeed.tech/tags/diffusion.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [generative-video](<https://devfeed.tech/tags/generative-video.md>), [identity](<https://devfeed.tech/tags/identity.md>), [ip](<https://devfeed.tech/tags/ip.md>), [lora](<https://devfeed.tech/tags/lora.md>), [ltx](<https://devfeed.tech/tags/ltx.md>), [models](<https://devfeed.tech/tags/models.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [production](<https://devfeed.tech/tags/production.md>), [video](<https://devfeed.tech/tags/video.md>), [wan-2-1](<https://devfeed.tech/tags/wan-2-1.md>)

### AI overview

The excerpt describes a LoRA pipeline for generating talking-head videos of catalog characters from a reference image and audio. LoRA freezes base weights and adds small character adapters (about 400 MB at rank 32, versus a 41 GB model), which can be swapped without reloading the base. Training data is divided into scenes, filtered for the target face, balanced by shot type, captioned with a character trigger, and precomputed into latents and text embeddings; face retrieval achieved about 85% recall. Wan 2.1's single-stage adapter produced robotic motion and identity drift; three-stage training and inference tuning improved results but left lip-sync and motion below production needs. LTX-2 worked with a simpler single-stage adapter and showed better identity retention, lip-sync, motion, and generalization to unseen scenes. Its best checkpoints typically fell at 6k-9k steps, while later training risked memorizing poses. Veo 3.1 and Kling 3.0 were compared without LoRA because they do not support adapter injection, limiting their use for reusable character-specific generation.

### Source excerpt

Introduction Generative AI offers a path to content creation at speeds and scales that traditional pipelines cannot match. One high-value use case: making existing IP characters-sports presenters, show hosts, brand ambassadors -deliver new scripts in their own likeness, without a reshoot, within IP & contract limitations. The premise is simple: take a reference image, provide audio, and generate a video where the character speaks naturally. In practice, this is harder than it sounds. Base proprietary video models like Kling, Veo often struggle with lip-sync quality, identity drift, and motion consistency. To address this, we built a production pipeline for character-consistent talking-head generation using LoRA (Low-Rank Adaptation), a lightweight fine-tuning method that adapts a base model to a specific character without retraining the entire network. This makes character adaptation practical to train, store, and deploy across multiple IP characters at scale. Why LoRA? LoRA works by freezing the original model weights and injecting small, trainable low-rank matrices into specific layers. Instead of updating a weight matrix W directly, LoRA decomposes the update into two smaller matrices: ΔW = A x B, where A and B have a rank r far smaller than the original dimensions. For rank 32 (our configuration), each adapted layer gains only ~0.1% additional parameters-producing a ~400MB adapter file vs. 41GB for the full model. Multiple character adapters can be swapped at inference without reloading the base model. LoRA is well-established for image generation, but video introduces harder challenges: the adapter must preserve identity across dozens of frames (not just one), motion and structure are entangled across diffusion noise levels, and video LoRAs train on far fewer samples (15-20 clips vs. hundreds of images), making overfitting the dominant risk. This blog covers how we fine-tuned two video architectures-Wan 2.1 and LTX-2-with LoRA, the data preparation that made it