# FlowTranslator: Training-Free In-Image Machine Translation with Flow-Based Editing

DevFeed: [FlowTranslator: Training-Free In-Image Machine Translation with Flow-Based Editing](<https://devfeed.tech/articles/flowtranslator-training-free-in-image-machine-translation-with-flow-based-editing-117461.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.04303>)

Author: Zhixian Li, Xingsong Ye, Yongkun Du, Yunyan Xiao, Yanglin Huang, Pinxuan Chen, Jiyu Zhuang, Cong Xu, Zhineng Chen

Published: 2026-11-04T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [machine-translation](<https://devfeed.tech/topics/machine-translation.md>), [image editing](<https://devfeed.tech/topics/image-editing.md>), [ai-image-generator](<https://devfeed.tech/topics/ai-image-generator.md>), [Image](<https://devfeed.tech/topics/image.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>)

Tags: [bleu](<https://devfeed.tech/tags/bleu.md>), [comet](<https://devfeed.tech/tags/comet.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [diffusion](<https://devfeed.tech/tags/diffusion.md>), [flow](<https://devfeed.tech/tags/flow.md>), [free](<https://devfeed.tech/tags/free.md>), [image](<https://devfeed.tech/tags/image.md>), [llm](<https://devfeed.tech/tags/llm.md>), [machine-translation](<https://devfeed.tech/tags/machine-translation.md>), [ocr](<https://devfeed.tech/tags/ocr.md>), [prim](<https://devfeed.tech/tags/prim.md>), [text-to-image](<https://devfeed.tech/tags/text-to-image.md>), [training](<https://devfeed.tech/tags/training.md>), [translation](<https://devfeed.tech/tags/translation.md>)

## AI overview

FlowTranslator performs in-image machine translation without task-specific training: an OCR model and an LLM create a translation prompt for a text-to-image diffusion model, with Region Coupling Release altering noise within the text region early in generation and Coupling Expansion amplifying the edit mid-trajectory. Under EasyOCR read-back, it reports average PRIM BLEU of 20.6 and COMET of 57.2, substantially outperforming the training-based UniTranslator baseline. On whole-image ScenePair photographs translated into Chinese, it reports 40.1% exact-match accuracy and surpasses existing editing systems, some of which handle only text rendering rather than the complete translation task. These are abstract-reported results; no evaluation details beyond those stated are provided.

## Source excerpt

arXiv:2611.04303v1 Announce Type: cross Abstract: In-image machine translation (IIMT) replaces text in an image with its translation while preserving the surrounding visual context. Existing task-specific models achieve convincing performance but require massive paired training images before and after translation. As advanced text-to-image (T2I) models have reached a practically usable level of multilingual text generation, we argue that this capability can be transferred to IIMT and present FlowTranslator. It is a training-free IIMT framework that first employs an OCR model and an LLM to generate the translation prompt, which is injected into the T2I-based diffusion model. To optimize the accurate and natural generation of translated text, we introduce two trajectory controls: Region Coupling Release (RCR) partially decorrelates target-branch noise inside the text region early in the trajectory, while Coupling Expansion (CE) amplifies the emerging edit displacement mid-trajectory. Under the EasyOCR read-back protocol, FlowTranslator achieves average PRIM BLEU and COMET scores of 20.6 and 57.2, respectively, substantially outperforming the strong training-based baseline UniTranslator. On the more challenging and realistic whole-image ScenePair photographs translated into Chinese, it reaches 40.1\% exact-match accuracy and surpasses existing editing systems, some of which only address the text-rendering stage rather than the complete IIMT task. These results establish flow-based editing as a strong, fully training-free baseline for IIMT.