# From Images to Grounded Edits: A Real-World Benchmark for Chinese Grammatical Error Correction in Handwritten Essays

DevFeed: [From Images to Grounded Edits: A Real-World Benchmark for Chinese Grammatical Error Correction in Handwritten Essays](<https://devfeed.tech/articles/from-images-to-grounded-edits-a-real-world-benchmark-for-chinese-grammatical-error-correction-in-handwritten-essays-135156.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.17966>)

Author: Weiru Zhang, Yuzhong Hong, Junwei Bao, Lemao Liu, Dejing Dou

Published: 2026-11-16T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Computer vision](<https://devfeed.tech/topics/computer-vision.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [object-detection](<https://devfeed.tech/topics/object-detection.md>), [Multi Agent Systems](<https://devfeed.tech/topics/multi-agent-systems.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [ai-assisted](<https://devfeed.tech/tags/ai-assisted.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [annotations](<https://devfeed.tech/tags/annotations.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [detection](<https://devfeed.tech/tags/detection.md>), [digital](<https://devfeed.tech/tags/digital.md>), [discovery](<https://devfeed.tech/tags/discovery.md>), [education](<https://devfeed.tech/tags/education.md>), [error-correction](<https://devfeed.tech/tags/error-correction.md>), [essay](<https://devfeed.tech/tags/essay.md>), [essays](<https://devfeed.tech/tags/essays.md>), [eval](<https://devfeed.tech/tags/eval.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [grounded](<https://devfeed.tech/tags/grounded.md>), [grounding](<https://devfeed.tech/tags/grounding.md>), [images](<https://devfeed.tech/tags/images.md>), [real-world](<https://devfeed.tech/tags/real-world.md>)

## AI overview

The benchmark reframes Chinese grammatical error correction for handwritten essays as an image-to-grounded-edit task: systems must identify corrections and locate them on essay images. G-CGEC-Eval contains real K-12 Chinese essay images with fine-grained annotations and uses adapted IoU metrics alongside a more tolerant center-distance measure. In the reported evaluations, direct single-pass vision-language models performed poorly, while pipelines and agentic workflows using OCR and character grounding improved results. An error-type-based multi-agent workflow performed best among the tested approaches. The task remains unsolved, with linguistic error discovery and character-level grounding identified as key bottlenecks.

## Source excerpt

arXiv:2611.17966v1 Announce Type: cross Abstract: Chinese Grammatical Error Correction (CGEC) is typically formulated as a text-to-text problem. While suitable for digital texts, this formulation falls short in real-world K-12 education, where AI-assisted corrections are expected directly on essay images, which are primarily handwritten and exhibit many irregularities. To bridge this gap, we introduce Grounded Chinese Grammatical Error Correction (G-CGEC), an image-to-grounded-edit task requiring systems to predict both corrections and their positions on essay images. We propose G-CGEC-Eval, a benchmark comprising real-world images of K-12 Chinese essays with fine-grained annotations. For evaluation, we adapt IoU-based metrics from object detection and propose a more tolerant alternative based on center-distance matching. Using this benchmark, we evaluate open-source and proprietary vision-language models under a direct single-pass setting, as well as settings with auxiliary components (OCR and character grounding) coordinated via pipelining or agentic harnessing. Results show that even top-tier proprietary models perform surprisingly poorly in the single-pass setting, while pipelining and agentic harnessing yield meaningful improvements. Notably, an error-type-based multi-agent workflow achieves the best performance, establishing it as the strongest baseline for future G-CGEC research. Through ablations and fine-grained analysis, we find the task remains far from solved, with linguistic error discovery and character-level grounding as the primary bottlenecks. This underscores the need for models that better integrate visual perception with linguistic reasoning and visual grounding.