# Spatial Harness: Grounding Spatial Reasoning in Executable World States with Physics Engines

DevFeed: [Spatial Harness: Grounding Spatial Reasoning in Executable World States with Physics Engines](<https://devfeed.tech/articles/spatial-harness-grounding-spatial-reasoning-in-executable-world-states-with-physics-engines-125365.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.11344>)

Author: Chentao Cao, Zhanke Zhou, Sangni Duan, Bo Han, Hang Li

Published: 2026-11-10T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Machine Perception](<https://devfeed.tech/topics/machine-perception.md>), [Computer vision](<https://devfeed.tech/topics/computer-vision.md>), [3D](<https://devfeed.tech/topics/3d.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>)

Tags: [camera](<https://devfeed.tech/tags/camera.md>), [code](<https://devfeed.tech/tags/code.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [physics](<https://devfeed.tech/tags/physics.md>), [qwen3-5](<https://devfeed.tech/tags/qwen3-5.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [spatial](<https://devfeed.tech/tags/spatial.md>), [spatial-reasoning](<https://devfeed.tech/tags/spatial-reasoning.md>), [vision](<https://devfeed.tech/tags/vision.md>), [vision-language-models](<https://devfeed.tech/tags/vision-language-models.md>), [vision-language-models-vlms](<https://devfeed.tech/tags/vision-language-models-vlms.md>), [vlms](<https://devfeed.tech/tags/vlms.md>), [world](<https://devfeed.tech/tags/world.md>)

## AI overview

Spatial Harness grounds spatial reasoning in an executable scene state: a Perceiver combines question-derived constraints with visual estimates to place objects and cameras in a shared coordinate frame, then a Reasoner uses physics-engine measurements and rendered views while executing viewpoint changes. Across four named benchmarks, the system was evaluated with open- and closed-weight VLMs. On MindCube, it raised Qwen3.5-27B accuracy from 52.70% to 71.14%, 7.52 percentage points above pySpatial. With identical annotated object and camera poses, it achieved 98.25%, compared with 71.81% for model-internal reasoning. These figures are reported for the stated MindCube conditions.

## Source excerpt

arXiv:2611.11344v1 Announce Type: new Abstract: Spatial reasoning requires understanding how objects and observers are arranged in a scene and how their relations change with viewpoint or movement. Vision-language models (VLMs) typically perform both steps through model-internal reasoning, forming an implicit scene interpretation from partial views and imagining the consequences of spatial transformations. A misread scene can lead to a wrong answer, while even a correct interpretation does not ensure that imagined transformations satisfy spatial constraints. We introduce Spatial Harness, which represents scenes as explicit and executable world states to ground spatial reasoning in physics-engine feedback. A Perceiver integrates scene constraints extracted from the question with specialized visual estimates to place objects and cameras in a shared coordinate frame. The resulting state is instantiated in a physics engine, where a Reasoner executes viewpoint changes and uses computed measurements and rendered views to guide reasoning. We evaluate on MindCube, SAT, MMSI-Bench, and SpatialRGPT-Bench with open- and closed-weight VLMs. On MindCube, Spatial Harness improves Qwen3.5-27B from 52.70% to 71.14%, surpassing pySpatial by 7.52 percentage points. Given identical annotated object and camera poses, it reaches 98.25% versus 71.81% for model-internal reasoning. Code is publicly available at: https://github.com/tmlr-group/Spatial-Harness