# VeV: Video-Enhanced Vibration Data Augmentation For Structural Difference

DevFeed: [VeV: Video-Enhanced Vibration Data Augmentation For Structural Difference](<https://devfeed.tech/articles/vev-video-enhanced-vibration-data-augmentation-for-structural-difference-125906.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.10257>)

Author: Joonhee Lee, Jiale Zhang, Sungmin Lee, Ruiqing Wang, Jeffrey Shulkin, Yiwen Dong, Pei Zhang, JeongGil Ko

Published: 2026-11-10T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [data augmentation](<https://devfeed.tech/topics/data-augmentation.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [ambient-intelligence](<https://devfeed.tech/tags/ambient-intelligence.md>), [classification](<https://devfeed.tech/tags/classification.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-hc](<https://devfeed.tech/tags/cs-hc.md>), [data-augmentation](<https://devfeed.tech/tags/data-augmentation.md>), [digital-twins](<https://devfeed.tech/tags/digital-twins.md>), [farm](<https://devfeed.tech/tags/farm.md>), [sensing](<https://devfeed.tech/tags/sensing.md>), [sensor](<https://devfeed.tech/tags/sensor.md>), [sim-to-real](<https://devfeed.tech/tags/sim-to-real.md>), [spatial](<https://devfeed.tech/tags/spatial.md>), [structure](<https://devfeed.tech/tags/structure.md>), [video](<https://devfeed.tech/tags/video.md>)

## AI overview

VeV synthesizes vibration responses at unmeasured structural locations from sparse sensor observations, using monocular video to map possible wave-guiding paths and visual features to represent transient sources and material dynamics. On 1,237 sensor-hours from a sow and piglet farm spanning different structures, it reportedly reduced waveform reconstruction MSE by over 57.5% versus data-driven baselines and reached up to 81.69% zero-shot classification accuracy. The abstract says peak performance required 30-50 calibration chunks; results are reported for this farm evaluation.

## Source excerpt

arXiv:2611.10257v1 Announce Type: cross Abstract: Surface-mounted vibration sensing provides non-invasive structural monitoring with high temporal fidelity across diverse ubiquitous computing scenarios such as smart farms, yet structure-borne wave models remain fragile to physical relocation and structural shifts. However, addressing this spatial data discontinuity remains limited by costly manual recalibration, insufficient physical grounding in data-driven synthesis, and substantial sim-to-real gaps in numerical digital twins. To resolve this spatial bottleneck without labor-intensive data recollection, we propose VeV, a physics-consistent spatial augmentation framework that synthesizes vibration responses at unmeasured target coordinates from sparse reference observations by coupling a monocular Vision-Derived Propagation Possibility Map for structural wave-guiding paths with a Visual Feature Map for transient source kinetics and implicit material dynamics. Evaluated on a 1,237 sensor-hour sow pig and piglet farm across disparate structures, VeV reduces waveform reconstruction MSE by over 57.5% compared to data-driven baselines and achieves up to 81.69% zero-shot classification accuracy, while reaching peak performance within just 30-50 calibration chunks to effectively eliminate cold-start retraining overhead and establish a scalable foundation extending to human-centric floor vibration sensing and ambient intelligence.