# robot sense of touch

Robotics discipline concerned with tactile sensing and force feedback for robot perception and manipulation.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## TipDex-VTLA: Learning When to Refine Actions with Touch for Dexterous Manipulation

DevFeed: [TipDex-VTLA: Learning When to Refine Actions with Touch for Dexterous Manipulation](<https://devfeed.tech/articles/tipdex-vtla-learning-when-to-refine-actions-with-touch-for-dexterous-manipulation-145571.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25683>)

Author: Xudi Ge, Yepeng Liu, Haifeng Liu, Enze Shi, Liangqi Zhang, Yongchao Xu

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>)

Tags: [benchmark](<https://devfeed.tech/tags/benchmark.md>), [code](<https://devfeed.tech/tags/code.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [drift](<https://devfeed.tech/tags/drift.md>), [execution](<https://devfeed.tech/tags/execution.md>), [feature](<https://devfeed.tech/tags/feature.md>), [feedback](<https://devfeed.tech/tags/feedback.md>), [forecast](<https://devfeed.tech/tags/forecast.md>), [gate](<https://devfeed.tech/tags/gate.md>), [language](<https://devfeed.tech/tags/language.md>), [learning](<https://devfeed.tech/tags/learning.md>), [lighting](<https://devfeed.tech/tags/lighting.md>), [manipulation](<https://devfeed.tech/tags/manipulation.md>), [policies](<https://devfeed.tech/tags/policies.md>), [real-world](<https://devfeed.tech/tags/real-world.md>), [reference](<https://devfeed.tech/tags/reference.md>), [reliability](<https://devfeed.tech/tags/reliability.md>), [simulation](<https://devfeed.tech/tags/simulation.md>), [source-code](<https://devfeed.tech/tags/source-code.md>), [state](<https://devfeed.tech/tags/state.md>), [tasks](<https://devfeed.tech/tags/tasks.md>)

### AI overview

TipDex-VTLA aims to reduce action drift when lighting changes by deciding when tactile feedback should refine dexterous manipulation actions. Its VASE component estimates visual reliability from a frozen reference policy's sensitivity to illumination changes; TACE compares predicted and measured touch at matched times, then combines the discrepancy with visual reliability to gate bounded feature corrections for actions not yet executed. Trained on data collected under normal visual conditions, it achieved average full-task success rates of 87.5% under normal lighting and 73.8% under challenging unseen lighting across four real-world tasks, and was also evaluated on the UniVTAC simulation benchmark. The excerpt reports outperforming some state-of-the-art methods but gives no specific comparator results.

### Source excerpt

arXiv:2611.25683v1 Announce Type: cross Abstract: Changes in illumination can induce action drift in dexterous manipulation even when the physical state remains unchanged. Although existing vision--tactile--language--action (VTLA) policies incorporate tactile feedback, when and how touch refines actions under changing visual conditions remains challenging. We introduce \textbf{TipDex-VTLA}, a VTLA policy that combines estimated visual action reliability and tactile forecast verification to regulate execution-time refinement. Specifically, Visual Action Sensitivity Estimation (VASE) learns visual reliability from a frozen reference policy's action sensitivity to illumination perturbations. Tactile Anticipation and Correction during Execution (TACE) compares predicted and measured touch at matched times and combines the resulting discrepancy with visual reliability to gate bounded feature corrections for unexecuted actions. This effectively helps to refine actions under challenging unseen visual conditions. We evaluate TipDex-VTLA on four real-world dexterous manipulation tasks and the UniVTAC simulation benchmark. TipDex-VTLA trained on data collected under normal visual conditions, achieves average full-task success rates of 87.5% (resp. 73.8%) under normal (resp. challenging unseen) lighting in real-world tasks, significantly outperforming some state-of-the-art methods. We will release the collected data and source code.

## Perception into Imagination: Executable Memory for World Models

DevFeed: [Perception into Imagination: Executable Memory for World Models](<https://devfeed.tech/articles/perception-into-imagination-executable-memory-for-world-models-140004.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22294>)

Author: Xianyao Li, Ruitong Tian, Rui Min, Fang Xu, Jing Du

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [World models](<https://devfeed.tech/topics/world-models.md>), [Physical AI](<https://devfeed.tech/topics/physical-ai.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>)

Tags: [actions](<https://devfeed.tech/tags/actions.md>), [control](<https://devfeed.tech/tags/control.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [imagination](<https://devfeed.tech/tags/imagination.md>), [learning](<https://devfeed.tech/tags/learning.md>), [memory](<https://devfeed.tech/tags/memory.md>), [model](<https://devfeed.tech/tags/model.md>), [motion](<https://devfeed.tech/tags/motion.md>), [neural](<https://devfeed.tech/tags/neural.md>), [physical-ai](<https://devfeed.tech/tags/physical-ai.md>), [policy](<https://devfeed.tech/tags/policy.md>), [prediction](<https://devfeed.tech/tags/prediction.md>), [recovery](<https://devfeed.tech/tags/recovery.md>), [retention](<https://devfeed.tech/tags/retention.md>), [reward](<https://devfeed.tech/tags/reward.md>), [state](<https://devfeed.tech/tags/state.md>), [training](<https://devfeed.tech/tags/training.md>), [value](<https://devfeed.tech/tags/value.md>), [visibility](<https://devfeed.tech/tags/visibility.md>), [world-model](<https://devfeed.tech/tags/world-model.md>), [world-models](<https://devfeed.tech/tags/world-models.md>)

### AI overview

Executable perceptual memory (EPM) carries explicit perceptual state forward alongside neural latent dynamics during imagined action, so remembered facts can inform reward prediction, value estimation, and policy learning. The method aligns reward inputs with the transitions that produced them and trains the reward head on open-loop rollouts of recorded actions. On Memory Maze 13x13, it reports 30.37 return after 1M interactions, versus 23.37 when the evolving read-out informs only policy and value on the same perceptual front end (gain 7.00 [3.80, 10.21]). The abstract also reports improved control on 9x9 and MiniWorld, and stronger reward anticipation for remembered out-of-view arrivals in both visual implementations. Tactile and concentration experiments are described as showing complementary roles for remembered facts; the excerpt gives no further methodological detail.

### Source excerpt

arXiv:2611.22294v1 Announce Type: cross Abstract: Physical agents must use what they previously saw or touched after visibility or contact is lost. Their actions change the implications of these remembered facts. We introduce executable perceptual memory (EPM), a world-model framework that advances explicit perceptual state alongside neural latent dynamics during imagination. Its evolving read-out informs reward prediction, value estimation and policy learning. We align reward inputs with the transitions that produced them and supervise the reward head on open-loop rollouts of recorded actions. On Memory Maze $13\times13$, EPM reaches 30.37 return at 1M interactions, compared with 23.37 when the same evolving read-out informs only policy and value on a common perceptual front end: a gain of 7.00 [3.80, 10.21]. The complete method also improves control on $9\times9$ and in MiniWorld. Probes of remembered, out-of-view arrivals show stronger reward anticipation in both visual implementations. Concentration, tactile recovery and real tactile frames demonstrate complementary roles of remembered facts in imagined-policy training, motion-dependent decisions and sensory-content retention. EPM connects persistent perception to the predicted consequences and learning signals of a world model for Physical AI.

## DGF-Asym: Adaptive Peer Weighting for Collective Estimation under Noisy and Faulty Sensing

DevFeed: [DGF-Asym: Adaptive Peer Weighting for Collective Estimation under Noisy and Faulty Sensing](<https://devfeed.tech/articles/dgf-asym-adaptive-peer-weighting-for-collective-estimation-under-noisy-and-faulty-sensing-140044.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22532>)

Author: Mohammad Nomaan Husain, Tanja Katharina Kaiser

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [Simulation](<https://devfeed.tech/topics/simulation.md>)

Tags: [adaptive](<https://devfeed.tech/tags/adaptive.md>), [asynchronous](<https://devfeed.tech/tags/asynchronous.md>), [collective](<https://devfeed.tech/tags/collective.md>), [consensus](<https://devfeed.tech/tags/consensus.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [decentralized](<https://devfeed.tech/tags/decentralized.md>), [decision](<https://devfeed.tech/tags/decision.md>), [influence](<https://devfeed.tech/tags/influence.md>), [information](<https://devfeed.tech/tags/information.md>), [model](<https://devfeed.tech/tags/model.md>), [navigation](<https://devfeed.tech/tags/navigation.md>), [noise](<https://devfeed.tech/tags/noise.md>), [peer](<https://devfeed.tech/tags/peer.md>), [performance](<https://devfeed.tech/tags/performance.md>), [personal](<https://devfeed.tech/tags/personal.md>), [ratio](<https://devfeed.tech/tags/ratio.md>), [retrospective](<https://devfeed.tech/tags/retrospective.md>), [robots](<https://devfeed.tech/tags/robots.md>), [sensing](<https://devfeed.tech/tags/sensing.md>), [sensor](<https://devfeed.tech/tags/sensor.md>), [size](<https://devfeed.tech/tags/size.md>)

### AI overview

DGF-Asym extends the DeGroot-Friedkin model with asymmetric peer weights based on retrospective predictive performance, allowing robots to balance personal observations and peer information without prior sensor-noise statistics or explicit fault models. It supports asynchronous communication. In simulated collective navigation with noisy observations and time-varying sensor faults, it produced more stable estimates and more reliably sustained the decision criterion than three baselines, but took longer to reach decisions. Performance also depended on fault ratio, group size, and influence-threshold selection.

### Source excerpt

arXiv:2611.22532v1 Announce Type: cross Abstract: Collective estimation under unreliable sensing requires robots to adaptively balance personal observations and social information from peers. We propose DGF-Asym, a decentralized collective estimation method extending the DeGroot-Friedkin model with asymmetric peer weighting based on retrospective predictive performance. The method supports consensus formation without prior sensor-noise statistics or explicit fault models while keeping inter-robot communication asynchronous. We evaluate DGF-Asym in simulated collective navigation under noisy observations and time-varying sensor faults. Compared with three baselines, it produces more stable estimates and more reliably sustains the decision criterion, at the cost of longer decision times. However, overall performance depends on fault ratio, group size, and influence-threshold selection. Our results demonstrate the potential of adaptive peer weighting for stable model-free collective estimation under unreliable sensing.

## Refinement vs. Replanning: Inference Compute Allocation in Robot Policies

DevFeed: [Refinement vs. Replanning: Inference Compute Allocation in Robot Policies](<https://devfeed.tech/articles/refinement-vs-replanning-inference-compute-allocation-in-robot-policies-137380.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.19034>)

Author: Alba Maria Tellez Fernandez

Published: 2026-11-17T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [smolvla](<https://devfeed.tech/topics/smolvla.md>), [benchmark overfitting machine learning](<https://devfeed.tech/topics/benchmark-overfitting-machine-learning.md>)

Tags: [compute](<https://devfeed.tech/tags/compute.md>), [compute-allocation](<https://devfeed.tech/tags/compute-allocation.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [inference](<https://devfeed.tech/tags/inference.md>), [robot](<https://devfeed.tech/tags/robot.md>)

### AI overview

The case study finds that robot-policy inference compute should be evaluated across both action refinement and replanning frequency. With a frozen SmolVLA checkpoint in synchronous LIBERO simulation and chunk length fixed at K=50, reducing denoising from d=5 to d=2 at h=2 raised success from 122/160 to 139/160 and used 5.9% less arithmetic per control step. At d=2, increasing execution horizon from h=2 to h=5 cut arithmetic per attempt by 60.7%, while successes were similar (139/160 vs. 138/160); the study does not establish equivalence. Arithmetic and host-time latency also reflect different cost profiles. Results come from one checkpoint and setting, so they do not identify a universal deployment configuration.

### Source excerpt

arXiv:2611.19034v1 Announce Type: cross Abstract: A frozen chunked robot policy can spend deployment-time inference compute in two coupled ways: more work within each policy call to refine a predicted action chunk, or more frequent policy calls to replan from fresh observations. We study this allocation without updating model weights. Our evaluation procedure reports success with both nominal compute rate and complete attempt cost, selects comparisons on discovery tasks, and tests prespecified comparisons on held-out tasks. Comparisons added after inspecting the held-out results only summarize observed patterns. We demonstrate the procedure with one frozen SmolVLA checkpoint in synchronous LIBERO simulation, using denoising count as the refinement control and fixing chunk length at K=50. Arithmetic and latency characterize cost differently: at d=10, 82.1% of counted arithmetic is independent of denoising, whereas a descriptive affine fit to fixed-input host time assigns 17.7% to its intercept. At h=2, d=2 succeeds on 139/160 attempts versus 122/160 for d=5 (+10.6 percentage points; task-conditional 95% interval: +4.4 to +16.9), while using 5.9% less arithmetic per control step. Executing h=5 rather than h=2 at d=2 yields 138/160 versus 139/160 successes and 60.7% lower arithmetic per attempt; equivalence is not established. The case study shows why deployment adaptation must evaluate generation effort and feedback frequency jointly; it does not define a universal setting.

## RoboACE: Adversarial Co-Evolution for Robot Self-Improvement

DevFeed: [RoboACE: Adversarial Co-Evolution for Robot Self-Improvement](<https://devfeed.tech/articles/roboace-adversarial-co-evolution-for-robot-self-improvement-137299.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.13034>)

Author: Delin Zhao, Zhengrong Yue, Junlin He, Yali Wang

Published: 2026-11-17T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [Adversarial attacks](<https://devfeed.tech/topics/adversarial-attacks.md>)

Tags: [adversarial](<https://devfeed.tech/tags/adversarial.md>), [agent](<https://devfeed.tech/tags/agent.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [evolution](<https://devfeed.tech/tags/evolution.md>), [robot](<https://devfeed.tech/tags/robot.md>), [self-improvement](<https://devfeed.tech/tags/self-improvement.md>)

### AI overview

RoboACE co-evolves two harnesses around frozen foundation models: a curriculum harness selects challenges using accumulated capability evidence, while an execution harness makes reusable revisions in response. Alternating updates hold one harness fixed as the other changes, and fixed snapshots of admitted challenges support comparisons between execution revisions. From a compact set of LIBERO practice conditions, its frozen deployment outperformed evaluated controllers and agent systems across four LIBERO-family panels. On LIBERO-PRO it achieved 74.0% success, 15.0 percentage points above the initial deployment and 13.5 points above direct execution by its VLA controller. Case studies report changes in evidence-guided practice selection, drawer-skill grounding, and controller intervention.

### Source excerpt

arXiv:2611.13034v1 Announce Type: cross Abstract: Robot agents can improve reusable skills, planning procedures, and recovery strategies from execution feedback, yet a fixed practice source leaves the search for new weaknesses unchanged. Useful practice depends on the agent's current capabilities, so the procedure that chooses practice must also be revisable. We present RoboACE (Robot Adversarial Co-Evolution), a framework that jointly evolves curriculum and execution harnesses around frozen foundation models. The curriculum harness uses accumulated capability evidence to propose informative challenges, while the execution harness responds with reusable revisions that expand execution capabilities. Alternating updates hold one side fixed as the other changes, and admitted challenges form fixed snapshots for comparing execution revisions. Starting from a compact set of LIBERO practice conditions, the resulting frozen deployment outperforms the evaluated controllers and agent systems across four LIBERO-family panels. On LIBERO-PRO, it reaches 74.0% success, exceeding the initial deployment by 15.0 percentage points and direct execution by its VLA controller by 13.5 points. Case studies document changes to evidence-guided practice selection, drawer-skill grounding, and controller intervention.

## RUMI: A Robotiq-Matched Universal Manipulation Interface for Robot Learning with Augmented Reality and Haptic Feedback

DevFeed: [RUMI: A Robotiq-Matched Universal Manipulation Interface for Robot Learning with Augmented Reality and Haptic Feedback](<https://devfeed.tech/articles/rumi-a-robotiq-matched-universal-manipulation-interface-for-robot-learning-with-augmented-reality-and-haptic-feedback-132173.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.15802>)

Author: Kevin Avdiu, Seongjin Bien, Yannik Blei, Philine Meister, Johannes Hechtl, Philipp Schmitt, Kai Wurm, Georg von Wichert, Wolfram Burgard

Published: 2026-11-13T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [contact-rich manipulation](<https://devfeed.tech/topics/contact-rich-manipulation.md>), [Glasses & AR Tech](<https://devfeed.tech/topics/glasses-ar-tech.md>), [Virtual reality](<https://devfeed.tech/topics/virtual-reality.md>), [Robotics Simulation](<https://devfeed.tech/topics/robotics-simulation.md>)

Tags: [augmented-reality](<https://devfeed.tech/tags/augmented-reality.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [feedback](<https://devfeed.tech/tags/feedback.md>), [haptic-feedback](<https://devfeed.tech/tags/haptic-feedback.md>), [interface](<https://devfeed.tech/tags/interface.md>), [learning](<https://devfeed.tech/tags/learning.md>), [manipulation](<https://devfeed.tech/tags/manipulation.md>), [robot](<https://devfeed.tech/tags/robot.md>)

### AI overview

RUMI is a handheld interface matched to the Robotiq 2F-85 that preserves its gripper geometry and uses exchangeable fingertip sensors for natural input before contact and force measurement after contact. Tracking integrated into a VR headset provides real-time augmented reality feedback on whether motions are kinematically feasible for the target robot; a haptic mechanism supports force-aware teleoperation with simulated and real robots. In a user study, episodes with joint-limit violations were fewer with live robot visualization and pose initialization (3/50) than without augmented reality (16/50). The authors also trained imitation policies from demonstrations collected with two fingertip modalities and assessed force-aware data collection in simulation. The supplied text is an abstract excerpt, so it does not provide implementation details or broader evaluation results.

### Source excerpt

arXiv:2611.15802v1 Announce Type: cross Abstract: Many manipulation tasks require carefully controlled contact forces for successful execution, yet large-scale, force-aware datasets remain scarce. Handheld interfaces can help by transmitting interaction forces directly through the operator's arm, but most existing designs are tailored to simple linear grippers and do not match the nonlinear mechanics of widely used robotic grippers. We present RUMI, a handheld universal manipulation interface matched to the Robotiq 2F-85 with exchangeable fingertip sensors that preserves the target gripper geometry while enabling natural input before contact and force measurement after contact. By integrating the tracking system into a virtual reality headset, our method provides real-time augmented reality feedback about the kinematic feasibility of motion on the target robot platform. We further introduce a haptic feedback mechanism that supports force-aware teleoperation for simulated and real robots. A user study shows fewer episodes containing joint-limit violations with live robot visualization and pose initialization (3/50) than without augmented reality (16/50). We additionally train imitation policies from demonstrations, collected using two different fingertip modalities enabled by the gripper-matched hardware, and assess the haptic interface's capability for collecting force-aware teleoperation datasets in simulation.

## DexRemo: A Force-Sensing Hand Platform and Task Suite for Contact-Rich Removal Manipulation

DevFeed: [DexRemo: A Force-Sensing Hand Platform and Task Suite for Contact-Rich Removal Manipulation](<https://devfeed.tech/articles/dexremo-a-force-sensing-hand-platform-and-task-suite-for-contact-rich-removal-manipulation-133057.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.15981>)

Author: Liman Wang, Hanyang Zhong, Sun Zhaole, Wenting Cao, Babar Jamil, Andy Tyrrell, Shan Luo, Jihong Zhu

Published: 2026-11-13T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [contact-rich manipulation](<https://devfeed.tech/topics/contact-rich-manipulation.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [Machine Perception](<https://devfeed.tech/topics/machine-perception.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [axis](<https://devfeed.tech/tags/axis.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [components](<https://devfeed.tech/tags/components.md>), [core](<https://devfeed.tech/tags/core.md>), [coverage](<https://devfeed.tech/tags/coverage.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [easier](<https://devfeed.tech/tags/easier.md>), [embedded](<https://devfeed.tech/tags/embedded.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [evaluations](<https://devfeed.tech/tags/evaluations.md>), [express](<https://devfeed.tech/tags/express.md>), [extension](<https://devfeed.tech/tags/extension.md>), [frame](<https://devfeed.tech/tags/frame.md>), [fuse](<https://devfeed.tech/tags/fuse.md>), [giving](<https://devfeed.tech/tags/giving.md>), [manipulation](<https://devfeed.tech/tags/manipulation.md>), [platform](<https://devfeed.tech/tags/platform.md>), [rich](<https://devfeed.tech/tags/rich.md>), [sensing](<https://devfeed.tech/tags/sensing.md>)

### AI overview

DexRemo pairs a high-force, three-finger robotic hand with modular fingertips and three-axis force sensing, and evaluates removal manipulation across nine real-robot scenarios. Its learned policies combine multi-view vision, proprioception, fingertip pose, and force measurements to predict closed-loop action chunks from demonstrations. Expressing fingertip forces in a shared wrist-centered frame makes force directions consistent across fingers; ablations on six core tasks report improved stability and generalization, especially when wrist-frame forces are combined with fingertip pose, compared with local-frame force inputs or no-force baselines. Three additional scenarios provide held-out coverage.

### Source excerpt

arXiv:2611.15981v1 Announce Type: cross Abstract: Many manipulation tasks require separating adhered, embedded, contaminated, or mechanically constrained targets. We study this setting as removal manipulation, where progress depends on evolving contact states that are only partially observable from vision and kinematics. We introduce DexRemo, a three-finger robotic hand with high-force actuation, modular fingertips, and three-axis fingertip force sensing, together with a nine-scenario real-robot task suite spanning adhesive detachment, surface cleaning and self-cleaning, and occluded retrieval. To make multi-finger force observations easier to fuse, we express fingertip forces in a shared wrist-centered frame, giving force components consistent geometric meaning across fingers and time. Using an Action Chunking Transformer backbone, policies fuse multi-view vision, proprioception, fingertip pose, and force observations to predict closed-loop action chunks from demonstrations. Evaluation uses six core benchmark tasks for controlled fingertip-input and force-frame ablations, plus three extension scenarios for additional held-out coverage. Across these evaluations, the learned policies achieve consistent removal performance, and ablations show that wrist-frame forces, especially with fingertip pose, improve stability and generalization over local-frame force inputs and no-force baselines. Project website: https://dexremo.github.io

## Grasp-Taxonomy Conditioning as a Mode Switch for Dexterous Grasping of Climbing Holds

DevFeed: [Grasp-Taxonomy Conditioning as a Mode Switch for Dexterous Grasping of Climbing Holds](<https://devfeed.tech/articles/grasp-taxonomy-conditioning-as-a-mode-switch-for-dexterous-grasping-of-climbing-holds-126219.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.12017>)

Author: Rumi Loghmani, Abraham George, Amir Barati Farimani

Published: 2026-11-10T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>)

Tags: [3d](<https://devfeed.tech/tags/3d.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [diffusion](<https://devfeed.tech/tags/diffusion.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [robotics](<https://devfeed.tech/tags/robotics.md>), [switch](<https://devfeed.tech/tags/switch.md>), [taxonomy](<https://devfeed.tech/tags/taxonomy.md>)

### AI overview

BetaGrasp uses a four-class grasp label--crimp, sloper, pinch, or jug--as a mode switch for a 3D diffusion policy controlling a Franka arm with a 16-DoF LEAP hand. The accompanying climbing-hold benchmark measures slip force with a spring testbed and ratchet. The authors report that the point-cloud encoder did not distinguish the four holds; without the label, simulated rollouts from the reset pose produced jug grasps for every hold, with 25% correct grasp types, versus 94% with BetaGrasp. Across 80 paired hardware trials, BetaGrasp increased average slip force from 9.6 N to 14.3 N and reduced trials in which the grasp slipped fully off the hold from 44% to 10%.

### Source excerpt

arXiv:2611.12017v1 Announce Type: cross Abstract: Dexterous grasping in robotics relies on distinct hand configurations depending on object geometry. We introduce BetaGrasp, a 3D diffusion policy that conditions a DP3-style point-cloud policy on a four-class grasp label (crimp, sloper, pinch, and jug), running on a Franka arm with a 16-DoF LEAP hand. We also introduce a climbing-hold benchmark: a spring testbed whose ratchet gives a slip-force reading in newtons. In our analysis the policy's point-cloud encoder did not separate the four holds, so the scan alone gave it little to choose a grasp from. Without the label (a DP3-style baseline), simulated rollouts from the robot's reset pose all end in a jug grasp, whatever the hold (25% correct grasp type, versus 94% for BetaGrasp). The label works as a switch for which grasp the policy performs. On 80 paired hardware trials, BetaGrasp raises average slip force from 9.6 N to 14.3 N, and grasps slipping fully off the hold drop from 44% of trials to 10%.

## UniOMA: Unified Optimal-Transport Multi-Modal Structural Alignment for Robot Perception

DevFeed: [UniOMA: Unified Optimal-Transport Multi-Modal Structural Alignment for Robot Perception](<https://devfeed.tech/articles/unioma-unified-optimal-transport-multi-modal-structural-alignment-for-robot-perception-126268.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.12351>)

Author: Xinrui Zu, Mark Hoogendoorn, Kevin Sebastian Luck, Shujian Yu

Published: 2026-11-10T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>)

Tags: [alignment](<https://devfeed.tech/tags/alignment.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [optimal-transport](<https://devfeed.tech/tags/optimal-transport.md>), [performance](<https://devfeed.tech/tags/performance.md>), [prediction](<https://devfeed.tech/tags/prediction.md>), [robot](<https://devfeed.tech/tags/robot.md>), [robot-perception](<https://devfeed.tech/tags/robot-perception.md>)

### AI overview

UniOMA adds geometry-aware Gromov-Wasserstein regularization to contrastive multimodal learning so representations align both individual instances and the structure within each modality. It encodes each modality's geometry and uses a dynamically learned GW barycenter to reduce cross-modal structural differences. The method targets robot perception, including force and tactile signals with varying sample densities. Across five robotic benchmarks, the authors report improved structural alignment and downstream performance over multimodal contrastive baselines, including on robot and environment state prediction. They state the regularizer can integrate with most InfoNCE-like objectives.

### Source excerpt

arXiv:2611.12351v1 Announce Type: cross Abstract: Achieving generalizable and well-aligned multimodal representations remains a core challenge in robot learning. While recent approaches have attempted to align modalities by modeling conditional or higher-order statistical dependencies, they do not explicitly consider the structural coherence across modalities. In this work, we propose a novel multimodal alignment method that augments existing contrastive losses with a geometry-aware Gromov--Wasserstein (GW) distance-based regularization. To this end, we encode intra-modal geometry for each modality and reduce cross-modal structural discrepancies through a dynamically learned GW barycenter, thereby encouraging structural consistency in addition to instance-level contrastive alignment. We apply this optimal-transport-based alignment strategy to robot perception tasks involving underexplored modalities such as force and tactile signals, where modality data often exhibit varying sample densities. Extensive experiments on five robotic benchmarks show that our method improves structural alignment and downstream performance over state-of-the-art multimodal contrastive baselines across a wide range of downstream tasks, including robot and environment state prediction. Moreover, our GW-based regularization can be seamlessly integrated into most InfoNCE-like objectives.

## Make a Robot Arm Feel Weightless with NVIDIA Holoscan 5

DevFeed: [Make a Robot Arm Feel Weightless with NVIDIA Holoscan 5](<https://devfeed.tech/articles/make-a-robot-arm-feel-weightless-with-nvidia-holoscan-5-123907.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/make-a-robot-arm-feel-weightless-with-nvidia-holoscan-5/>)

Author: Elizabeth Goodman

Published: 2026-11-09T19:09:32Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Holoscan](<https://devfeed.tech/topics/holoscan.md>), [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [Isaac](<https://devfeed.tech/topics/isaac.md>)

Tags: [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [clara](<https://devfeed.tech/tags/clara.md>), [control](<https://devfeed.tech/tags/control.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [edge-computing](<https://devfeed.tech/tags/edge-computing.md>), [healthcare-life-sciences](<https://devfeed.tech/tags/healthcare-life-sciences.md>), [holoscan](<https://devfeed.tech/tags/holoscan.md>), [medical-devices](<https://devfeed.tech/tags/medical-devices.md>), [monai](<https://devfeed.tech/tags/monai.md>), [nvidia-holoscan](<https://devfeed.tech/tags/nvidia-holoscan.md>), [robot](<https://devfeed.tech/tags/robot.md>), [robot-arm](<https://devfeed.tech/tags/robot-arm.md>), [robotics](<https://devfeed.tech/tags/robotics.md>), [video-analytics](<https://devfeed.tech/tags/video-analytics.md>)

### AI overview

The tutorial builds a hand-guidable gravity-compensation loop for the Seeed reBot Arm B601-DM using three Holoscan operators: clock-triggered motor-state reads, Pinocchio inverse dynamics, and motor commands. A single-thread partition and depth-one drop-oldest queues limit handoffs and stale samples; graph compilation checks the execution plan before motor startup, while watchdog and shutdown callbacks disable the motors. Nsight Systems annotations expose timing without custom instrumentation. In profiled runs, pinning and CPU isolation reduced observed p99.99 latency roughly 5x for C++ and 9.6x for Python. Python adds interpreter, allocation, and GIL costs relevant to microsecond-budget CPU control; the article notes C++ offers more critical-path control, though its example is not zero-allocation or zero-syscall. The walkthrough was tested on Jetson Orin Nano, Jetson Thor, and x86 Ubuntu 24.04; it also points to a C++ implementation and a Python example extending the loop with kinematics and impedance control.

### Source excerpt

Picture guiding a robot arm by hand while its motors supply just enough torque to support its weight and keep the robot upright. This simple interaction, a...

## NoContactNoWorries: Estimating Contact through Vision and Proprioception for In-Hand Dexterous Manipulation

DevFeed: [NoContactNoWorries: Estimating Contact through Vision and Proprioception for In-Hand Dexterous Manipulation](<https://devfeed.tech/articles/nocontactnoworries-estimating-contact-through-vision-and-proprioception-for-in-hand-dexterous-manipulation-124446.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2606.24450>)

Author: Soham Patil, Avirup Das, Sourabh Bhosale, Spandan Roy

Published: 2026-11-09T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [contact-rich manipulation](<https://devfeed.tech/topics/contact-rich-manipulation.md>), [Reinforcement learning](<https://devfeed.tech/topics/reinforcement-learning.md>)

Tags: [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [manipulation](<https://devfeed.tech/tags/manipulation.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [novel](<https://devfeed.tech/tags/novel.md>), [real-world](<https://devfeed.tech/tags/real-world.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [robot](<https://devfeed.tech/tags/robot.md>), [sensors](<https://devfeed.tech/tags/sensors.md>), [simulation](<https://devfeed.tech/tags/simulation.md>), [transformer](<https://devfeed.tech/tags/transformer.md>), [vision](<https://devfeed.tech/tags/vision.md>)

### AI overview

NoContactNoWorries uses a transformer to combine RGB-D vision and robot proprioception to estimate binary hand-object contact as a pseudo-tactile signal. The authors train one contact predictor across multiple objects and report that its output supports reinforcement learning for in-hand object reorientation, including generalization to novel objects. They validate the approach in simulation and on a real-world robot. The abstract frames this as a scalable alternative for binary contact estimation, citing cost, fragility, and integration challenges with dedicated tactile hardware; it does not establish broader tactile replacement.

### Source excerpt

arXiv:2606.24450v2 Announce Type: replace-cross Abstract: Perceiving physical contact is fundamental to dexterous manipulation. While robots often rely on dedicated hardware tactile sensors, humans exhibit a remarkable ability to infer contact by integrating visual information with an innate sense of their body's pose and movement. Inspired by this embodied perceptual skill, we investigate whether a robot can learn to infer contact from vision, an approach that also offers a scalable alternative to tactile hardware specifically for binary contact estimation, which faces practical challenges in cost, fragility, and integration. We present NoContactNoWorries, a transformer-based multimodal framework that fuses RGB-D vision with the robot's proprioception to infer binary contact states as a pseudo-tactile signal for hand-object interactions. We validate by training a single contact prediction model on multiple objects and show that the inferred contact signal supports downstream reinforcement learning agents for in-hand object reorientation, generalizing to novel objects. Experiments in both simulation and on a real-world robot validate our approach, highlighting the feasibility of inferring contact from vision and proprioception. Project Page: https://soham2560.github.io/no-contact-no-worries/

## MATE: Asynchronous Multi-Rate Diffusion Policy Composition

DevFeed: [MATE: Asynchronous Multi-Rate Diffusion Policy Composition](<https://devfeed.tech/articles/mate-asynchronous-multi-rate-diffusion-policy-composition-124456.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2607.17257>)

Author: Zihao He, Hongjie Fang, Shirun Tang, Cewu Lu, Haoshu Fang

Published: 2026-11-09T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [contact-rich manipulation](<https://devfeed.tech/topics/contact-rich-manipulation.md>), [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>)

Tags: [asynchronous](<https://devfeed.tech/tags/asynchronous.md>), [composition](<https://devfeed.tech/tags/composition.md>), [contact-rich-manipulation](<https://devfeed.tech/tags/contact-rich-manipulation.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [denoising](<https://devfeed.tech/tags/denoising.md>), [diffusion](<https://devfeed.tech/tags/diffusion.md>), [latency](<https://devfeed.tech/tags/latency.md>), [manipulation](<https://devfeed.tech/tags/manipulation.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [performance](<https://devfeed.tech/tags/performance.md>), [policies](<https://devfeed.tech/tags/policies.md>), [policy](<https://devfeed.tech/tags/policy.md>), [vision](<https://devfeed.tech/tags/vision.md>)

### AI overview

LAG-Fusion composes multimodal diffusion policies asynchronously, letting each modality-specific policy run at its native inference rate and provide denoising guidance when available. To align delayed guidance under relative action representations, it rebases diffusion variables into a shared reference frame before fusion. The authors apply this approach to contact-rich manipulation by combining low-frequency vision with high-frequency force input. In experiments with heterogeneous modality latencies, they report better policy responsiveness and task performance than synchronous fusion and specially designed force-aware baselines.

### Source excerpt

arXiv:2607.17257v2 Announce Type: replace-cross Abstract: Diffusion policies have shown strong potential for robotic imitation learning, and recent extensions incorporate additional modalities to improve manipulation performance. However, these modalities often differ not only in information content but also in sensing rates and inference latencies. Existing multimodal diffusion policies typically rely on synchronous fusion or manually designed multi-frequency architectures, which either slow down high-frequency feedback or limit extensibility to new modality combinations. We propose LAG-Fusion, a latency-aware guidance fusion framework for asynchronous multimodal diffusion policy composition. LAG-Fusion allows modality-specific policies to operate at their native inference rates and contribute denoising guidance whenever available. To make asynchronous composition consistent, we derive a reference-frame rebasing rule for diffusion variables under relative action representations, enabling delayed guidance to be aligned before fusion. We instantiate LAG-Fusion in contact-rich manipulation by composing a low-frequency vision policy with a high-frequency force policy. Experiments under heterogeneous modality latencies show that LAG-Fusion improves policy responsiveness and task performance over synchronous fusion and specially designed force-aware baselines.

## VTAM: Efficient Visuo-Tactile World-Action Models for Contact-Rich Manipulation without Tactile Pretraining

DevFeed: [VTAM: Efficient Visuo-Tactile World-Action Models for Contact-Rich Manipulation without Tactile Pretraining](<https://devfeed.tech/articles/vtam-efficient-visuo-tactile-world-action-models-for-contact-rich-manipulation-without-tactile-pretraining-120007.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2603.23481>)

Author: Haoran Yuan, Weigang Yi, Zhenyu Zhang, Wendi Chen, Yuchen Mo, Jiashi Yin, Xinzhuo Li, Yue Luo, Jialin Li, Xiangyu Zeng, Chuan Wen, Cewu Lu, Katherine Driggs-Campbell, Ismini Lourentzou

Published: 2026-11-06T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [contact-rich manipulation](<https://devfeed.tech/topics/contact-rich-manipulation.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [World models](<https://devfeed.tech/topics/world-models.md>)

Tags: [contact-rich-manipulation](<https://devfeed.tech/tags/contact-rich-manipulation.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [flow](<https://devfeed.tech/tags/flow.md>), [inference](<https://devfeed.tech/tags/inference.md>), [latency](<https://devfeed.tech/tags/latency.md>), [manipulation](<https://devfeed.tech/tags/manipulation.md>), [pretraining](<https://devfeed.tech/tags/pretraining.md>), [robot](<https://devfeed.tech/tags/robot.md>), [sensors](<https://devfeed.tech/tags/sensors.md>), [simulation](<https://devfeed.tech/tags/simulation.md>), [transformer](<https://devfeed.tech/tags/transformer.md>), [vae](<https://devfeed.tech/tags/vae.md>), [vision-language-action](<https://devfeed.tech/tags/vision-language-action.md>), [world-model](<https://devfeed.tech/tags/world-model.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

VTAM is a visuo-tactile world-action model for contact-rich manipulation that uses task demonstrations without tactile or action pretraining. It first adapts a pretrained video backbone to predict future visual and tactile latents, then fine-tunes it with an action expert that predicts actions, proprioceptive states, and a flow-force proxy from tactile optical flow. The abstract reports better results than all baselines on four real-robot tasks across two platforms and higher average success than baselines without tactile pretraining on eight UniVTAC tasks. Its reported UniVTAC success is comparable to models trained on over 30,000 hours of largely visuo-tactile data: 83.4% versus 84.5% for N0-TWAM. At inference, it is about 6x faster than N0-TWAM and 16x faster than LingBot-VA without compilation; compiled latency is comparable to Fast-WAM. Ablations found that bypassing tactile world modeling failed on every tested task, while the flow-force proxy helped prevent the policy from ignoring touch. The tactile encoder transferred zero-shot between GelSight Mini and Xense Photon sensors.

### Source excerpt

arXiv:2603.23481v2 Announce Type: replace-cross Abstract: Tactile vision-language-action models (VLAs) and tactile world-action models (WAMs) are a promising new paradigm for contact-rich manipulation, but existing models either underutilize touch, rely on large-scale tactile pretraining, or incur high inference latency due to iterative video generation. We present VTAM, an efficient visuo-tactile world-action model for contact-rich manipulation that requires no tactile or action pretraining. RGB and tactile observations share a frozen video VAE and the pretrained video transformer weights. VTAM first adapts the video backbone to jointly predict future visual and tactile latents, then fine-tunes it end-to-end with a randomly initialized action expert that predicts actions, proprioceptive states, and a light flow-force proxy computed from tactile optical flow. Trained only on task demonstrations, VTAM outperforms all baselines on four real-robot tasks across two platforms with different tactile sensors, outperforms all baselines without tactile pretraining in average success on eight UniVTAC simulation tasks, and is comparable to tactile VLAs and WAMs pretrained on over 30K hours of largely visuo-tactile robot data (83.4% vs. 84.5% for N0-TWAM). Without full video denoising at inference, VTAM is approximately 6x and 16x faster than N0-TWAM and LingBot-VA without compilation, with compiled latency comparable to Fast-WAM. Ablations show that feeding frozen-VAE tactile features directly to the action expert, bypassing tactile world modeling, fails on every tested task, that Stage I visuo-tactile world-model fine-tuning improves UniVTAC success on most tasks, and that flow-force proxy keeps the policy from fully ignoring touch. The tactile encoder transfers zero-shot across GelSight Mini and Xense Photon sensors.

## VisionSIM: Beyond Idealized Sensors - A Multi-Modal Simulator for Robot Perception

DevFeed: [VisionSIM: Beyond Idealized Sensors - A Multi-Modal Simulator for Robot Perception](<https://devfeed.tech/articles/visionsim-beyond-idealized-sensors-a-multi-modal-simulator-for-robot-perception-120312.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.08368>)

Author: Sacha Jungerman, Kaustubh Sadekar, Avery Gump, Sriram Narayanan, Shantanu Gupta, Bhuyashi Deka, Srinivasa Narasimhan, Atul Ingle, Mohit Gupta

Published: 2026-11-06T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Robotics Simulation](<https://devfeed.tech/topics/robotics-simulation.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>)

Tags: [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [data](<https://devfeed.tech/tags/data.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [event](<https://devfeed.tech/tags/event.md>), [failure](<https://devfeed.tech/tags/failure.md>), [lidar](<https://devfeed.tech/tags/lidar.md>), [measurement](<https://devfeed.tech/tags/measurement.md>), [modeling](<https://devfeed.tech/tags/modeling.md>), [motion](<https://devfeed.tech/tags/motion.md>), [platform](<https://devfeed.tech/tags/platform.md>), [raw](<https://devfeed.tech/tags/raw.md>), [robot](<https://devfeed.tech/tags/robot.md>), [robot-perception](<https://devfeed.tech/tags/robot-perception.md>), [sensors](<https://devfeed.tech/tags/sensors.md>), [simulation](<https://devfeed.tech/tags/simulation.md>), [simulator](<https://devfeed.tech/tags/simulator.md>), [thermal](<https://devfeed.tech/tags/thermal.md>)

### AI overview

VisionSIM models raw physical measurements for conventional and emerging robot sensors, exposing sensor parameters to reproduce failures that idealized simulators may miss. It simulates LiDAR pileup and glare; iToF phase wrapping, saturation, and motion artifacts; event-camera refractory drops; and history-dependent thermal emission. By applying these models to identical scenes and trajectories, it supports cross-modality comparisons. The authors also release an indoor dataset with synchronized raw measurements and ground-truth annotations.

### Source excerpt

arXiv:2611.08368v1 Announce Type: cross Abstract: Robotic perception increasingly relies on heterogeneous sensor suites combining cameras with emerging modalities (event, SPAD, iToF/dToF, and thermal). Yet existing simulators idealize these sensors, hiding critical modality-specific failure modes that limit real-world deployment. We present VisionSIM, a unified, physically grounded simulation platform that elevates sensor realism to a first-class concern by modeling the raw physical measurement process for diverse conventional and emerging modalities. We expose fine-grained control over physical sensor parameters, reproducing failure modes overlooked by general-purpose simulators: pileup and glare for LiDAR; phase wrapping, saturation, and motion artifacts for iToF; refractory drops for event cameras; and history-dependent emission for thermal cameras. This enables principled cross-modality comparison on identical scenes and trajectories. We release the platform and a large indoor dataset with synchronized raw measurements and rich ground-truth annotations.

## GhostTac: Manipulating Tactile Sensors without Physical Contact

DevFeed: [GhostTac: Manipulating Tactile Sensors without Physical Contact](<https://devfeed.tech/articles/ghosttac-manipulating-tactile-sensors-without-physical-contact-118673.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2608.20817>)

Author: Kun Wang, Xuancun Lu, Ruochen Zhou, Kai Wang, Tongjun Ye, Yihao Shao, Chen Yan, Xiaoyu Ji, Wenyuan Xu

Published: 2026-11-05T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>)

Topics: [Security](<https://devfeed.tech/topics/security.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [Robotics](<https://devfeed.tech/topics/robotics.md>), [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>)

Tags: [attack](<https://devfeed.tech/tags/attack.md>), [bandwidth](<https://devfeed.tech/tags/bandwidth.md>), [behaviors](<https://devfeed.tech/tags/behaviors.md>), [case-studies](<https://devfeed.tech/tags/case-studies.md>), [classification](<https://devfeed.tech/tags/classification.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [detection](<https://devfeed.tech/tags/detection.md>), [devices](<https://devfeed.tech/tags/devices.md>), [distribution](<https://devfeed.tech/tags/distribution.md>), [electromagnetic-interference](<https://devfeed.tech/tags/electromagnetic-interference.md>), [exploits](<https://devfeed.tech/tags/exploits.md>), [feedback](<https://devfeed.tech/tags/feedback.md>), [fine](<https://devfeed.tech/tags/fine.md>), [location](<https://devfeed.tech/tags/location.md>), [magnitude](<https://devfeed.tech/tags/magnitude.md>), [manipulation](<https://devfeed.tech/tags/manipulation.md>), [material](<https://devfeed.tech/tags/material.md>), [measurement](<https://devfeed.tech/tags/measurement.md>), [mechanism](<https://devfeed.tech/tags/mechanism.md>), [modules](<https://devfeed.tech/tags/modules.md>), [sensors](<https://devfeed.tech/tags/sensors.md>)

### AI overview

GhostTac uses electromagnetic interference (EMI) to manipulate tactile sensor readings without physical contact. The reported mechanism converts carefully crafted EMI into a persistent DC offset through nonlinear rectification and limited-bandwidth amplification, bypassing onboard filtering. The attack can controllably alter output magnitude and spatial distribution, potentially causing harmful robot behavior. Tests across 10 sensor modules and 2 dexterous hands covered 15 tactile sensors and showed consistent effectiveness; three case studies examined grasping, slip detection, and material classification. These findings describe an attack demonstrated on the tested devices, not evidence about all tactile sensors.

### Source excerpt

arXiv:2608.20817v4 Announce Type: replace Abstract: Tactile sensors are integral components of modern robotic systems, enabling robots to perceive and interact with the physical environment through tactile feedback. Despite their importance, the physical-layer security of tactile sensors has received little attention in prior work. In this paper, we present GhostTac, to the best of our knowledge, the first contactless attack that manipulates tactile sensing via electromagnetic interference (EMI). We identify that EMI exploits the nonlinear rectification and limited bandwidth amplification effects, allowing carefully crafted EMI signals to be converted into a persistent DC offset that bypasses on-board filtering and induces stable measurement deviations. Building on this mechanism, GhostTac enables fine-grained and controllable manipulation of sensor outputs by reshaping the spatial distribution and manipulating the magnitude at the targeted location. Such interference can induce unintended and harmful robot behaviors, such as causing a domestic robot to exert excessive force, resulting in physical damage or human injury. We evaluate GhostTac on 10 sensor modules and 2 dexterous hands, covering 15 tactile sensors of different types, and demonstrate consistent attack effectiveness across all tested devices. We further present three case studies on tactile grasping, slip detection, and material classification to illustrate practical impacts in real robotic tasks. We envision that our findings shed light on a new physical attack vector against tactile sensing in robotic systems.

## DexCanvas: Bridging Human Demonstrations and Robot Learning for Dexterous Manipulation

DevFeed: [DexCanvas: Bridging Human Demonstrations and Robot Learning for Dexterous Manipulation](<https://devfeed.tech/articles/dexcanvas-bridging-human-demonstrations-and-robot-learning-for-dexterous-manipulation-116645.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2510.15786>)

Author: Xinyue Xu (Daisy), Jieqiang Sun (Daisy), Jing (Daisy), Dai, Siyuan Chen, Lanjie Ma, Ke Sun, Bin Zhao, Jianbo Yuan, Sheng Yi, Haohua Zhu, Irvine Lu

Published: 2026-11-04T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [contact-rich manipulation](<https://devfeed.tech/topics/contact-rich-manipulation.md>), [Reinforcement learning](<https://devfeed.tech/topics/reinforcement-learning.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>)

Tags: [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [diffusion](<https://devfeed.tech/tags/diffusion.md>), [hand-tracking](<https://devfeed.tech/tags/hand-tracking.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [hybrid](<https://devfeed.tech/tags/hybrid.md>), [interaction](<https://devfeed.tech/tags/interaction.md>), [learning](<https://devfeed.tech/tags/learning.md>), [manipulation](<https://devfeed.tech/tags/manipulation.md>), [motion-capture](<https://devfeed.tech/tags/motion-capture.md>), [optical-motion-capture](<https://devfeed.tech/tags/optical-motion-capture.md>), [physics](<https://devfeed.tech/tags/physics.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [policies](<https://devfeed.tech/tags/policies.md>), [policy](<https://devfeed.tech/tags/policy.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [rl](<https://devfeed.tech/tags/rl.md>), [robot](<https://devfeed.tech/tags/robot.md>), [simulation](<https://devfeed.tech/tags/simulation.md>), [simulator](<https://devfeed.tech/tags/simulator.md>), [synthetic](<https://devfeed.tech/tags/synthetic.md>)

### AI overview

DexCanvas augments 70 hours of optical motion capture across 21 manipulation types into a reported 7,000 hours of hand-object interaction with per-frame contact points and forces. A reinforcement learning policy drives an actuated MANO hand in simulation to reproduce captured object trajectories, while the simulator measures contacts. It reproduces 87.5% of demonstrations, succeeds on 80.9% of rollouts from perturbed initial poses, and succeeds 72.5% on six YCB objects absent from capture. In 18,522 trials, a Diffusion Policy using DexCanvas contact features succeeds 82.2% of the time versus 67.5% without them. Contact-driven retargeting is also reported for two robot hands. The excerpt says a first release includes 111,857 force-annotated trajectories on Hugging Face.

### Source excerpt

arXiv:2510.15786v3 Announce Type: replace-cross Abstract: A dexterous hand succeeds or fails through contact, yet every scalable record of human manipulation (video, vision-based hand tracking, motion capture) observes how the hand moves and misses how it pushes. We present DexCanvas, a hybrid real-synthetic dataset of 7,000 hours of dexterous hand-object interaction with per-frame contact points and contact forces, grown from 70 hours of optical motion capture that spans 21 manipulation types, from power and precision grasps to in-hand manipulation. The forces come from a real-to-sim pipeline: one reinforcement learning (RL) policy, conditioned on object geometry and manipulation type, drives an actuated MANO hand in physics simulation to reproduce each captured object trajectory, and the simulator measures the contacts that produce the reproduced motion. The policy reproduces 87.5% of the demonstrations and still succeeds on 80.9% of rollouts from perturbed initial object poses; these perturbed rollouts expand the 70 captured hours a hundredfold. On six YCB objects absent from the capture set it succeeds 72.5% of the time. The contact channels make better policies: a Diffusion Policy that observes DexCanvas contact features succeeds 82.2% of the time, against 67.5% without them, over 18,522 trials. Contact-driven retargeting carries the same demonstrations to two dexterous robot hands, where the RL stage again produces stable rollouts. A first release of 111,857 force-annotated trajectories is publicly available on Hugging Face.

## FlowTouch: View-Invariant Visuo-Tactile Prediction

DevFeed: [FlowTouch: View-Invariant Visuo-Tactile Prediction](<https://devfeed.tech/articles/flowtouch-view-invariant-visuo-tactile-prediction-111385.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2603.08255>)

Author: Seongjin Bien, Carlo Kneissl, Tobias J\\"ulg, Frank Fundel, Thomas Ressler-Antal, Florian Walter, Bj\\"orn Ommer, Gitta Kutyniok, Wolfram Burgard

Published: 2026-11-02T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [contact-rich manipulation](<https://devfeed.tech/topics/contact-rich-manipulation.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [Computer vision](<https://devfeed.tech/topics/computer-vision.md>), [3D](<https://devfeed.tech/topics/3d.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Image](<https://devfeed.tech/topics/image.md>)

Tags: [3d](<https://devfeed.tech/tags/3d.md>), [camera](<https://devfeed.tech/tags/camera.md>), [contact-rich-manipulation](<https://devfeed.tech/tags/contact-rich-manipulation.md>), [control](<https://devfeed.tech/tags/control.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [flow-matching](<https://devfeed.tech/tags/flow-matching.md>), [image-generation](<https://devfeed.tech/tags/image-generation.md>), [invariant](<https://devfeed.tech/tags/invariant.md>), [mesh](<https://devfeed.tech/tags/mesh.md>), [model](<https://devfeed.tech/tags/model.md>), [prediction](<https://devfeed.tech/tags/prediction.md>), [sensor](<https://devfeed.tech/tags/sensor.md>), [sim-to-real](<https://devfeed.tech/tags/sim-to-real.md>), [tasks](<https://devfeed.tech/tags/tasks.md>), [vision](<https://devfeed.tech/tags/vision.md>)

### AI overview

FlowTouch predicts tactile patterns from visual information to make tactile feedback useful before contact. It uses an object's local 3D mesh to reduce dependence on scene-specific camera views, combining scene reconstruction with Flow Matching-based image generation. The authors report bridging the sim-to-real gap, generalizing to new sensor instances, and using the predicted tactile images for downstream grasp stability prediction.

### Source excerpt

arXiv:2603.08255v2 Announce Type: replace-cross Abstract: Tactile sensation is essential for contact-rich manipulation tasks. It provides direct feedback on object geometry, surface properties, and interaction forces, enhancing perception and enabling fine-grained control. An inherent limitation of tactile sensors is that readings are available only when an object is touched. This precludes their use during planning and the initial execution phase of a task. Predicting tactile information from visual information can bridge this gap. A common approach is to learn a direct mapping from camera images to the output of vision-based tactile sensors. However, the resulting model will depend strongly on the specific setup and on how well the camera can capture the area where an object is touched. In this work, we introduce FlowTouch, a novel model for view-invariant visuo-tactile prediction. Our key idea is to use an object's local 3D mesh to encode rich information for predicting tactile patterns while abstracting away from scene-dependent details. FlowTouch integrates scene reconstruction and Flow Matching-based models for image generation. Our results show that FlowTouch is able to bridge the sim-to-real gap and generalize to new sensor instances. We further show that the resulting tactile images can be used for downstream grasp stability prediction. Our code, datasets and videos are available at https://flowtouch.github.io/

## Tactus: Tactile & Pose Sensing Glove for Natural Dexterity Data Collection

DevFeed: [Tactus: Tactile & Pose Sensing Glove for Natural Dexterity Data Collection](<https://devfeed.tech/articles/tactus-tactile-pose-sensing-glove-for-natural-dexterity-data-collection-108152.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2610.39076>)

Author: Li Guan, Rachael Granberry, Sahar Aseeri, Sahar Rostami, Taylor Niehues, Sai Dhanooshi Marri, Mia Huang, Dingtian Zhang, Ziyi Kou, Jason Pursel, Eric Whitmire, Vatsal Mehta, Ashish Deshpande, Tristan

Published: 2026-10-30T04:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [contact-rich manipulation](<https://devfeed.tech/topics/contact-rich-manipulation.md>), [World models](<https://devfeed.tech/topics/world-models.md>)

Tags: [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [capacitive](<https://devfeed.tech/tags/capacitive.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ar](<https://devfeed.tech/tags/cs-ar.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [data](<https://devfeed.tech/tags/data.md>), [data-collection](<https://devfeed.tech/tags/data-collection.md>), [dexterity](<https://devfeed.tech/tags/dexterity.md>), [hand-tracking](<https://devfeed.tech/tags/hand-tracking.md>), [imu](<https://devfeed.tech/tags/imu.md>), [manipulation](<https://devfeed.tech/tags/manipulation.md>), [sensing](<https://devfeed.tech/tags/sensing.md>), [textile](<https://devfeed.tech/tags/textile.md>), [wearable](<https://devfeed.tech/tags/wearable.md>), [world-models](<https://devfeed.tech/tags/world-models.md>)

### AI overview

Tactus combines a thin, textile-integrated glove with capacitive touch sensors and IMU-fused hand-pose tracking to record manipulation while aiming to preserve natural movement and track through hand-object occlusion. Its calibration pipeline supports consistency across gloves and correction for individual sessions. In standardized tests against two commercial tactile gloves, Tactus detected forces down to 0.59 N at 95% confidence--1.6-2.7 times lower than the baselines--and achieved 0.87 cross-participant consistency. During manipulation, fingertip keypoint relative error was 11.0 mm under the heaviest occlusion. The authors report that the combined signals support object-property estimation, slip detection, and hand-object interaction recordings for contact-aware robotics research.

### Source excerpt

arXiv:2610.39076v1 Announce Type: cross Abstract: Collecting naturalistic human manipulation demonstrations with accurate contact force and hand pose is essential for robot dexterous manipulation policy and foundational world model learning - yet no existing wearable platform provides both calibrated fingertip force sensing and occlusion-resilient hand tracking in a form factor that preserves natural manipulation behavior. We present Tactus, a textile-integrated sensing glove that co-optimizes three design pillars: (1) a thin, conformal 3D-knit form factor (1.5 mm fingertip stackup) designed to minimize interference with natural manipulation, (2) strategically placed capacitive tactile sensors at manipulation-relevant regions informed by empirical contact studies, and (3) IMU-fused pose tracking that maintains accuracy through the hand-object occlusions where manipulation data is most valuable. Tactus includes a documented calibration pipeline for cross-glove consistency and per-session calibration for subject-dependent correction. To enable objective comparison, we introduce standardized benchmarking protocols for tactile force regression and hand pose estimation, and apply them to Tactus and two commercially available tactile gloves - to our knowledge the first quantitative cross-platform evaluation of this kind. Tactus resolves a minimum detectable force of 0.59 N at 95% confidence, 1.6 - 2.7x lower than the commercial baselines, and with 0.87 cross-participant consistency, while our pose tracking sustains 11.0 mm fingertip keypoint relative error during manipulation, when occlusion is heaviest. We show that these combined signals support object property estimation, slip detection, and representative recording of hand-object interaction - yielding demonstration data with the fidelity required for contact-aware manipulation policies and world models.

## Which Hand Was Late? Diagnosis for Robot Failure Recovery in Bimanual Tool Use

DevFeed: [Which Hand Was Late? Diagnosis for Robot Failure Recovery in Bimanual Tool Use](<https://devfeed.tech/articles/which-hand-was-late-diagnosis-for-robot-failure-recovery-in-bimanual-tool-use-103284.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2610.37533>)

Author: Baptiste Bonin, Caro Strickland, Audrey Durand

Published: 2026-10-28T04:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>)

Tags: [arm](<https://devfeed.tech/tags/arm.md>), [cause](<https://devfeed.tech/tags/cause.md>), [channel](<https://devfeed.tech/tags/channel.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [delay](<https://devfeed.tech/tags/delay.md>), [diagnosis](<https://devfeed.tech/tags/diagnosis.md>), [failure](<https://devfeed.tech/tags/failure.md>), [failure-recovery](<https://devfeed.tech/tags/failure-recovery.md>), [manipulation](<https://devfeed.tech/tags/manipulation.md>), [models](<https://devfeed.tech/tags/models.md>), [policy](<https://devfeed.tech/tags/policy.md>), [recovery](<https://devfeed.tech/tags/recovery.md>), [repair](<https://devfeed.tech/tags/repair.md>), [robot](<https://devfeed.tech/tags/robot.md>), [robot-manipulation](<https://devfeed.tech/tags/robot-manipulation.md>), [sensing](<https://devfeed.tech/tags/sensing.md>), [sensor](<https://devfeed.tech/tags/sensor.md>), [tool](<https://devfeed.tech/tags/tool.md>), [tool-use](<https://devfeed.tech/tags/tool-use.md>), [vision-language-models](<https://devfeed.tech/tags/vision-language-models.md>), [vision-language-models-vlms](<https://devfeed.tech/tags/vision-language-models-vlms.md>)

### AI overview

In a simulated bimanual tool-use task, the sensing channel determines which failure causes a diagnoser can identify: tool slip is visible on the tool hand, while identifying which hand was late requires observing both arms. A one-hand sensor reads its own delay and at most part of the other hand's; passive sensing cannot distinguish a late tool hand's attempt that was also too weak. A repair policy that escalates when causes are unidentifiable repaired as many failures within two attempts as a policy given the true cause. A VLM's internal state encoded the late hand almost perfectly, but whether its answer disclosed that information depended on question wording.

### Source excerpt

arXiv:2610.37533v1 Announce Type: cross Abstract: Failure diagnosers for robot manipulation are increasingly vision--language models (VLMs), trained and evaluated on single-arm failures produced by perturbing a successful demonstration. Bimanual tool use adds failures of other kinds: a tool that slips out of its socket while still held, two correct gestures made at different times, and attempts that fail for two reasons at once. On a simulated bimanual tool-use task whose failure causes are read from the recorded trace, we measure what each sensing channel lets a diagnoser tell. The tool's slip is read on the tool hand; which hand was late is read on both arms, while a sensor on one hand reads its own hand's delay and at most part of the other's; and whether a late attempt was also pushed too weakly is not identifiable from passive sensing when the tool hand is late. Within two attempts, a repair policy that escalates when the cause is not identifiable repairs as many failures as one told the true cause. A VLM's internal state carries the late hand almost perfectly, along a direction no closer to the one its answer reads than a random one; whether the answer reports it depends on the wording of the question.

## ActiveAlign: Aligning Egocentric Manipulation via Active Perception

DevFeed: [ActiveAlign: Aligning Egocentric Manipulation via Active Perception](<https://devfeed.tech/articles/activealign-aligning-egocentric-manipulation-via-active-perception-103199.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2610.36859>)

Author: Ri-Zhao Qiu, Bowen Wen, Yifeng Jiang, Chen Tessler, Eric Heiden, Xue Bin Peng, Xiaolong Wang, Stan Birchfield, Erwin Coumans

Published: 2026-10-28T04:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [contact-rich manipulation](<https://devfeed.tech/topics/contact-rich-manipulation.md>), [Physical AI](<https://devfeed.tech/topics/physical-ai.md>)

Tags: [alignment](<https://devfeed.tech/tags/alignment.md>), [buttons](<https://devfeed.tech/tags/buttons.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [framework](<https://devfeed.tech/tags/framework.md>), [gap](<https://devfeed.tech/tags/gap.md>), [manipulation](<https://devfeed.tech/tags/manipulation.md>), [planning](<https://devfeed.tech/tags/planning.md>), [precision](<https://devfeed.tech/tags/precision.md>), [rendering](<https://devfeed.tech/tags/rendering.md>), [robot](<https://devfeed.tech/tags/robot.md>), [robot-manipulation](<https://devfeed.tech/tags/robot-manipulation.md>), [sim-to-real](<https://devfeed.tech/tags/sim-to-real.md>), [simulation](<https://devfeed.tech/tags/simulation.md>), [sliders](<https://devfeed.tech/tags/sliders.md>), [unitree](<https://devfeed.tech/tags/unitree.md>)

### AI overview

ActiveAlign uses interactions to reduce Real2Sim2Real alignment gaps associated with imperfect passive observations. Its ActiveAlign-Waving module calibrates the hand and eye using active hand motions and differentiable rendering; ActiveAlign-Touching refines object alignment with tactile feedback, with the authors reporting millimeter-level precision. They report using Waving to curate simulation environments for open-source uncalibrated manipulation datasets, and demonstrating on a real Unitree G1 that the framework supports millimeter-scale tasks such as pressing buttons and moving sliders. The supplied text is an abstract-level account and does not provide further evaluation details.

### Source excerpt

arXiv:2610.36859v1 Announce Type: cross Abstract: Real-to-Sim-to-Real (Real2Sim2Real) enables structured world representations for planning, interpretability, and safe execution. Most existing approaches rely on passive perception, which creates real2sim gaps due to imperfect observation. Inspired by how humans perceive actively through actions, we propose ActiveAlign, a framework that leverages active perception to align the Real2Sim2Real gap from interactions. ActiveAlign introduces two complementary modules: (i) ActiveAlign-Waving, which performs hand-eye calibration by exploiting active hand motions and differentiable rendering, and (ii) ActiveAlign-Touching, which refines object alignment through tactile feedback to achieve millimeter-level precision. Together, these capabilities enable strong real2sim alignment. We demonstrate that ActiveAlign-Waving can be used to curate simulation environments for open-sourced uncalibrated robot manipulation datasets, and demonstrate on a real Unitree G1 robot that ActiveAlign enables fine manipulation of millimeter-scale objects such as pressing buttons and moving sliders.

## Investigating Active Sampling for Hardness Classification with Vision-Based Tactile Sensors

DevFeed: [Investigating Active Sampling for Hardness Classification with Vision-Based Tactile Sensors](<https://devfeed.tech/articles/investigating-active-sampling-for-hardness-classification-with-vision-based-tactile-sensors-103702.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2505.13231>)

Author: Junyi Chen, Frederik Heller, Mario G\\'omez Andreu, Boris Belousov, Tim Schneider, Lisa P. Y. Lin, Katja Doerschner, Knut Drewing, Jan Peters, Alap Kshirsagar

Published: 2026-10-28T04:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>)

Tags: [classification](<https://devfeed.tech/tags/classification.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [entropy](<https://devfeed.tech/tags/entropy.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [probabilistic](<https://devfeed.tech/tags/probabilistic.md>), [robot](<https://devfeed.tech/tags/robot.md>), [robotics](<https://devfeed.tech/tags/robotics.md>), [sampling](<https://devfeed.tech/tags/sampling.md>), [sensors](<https://devfeed.tech/tags/sensors.md>), [uncertainty](<https://devfeed.tech/tags/uncertainty.md>), [variance](<https://devfeed.tech/tags/variance.md>), [vision](<https://devfeed.tech/tags/vision.md>)

### AI overview

The study evaluates whether uncertainty-guided active sampling can reduce the tactile data needed to classify hardness with vision-based tactile sensors (VBTS). It compares three probabilistic classifiers and two strategies guided by variance and entropy against random sampling, using a robot-collected dataset and a previously published dataset; it also compares results with a human study on the same objects. The active approaches perform best, reaching 90% accuracy, while human accuracy was 48%. The excerpt does not specify sample counts or detailed results for each classifier and strategy.

### Source excerpt

arXiv:2505.13231v2 Announce Type: replace-cross Abstract: Hardness is one of the most important object properties that humans and robots perceive through touch. This paper investigates active sampling strategies for sample-efficient hardness classification with vision-based tactile sensors (VBTS), using information-theoretic measures of model uncertainty. We evaluated three probabilistic classifier models and two active sampling strategies and a random sampling baseline on a hardness classification task, with our own dataset of VBTS samples collected by a robot and a previously published dataset. In addition, we conducted a human study on the hardness classification task with the same objects as our dataset. Our findings indicate that the active sampling approaches, driven by variance and entropy as measures of model uncertainty, perform best with accuracy reaching 90%, compared to human accuracy of 48%, demonstrating the effectiveness of using VBTS for hardness classification. More information can be found at: https://fheller1.github.io/ActiveHardness

## Robotics startup Enact Intelligence nabs $30M funding round

DevFeed: [Robotics startup Enact Intelligence nabs $30M funding round](<https://devfeed.tech/articles/robotics-startup-enact-intelligence-nabs-30m-funding-round-96300.md>)

Original publisher: [Read original article](<https://siliconangle.com/2026/10/22/robotics-startup-enact-intelligence-nabs-30m-funding-round/>)

Author: Maria Deutscher

Published: 2026-10-22T20:31:36Z

Content type: news

Language: en

Sources: [SiliconANGLE](<https://devfeed.tech/sources/siliconangle.md>)

Topics: [Physical AI](<https://devfeed.tech/topics/physical-ai.md>), [AI Development](<https://devfeed.tech/topics/ai-development.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [AI Research](<https://devfeed.tech/topics/ai-research.md>)

Tags: [actuator](<https://devfeed.tech/tags/actuator.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [algorithms](<https://devfeed.tech/tags/algorithms.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-com](<https://devfeed.tech/tags/amazon-com.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [automation](<https://devfeed.tech/tags/automation.md>), [co-founder](<https://devfeed.tech/tags/co-founder.md>), [emerging-tech](<https://devfeed.tech/tags/emerging-tech.md>), [enact](<https://devfeed.tech/tags/enact.md>), [executive](<https://devfeed.tech/tags/executive.md>), [funding](<https://devfeed.tech/tags/funding.md>), [funding-round](<https://devfeed.tech/tags/funding-round.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [hugging-face-inc](<https://devfeed.tech/tags/hugging-face-inc.md>), [investment](<https://devfeed.tech/tags/investment.md>), [mistral](<https://devfeed.tech/tags/mistral.md>), [mistral-ai](<https://devfeed.tech/tags/mistral-ai.md>), [news](<https://devfeed.tech/tags/news.md>), [pre-seed](<https://devfeed.tech/tags/pre-seed.md>), [pre-seed-funding](<https://devfeed.tech/tags/pre-seed-funding.md>), [robotics](<https://devfeed.tech/tags/robotics.md>), [sensor](<https://devfeed.tech/tags/sensor.md>), [startup](<https://devfeed.tech/tags/startup.md>), [the-latest](<https://devfeed.tech/tags/the-latest.md>)

### AI overview

Swiss startup Enact Intelligence, founded by Manuel Yves Galliker, raised $30 million in pre-seed funding from a consortium including Yann LeCun, Mistral AI CEO Arthur Mensch, Hugging Face co-founder Thomas Wolf and venture firms. It is developing AI models intended to control varied robot designs, addressing the limits of models tailored to particular forms. A job posting suggests Enact plans to pre-train models from scratch, a more difficult route than adapting open-source models. The company is also building actuators that it says can sense force and touch, though it has not explained how they work. The excerpt describes Back EMF sensing as a possible clue from other projects, not a confirmed Enact method. A job posting also points to planned FPGA use for robot performance and power efficiency. Funding will support hiring and technology development.

### Source excerpt

Swiss robotics startup Enact Intelligence today announced that it has raised $30 million in pre-seed funding. The capital was provided by a consortium that included Yann LeCun, one of the world's most prominent artificial intelligence researchers. He was joined by Mistral AI SAS Chief Executive Arthur Mensch, Hugging Face Inc. co-founder Thomas Wolf and several [...] The post Robotics startup Enact Intelligence nabs $30M funding round appeared first on SiliconANGLE.

## AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systems

DevFeed: [AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systems](<https://devfeed.tech/articles/agibot-world-colosseo-a-large-scale-manipulation-platform-for-scalable-and-intelligent-embodied-systems-94660.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2503.06669>)

Author: AgiBot World Contributors, Qingwen Bu, Jisong Cai, Li Chen, Xiuqi Cui, Yan Ding, Siyuan Feng, Shenyuan Gao, Xindong He, Xuan Hu, Xu Huang, Shu Jiang, Yuxin Jiang, Cheng Jing, Hongyang Li, Jialu Li, Ch

Published: 2026-10-22T04:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [Physical AI](<https://devfeed.tech/topics/physical-ai.md>), [AI-Ready Data](<https://devfeed.tech/topics/ai-ready-data.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [contact-rich manipulation](<https://devfeed.tech/topics/contact-rich-manipulation.md>), [big-data](<https://devfeed.tech/topics/big-data.md>)

Tags: [agibot](<https://devfeed.tech/tags/agibot.md>), [complex](<https://devfeed.tech/tags/complex.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [data](<https://devfeed.tech/tags/data.md>), [data-volume](<https://devfeed.tech/tags/data-volume.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [distribution](<https://devfeed.tech/tags/distribution.md>), [domain](<https://devfeed.tech/tags/domain.md>), [generalist](<https://devfeed.tech/tags/generalist.md>), [genie](<https://devfeed.tech/tags/genie.md>), [grippers](<https://devfeed.tech/tags/grippers.md>), [human-in-the-loop](<https://devfeed.tech/tags/human-in-the-loop.md>), [improvement](<https://devfeed.tech/tags/improvement.md>), [intelligence](<https://devfeed.tech/tags/intelligence.md>), [large](<https://devfeed.tech/tags/large.md>), [magnitude](<https://devfeed.tech/tags/magnitude.md>), [manipulation](<https://devfeed.tech/tags/manipulation.md>), [models](<https://devfeed.tech/tags/models.md>), [platform](<https://devfeed.tech/tags/platform.md>), [scale](<https://devfeed.tech/tags/scale.md>)

### AI overview

AgiBot World combines more than 1 million robot trajectories across 217 tasks and five deployment scenarios with a standardized collection pipeline and human verification. The platform supports grippers, dexterous hands, and visuo-tactile sensors. Its generalist policy, Genie Operator-1 (GO-1), uses latent action representations; the authors report predictable scaling as data volume increases. Policies pretrained on the dataset improve average performance by 30% over policies trained on Open X-Embodiment in both in-domain and out-of-distribution settings. GO-1 exceeds 60% success on complex real-world dexterous and long-horizon tasks and outperforms the prior RDT approach by 32%. These are abstract-reported results; the supplied text does not include evaluation details.

### Source excerpt

arXiv:2503.06669v5 Announce Type: replace-cross Abstract: We explore how scalable robot data can address real-world challenges for generalized robotic manipulation. Introducing AgiBot World, a large-scale platform comprising over 1 million trajectories across 217 tasks in five deployment scenarios, we achieve an order-of-magnitude increase in data scale compared to existing datasets. Accelerated by a standardized collection pipeline with human-in-the-loop verification, AgiBot World guarantees high-quality and diverse data distribution. It is extensible from grippers to dexterous hands and visuo-tactile sensors for fine-grained skill acquisition. Building on top of data, we introduce Genie Operator-1 (GO-1), a novel generalist policy that leverages latent action representations to maximize data utilization, demonstrating predictable performance scaling with increased data volume. Policies pre-trained on our dataset achieve an average performance improvement of 30% over those trained on Open X-Embodiment, both in in-domain and out-of-distribution scenarios. GO-1 exhibits exceptional capability in real-world dexterous and long-horizon tasks, achieving over 60% success rate on complex tasks and outperforming prior RDT approach by 32%. By open-sourcing the dataset, tools, and models, we aim to democratize access to large-scale, high-quality robot data, advancing the pursuit of scalable and general-purpose intelligence.

## Huang shrugs off protestors to kick off GTC Berlin with DSX Pods, Robots

DevFeed: [Huang shrugs off protestors to kick off GTC Berlin with DSX Pods, Robots](<https://devfeed.tech/articles/huang-shrugs-off-protestors-to-kick-off-gtc-berlin-with-dsx-pods-robots-92833.md>)

Original publisher: [Read original article](<https://www.nextplatform.com/control/2026/10/21/huang-shrugs-off-protestors-to-kick-off-gtc-berlin-with-dsx-pods-robots/5304447>)

Author: Joe Fay

Published: 2026-10-21T13:35:51Z

Content type: news

Language: en

Sources: [The Next Platform: In-depth coverage of high end computing](<https://devfeed.tech/sources/the-next-platform-in-depth-coverage-of-high-end-computing.md>)

Topics: [NVIDIA DSX](<https://devfeed.tech/topics/nvidia-dsx.md>), [Humanoid Robots](<https://devfeed.tech/topics/humanoid-robots.md>), [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>)

Tags: [800v](<https://devfeed.tech/tags/800v.md>), [accelerated-computing](<https://devfeed.tech/tags/accelerated-computing.md>), [advanced-packaging](<https://devfeed.tech/tags/advanced-packaging.md>), [agile](<https://devfeed.tech/tags/agile.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-factories](<https://devfeed.tech/tags/ai-factories.md>), [ai-factory](<https://devfeed.tech/tags/ai-factory.md>), [ai-performance](<https://devfeed.tech/tags/ai-performance.md>), [amkor](<https://devfeed.tech/tags/amkor.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [assembly](<https://devfeed.tech/tags/assembly.md>), [control](<https://devfeed.tech/tags/control.md>), [datacenters](<https://devfeed.tech/tags/datacenters.md>), [dsx](<https://devfeed.tech/tags/dsx.md>), [dsx-pod](<https://devfeed.tech/tags/dsx-pod.md>), [europe](<https://devfeed.tech/tags/europe.md>), [gtc](<https://devfeed.tech/tags/gtc.md>), [gtc-berlin-2026](<https://devfeed.tech/tags/gtc-berlin-2026.md>), [jensen-huang](<https://devfeed.tech/tags/jensen-huang.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [pods](<https://devfeed.tech/tags/pods.md>), [robots](<https://devfeed.tech/tags/robots.md>), [token](<https://devfeed.tech/tags/token.md>)

### AI overview

NVIDIA presented its DSX Pod as a way to shorten AI datacenter deployment: factory-built systems based on Vera Rubin NVL72 racks would arrive integrated, cabled, tested and qualified in transportable containers. Huang said this could reduce the time from installation to token production from four to five months to about one month, cutting on-site assembly and idle computing; NVIDIA said deliveries with partners are planned worldwide for early 2027. The keynote also introduced Agile One SN, a preassembled humanoid robot reference design expected in the first quarter of next year, and outlined manufacturing agreements intended to expand packaging, testing and optical-engine capacity. The excerpt notes European environmental and sovereignty concerns and an activist interruption during the speech.

### Source excerpt

GTC Jensen Huang kicked off GTC Europe by promising to cut the time to token at new datacenters fro ...

[Next page](<https://devfeed.tech/topics/robot-sense-of-touch.md?cursor=WyIyMDI2LTEwLTIxVDEzOjM1OjUxKzAwOjAwIiwgImJiMzc1YTM1LWQwMjItNDcwZC1iNzAwLWQ0ZmQ0Y2JjZDEyOSJd>)