# autonomous vehicles

Autonomous vehicles use automated driving systems with sensing, computing, and actuation modules to perform part or all of the dynamic driving task.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## On the Vulnerability of Lane Detectors to Physical Shadow Attack

DevFeed: [On the Vulnerability of Lane Detectors to Physical Shadow Attack](<https://devfeed.tech/articles/on-the-vulnerability-of-lane-detectors-to-physical-shadow-attack-145991.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2409.18248>)

Author: Pedram MohajerAnsari (Clemson University, Clemson, SC, USA), Amir Salarpour (Clemson University, Clemson, SC, USA), Jan de Voor (Clemson University, Clemson, SC, USA), Arkajyoti Mitra (University of T

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>)

Topics: [Adversarial attacks](<https://devfeed.tech/topics/adversarial-attacks.md>), [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [Security](<https://devfeed.tech/topics/security.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>)

Tags: [adversarial](<https://devfeed.tech/tags/adversarial.md>), [algorithm](<https://devfeed.tech/tags/algorithm.md>), [attack](<https://devfeed.tech/tags/attack.md>), [autonomous](<https://devfeed.tech/tags/autonomous.md>), [autonomous-vehicles](<https://devfeed.tech/tags/autonomous-vehicles.md>), [bias](<https://devfeed.tech/tags/bias.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [deep-neural-networks](<https://devfeed.tech/tags/deep-neural-networks.md>), [detection](<https://devfeed.tech/tags/detection.md>), [exploits](<https://devfeed.tech/tags/exploits.md>), [optimize](<https://devfeed.tech/tags/optimize.md>), [patterns](<https://devfeed.tech/tags/patterns.md>), [private](<https://devfeed.tech/tags/private.md>), [property](<https://devfeed.tech/tags/property.md>), [real-world](<https://devfeed.tech/tags/real-world.md>), [security](<https://devfeed.tech/tags/security.md>), [security-vulnerabilities](<https://devfeed.tech/tags/security-vulnerabilities.md>), [simulations](<https://devfeed.tech/tags/simulations.md>), [software](<https://devfeed.tech/tags/software.md>), [study](<https://devfeed.tech/tags/study.md>), [vulnerability](<https://devfeed.tech/tags/vulnerability.md>)

### AI overview

The Negative Shadow attack exploits a shadow-removal intensity bias: bright patterns cast by sunlight through shaped occluders can be mistaken for lane markings by neural lane detectors. A genetic algorithm optimizes these patterns against CLRerNet, HybridNets, and TwinLiteNet. In CARLA-OpenPilot simulations, the attack produced hazard-scenario violation rates of up to 100%; the authors also report a miniature-road testbed and a real-world Comma 3X deployment that caused a lane departure. In a human-subject study, 83.6% of participants failed to detect the patterns, while tested input-preprocessing defenses offered only limited protection.

### Source excerpt

arXiv:2409.18248v3 Announce Type: replace Abstract: Automated Lane Centering (ALC) systems are critical components of Level 2 autonomous vehicles, yet their reliance on Deep Neural Networks (DNNs) for lane detection introduces security vulnerabilities. This work introduces the Negative Shadow (NS) Attack, a novel physical-world adversarial technique that exploits intensity bias in shadow-removal preprocessing, where bright patches within shadowed regions are misclassified as genuine lane markings. Unlike previous attacks requiring illegal road markings, the NS attack is passive and stealthy, utilizing sunlight filtered through shaped occluders placed on private property to cast patterns onto the roadway. We utilize a genetic algorithm to optimize the geometry of these shadows against three state-of-the-art lane detection systems: CLRerNet, HybridNets, and TwinLiteNet. The attack is evaluated across three hazard scenarios -- left-turn deviation, head-on collision, and off-road deviation -- using software-in-the-loop simulations with CARLA-OpenPilot, which demonstrated violation rates of up to 100%. Further validation is provided through a miniature road testbed and a real-world deployment where the attack successfully caused a Comma 3X-equipped vehicle to depart its lane. Additionally, a human-subject study indicates high stealth, with 83.6% of participants failing to detect the adversarial patterns, and an assessment of input-preprocessing defenses shows they offer only limited protection against this threat.

## Backbone Matters: Benchmarking Encoder-Decoder Networks for Semantic Segmentation of Driving Scenes on BDD100K

DevFeed: [Backbone Matters: Benchmarking Encoder-Decoder Networks for Semantic Segmentation of Driving Scenes on BDD100K](<https://devfeed.tech/articles/backbone-matters-benchmarking-encoder-decoder-networks-for-semantic-segmentation-of-driving-scenes-on-bdd100k-145151.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26191>)

Author: Ehsan Rassekh

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [Machine Perception](<https://devfeed.tech/topics/machine-perception.md>), [image recognition](<https://devfeed.tech/topics/image-recognition.md>)

Tags: [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [decoder](<https://devfeed.tech/tags/decoder.md>), [driving](<https://devfeed.tech/tags/driving.md>), [encoder](<https://devfeed.tech/tags/encoder.md>), [encoder-decoder](<https://devfeed.tech/tags/encoder-decoder.md>), [networks](<https://devfeed.tech/tags/networks.md>), [semantic](<https://devfeed.tech/tags/semantic.md>)

### AI overview

On BDD100K, decoder choice strongly changes how a backbone performs: EfficientNet-B4 scores 62.6% mIoU with FPN but 42.6% with PSPNet. The study trained 52 combinations of four decoders (U-Net, FPN, LinkNet and PSPNet) and 13 backbones across six families using a common protocol. FPN with EfficientNet-B4 was best, reaching 62.6% mIoU, 89.8% accuracy and 0.092 loss; only two FPN-EfficientNet combinations exceeded the cited BDD100K benchmark of 56.9% mIoU. The best-to-worst backbone gap varied by decoder, from 12.0 points for U-Net to 42.5 for FPN. These are reported results for this dataset and protocol; the supplied text does not provide further methodological details or broader validation.

### Source excerpt

arXiv:2611.26191v1 Announce Type: cross Abstract: Semantic segmentation gives an autonomous vehicle a dense, pixel-level description of its surroundings and is a core part of scene understanding. Most segmentation networks consist of an encoder (the backbone) and a decoder, yet the backbone is often chosen without a systematic comparison. This work studies this choice on the BDD100K driving dataset. Four widely used decoders (U-Net, FPN, LinkNet and PSPNet) are combined with 13 backbones from six families (ResNet, VGG, DenseNet, Inception, MobileNet and EfficientNet), and all 52 models are trained with one common protocol. The best model, an FPN decoder with an EfficientNet-B4 backbone, reaches 62.6% mean intersection over union (mIoU), 89.8% accuracy and a loss of 0.092. Only two of the 52 models, both FPN with EfficientNet, exceed the 56.9% mIoU reported with the BDD100K benchmark. The effect of the backbone depends strongly on the decoder: the same EfficientNet-B4 gives 42.6% mIoU with PSPNet but 62.6% with FPN, and the gap between the best and the worst backbone ranges from 12.0 points (U-Net) to 42.5 points (FPN). The results and the scope of this study are discussed.

## CP-Guard+: A New Paradigm for Malicious Agent Detection and Defense in Collaborative Perception

DevFeed: [CP-Guard+: A New Paradigm for Malicious Agent Detection and Defense in Collaborative Perception](<https://devfeed.tech/articles/cp-guard-a-new-paradigm-for-malicious-agent-detection-and-defense-in-collaborative-perception-144851.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2502.07807>)

Author: Senkang Hu, Yihang Tao, Zihan Fang, Guowen Xu, Hangcheng Cao, Yiqin Deng, Sam Kwong, Yuguang Fang

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [AI agents in autonomous vehicles](<https://devfeed.tech/topics/ai-agents-in-autonomous-vehicles.md>), [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [attacks](<https://devfeed.tech/tags/attacks.md>), [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [defense](<https://devfeed.tech/tags/defense.md>), [detection](<https://devfeed.tech/tags/detection.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [feature](<https://devfeed.tech/tags/feature.md>), [features](<https://devfeed.tech/tags/features.md>), [malicious](<https://devfeed.tech/tags/malicious.md>), [margin](<https://devfeed.tech/tags/margin.md>), [overhead](<https://devfeed.tech/tags/overhead.md>), [performance](<https://devfeed.tech/tags/performance.md>), [results](<https://devfeed.tech/tags/results.md>), [robust](<https://devfeed.tech/tags/robust.md>), [safe](<https://devfeed.tech/tags/safe.md>), [sensing](<https://devfeed.tech/tags/sensing.md>), [share](<https://devfeed.tech/tags/share.md>), [system](<https://devfeed.tech/tags/system.md>), [systems](<https://devfeed.tech/tags/systems.md>)

### AI overview

CP-Guard+ targets malicious agents in collaborative perception systems used by connected vehicles, where shared sensing can expose an ego vehicle to misleading information. Its detection paradigm identifies malicious agents from features without checking final perception results, which the authors say reduces computational overhead. The work also introduces CP-GuardBench for training and evaluating detection methods, and a defense method that uses Dual-Centered Contrastive Loss (DCCLoss) to increase the separation between benign and malicious feature representations. The authors report experiments on CP-GuardBench and V2X-Sim and say CP-Guard+ outperforms alternatives; the excerpt provides no quantitative results or further experimental details.

### Source excerpt

arXiv:2502.07807v2 Announce Type: replace-cross Abstract: Collaborative perception (CP) is a promising method for safe connected and autonomous driving, which enables multiple vehicles to share sensing information to enhance perception performance. However, compared with single-vehicle perception, the openness of a CP system makes it more vulnerable to malicious attacks that can inject malicious information to mislead the perception of an ego vehicle, resulting in severe risks for safe driving. To mitigate such vulnerability, we first propose a new paradigm for malicious agent detection that effectively identifies malicious agents at the feature level without requiring verification of final perception results, significantly reducing computational overhead. Building on this paradigm, we introduce CP-GuardBench, the first comprehensive dataset provided to train and evaluate various malicious agent detection methods for CP systems. Furthermore, we develop a robust defense method called CP-Guard+, which enhances the margin between the representations of benign and malicious features through a carefully designed Dual-Centered Contrastive Loss (DCCLoss). Finally, we conduct extensive experiments on both CP-GuardBench and V2X-Sim, and demonstrate the superiority of CP-Guard+.

## Composable Driving Style for End-to-End Autonomous Driving

DevFeed: [Composable Driving Style for End-to-End Autonomous Driving](<https://devfeed.tech/articles/composable-driving-style-for-end-to-end-autonomous-driving-145397.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2610.14802>)

Author: Guantian Zheng, Lidong Yu, Tianyu Gao, Jiashu Li, Jiaxing Chen, Wilfried Ariel Mulyawan, Chen Lv

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>)

Tags: [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [continuous](<https://devfeed.tech/tags/continuous.md>), [control](<https://devfeed.tech/tags/control.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [driving](<https://devfeed.tech/tags/driving.md>), [end-to-end-autonomous-driving](<https://devfeed.tech/tags/end-to-end-autonomous-driving.md>), [kinematics](<https://devfeed.tech/tags/kinematics.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [planner](<https://devfeed.tech/tags/planner.md>), [safety](<https://devfeed.tech/tags/safety.md>), [sas](<https://devfeed.tech/tags/sas.md>), [score](<https://devfeed.tech/tags/score.md>), [style](<https://devfeed.tech/tags/style.md>), [vector](<https://devfeed.tech/tags/vector.md>), [vision-language-action](<https://devfeed.tech/tags/vision-language-action.md>)

### AI overview

YOUDrive adds continuous, composable driving-style control to an end-to-end vision-language-action planner. It distills teacher behaviors into task vectors that can be scaled or combined at inference without retraining the backbone, then uses a flow-matching decoder to generate kinematically feasible alternatives from a multimodal trajectory distribution. On NAVSIM navtest, one coefficient monotonically adjusts assertiveness across six teacher-derived personas; PDMS stays above 0.90 in tested individual and blended configurations, reaching 0.954. The proposed Style Alignment Score measures human-referenced kinematic behavior after safety and task gating. The abstract also reports policy-specific kinematics after controlling for scene context, while evaluated discrete style labels add limited explanatory power. These are abstract-level claims; no further experimental details are provided.

### Source excerpt

arXiv:2610.14802v2 Announce Type: replace-cross Abstract: End-to-end driving policies can achieve strong task performance while offering limited control over their driving style. Driving style describes how a vehicle accelerates, brakes, and maintains distance. Policies trained without explicit preference conditioning lack a direct mechanism for adjusting these behaviors at inference. We propose YOUDrive, a vision--language--action planner for continuous and composable driving-style control. Each teacher's behavior is distilled into a task vector, a learned parameter update that induces a style direction in the planner's representation. These directions can be scaled and combined at inference without retraining the backbone. Conditioned on these directions, a flow-matching decoder models a multimodal trajectory distribution and generates kinematically feasible motion alternatives. We introduce the Style Alignment Score (SAS) to describe human-referenced kinematic behavior after safety and task gating. On NAVSIM navtest, a single coefficient monotonically controls assertiveness across six teacher-derived personas, while PDMS remains above 0.90 across the tested individual and blended configurations, reaching 0.954. Further analyses reveal systematic policy-specific kinematics after controlling for scene context, whereas the evaluated discrete style labels provide limited additional explanatory power. Code, checkpoints, and the metric will be released.

## Security of Deep Reinforcement Learning for Autonomous Driving: A Survey

DevFeed: [Security of Deep Reinforcement Learning for Autonomous Driving: A Survey](<https://devfeed.tech/articles/security-of-deep-reinforcement-learning-for-autonomous-driving-a-survey-144846.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2212.06123>)

Author: Ambra Demontis, Srishti Gupta, Maura Pintor, Luca Demetrio, Kathrin Grosse, Hsiao-Ying Lin, Chengfang Fang, Battista Biggio, Fabio Roli

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Reinforcement learning](<https://devfeed.tech/topics/reinforcement-learning.md>), [ai security](<https://devfeed.tech/topics/ai-security.md>), [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [Adversarial attacks](<https://devfeed.tech/topics/adversarial-attacks.md>)

Tags: [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [security](<https://devfeed.tech/tags/security.md>), [survey](<https://devfeed.tech/tags/survey.md>)

### AI overview

The survey examines how attacks can undermine reinforcement learning by compromising policy learning or causing trained agents to make erroneous decisions, a concern for safety-critical uses such as autonomous driving. It reviews 86 recent studies and organizes attacks and defenses by threat model and single- versus multi-agent setting, aiming to help select defenses for particular systems. It also assesses how state-of-the-art attacks and defenses apply to autonomous driving. The supplied text does not describe specific attack or defense methods or their comparative effectiveness.

### Source excerpt

arXiv:2212.06123v5 Announce Type: replace Abstract: Reinforcement learning (RL) enables agents to learn optimal behaviors through interaction with their environment and has been increasingly deployed in safety-critical applications, including autonomous driving. Despite its promise, RL is susceptible to attacks designed either to compromise policy learning or to induce erroneous decisions by trained agents. Although the literature on RL security has grown rapidly and several surveys exist, existing categorizations often fall short in guiding the selection of appropriate defenses for specific systems. In this work, we present a comprehensive survey of 86 recent studies on RL security, addressing these limitations by systematically categorizing attacks and defenses according to defined threat models and single- versus multi-agent settings. Furthermore, we examine the relevance and applicability of state-of-the-art attacks and defense mechanisms within the context of autonomous driving, providing insights to inform the design of robust RL systems.

## PGU-Decoder: Prior-Guided Unified Decoding for Industrial Road-Network Map Updating

DevFeed: [PGU-Decoder: Prior-Guided Unified Decoding for Industrial Road-Network Map Updating](<https://devfeed.tech/articles/pgu-decoder-prior-guided-unified-decoding-for-industrial-road-network-map-updating-143464.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23936>)

Author: Yuguang Ning, Bingbing Kang, Nan Zhao, Zhixuan Li, Ze Zhao, Dongdong Liu, Wenjian Zhu, Zekai Liu, Junhui Wang

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Neural Network](<https://devfeed.tech/topics/neural-network.md>), [Representation learning](<https://devfeed.tech/topics/representation-learning.md>), [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [attention](<https://devfeed.tech/tags/attention.md>), [automated](<https://devfeed.tech/tags/automated.md>), [autonomous](<https://devfeed.tech/tags/autonomous.md>), [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [china](<https://devfeed.tech/tags/china.md>), [cities](<https://devfeed.tech/tags/cities.md>), [cost](<https://devfeed.tech/tags/cost.md>), [costs](<https://devfeed.tech/tags/costs.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [decoder](<https://devfeed.tech/tags/decoder.md>), [dependencies](<https://devfeed.tech/tags/dependencies.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [detection](<https://devfeed.tech/tags/detection.md>), [framework](<https://devfeed.tech/tags/framework.md>), [generate](<https://devfeed.tech/tags/generate.md>), [generation](<https://devfeed.tech/tags/generation.md>), [industrial](<https://devfeed.tech/tags/industrial.md>), [map](<https://devfeed.tech/tags/map.md>), [network](<https://devfeed.tech/tags/network.md>), [updating](<https://devfeed.tech/tags/updating.md>)

### AI overview

PGU-Decoder combines three road-map updating tasks--intra-intersection network generation, merging/diverging detection, and drivable-area detection--in one decoding framework. Its Prior Query Module samples road-network geometries to create point-level queries and keeps their reference points fixed during decoding; point representations are aggregated into instances, whose dependencies are modeled by a Relational Graph Attention Network before task-specific prediction heads produce outputs. The abstract reports evaluation across more than 360 Chinese cities, outperforming seven baselines. After deployment at AutoNavi Map, reported quality scores exceeded 98% on all three tasks, manual verification costs fell by 95%, and update frequency rose from weekly to hourly.

### Source excerpt

arXiv:2611.23936v1 Announce Type: new Abstract: Timely road-network map updates are essential to navigation and autonomous driving. Three key tasks are intra-intersection road network generation, merging/diverging detection, and drivable-area detection, covering topology, geometry, and attributes, respectively. Separate pipelines duplicate rule maintenance, quality assurance, and manual verification, increasing operational costs. We propose PGU-Decoder, a production-grade unified decoding framework for semantic prediction across these tasks. A Prior Query Module (PQM) constructs point-level prior queries from sampled locations on road-network geometries. Fixed reference points preserve positional priors throughout decoding, allowing the model to focus on surrounding context. Point-level representations are aggregated into instance-level representations, and a Relational Graph Attention Network (RGAT) captures inter-instance dependencies. Task-specific heads then generate predictions. We validate PGU-Decoder in large-scale automated road-network map updating across more than 360 cities in China, where it consistently outperforms seven baselines. Following deployment at AutoNavi Map, it achieves quality scores above 98% on all three tasks, reduces manual verification costs by 95%, and increases update frequency from weekly to hourly. These results demonstrate a practical and cost-effective industrial solution for road-network map updating.

## Learning to Interact in Multi-Agent Self-Play for Controllable Autonomous Driving Scenario Generation

DevFeed: [Learning to Interact in Multi-Agent Self-Play for Controllable Autonomous Driving Scenario Generation](<https://devfeed.tech/articles/learning-to-interact-in-multi-agent-self-play-for-controllable-autonomous-driving-scenario-generation-143574.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24876>)

Author: Beyazit Yalcinkaya, Ethan Pronovost, Maximilian Naumann, Marcell Vazquez-Chanlatte

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Multi Agent Systems](<https://devfeed.tech/topics/multi-agent-systems.md>), [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [adversarial](<https://devfeed.tech/tags/adversarial.md>), [agent](<https://devfeed.tech/tags/agent.md>), [approach](<https://devfeed.tech/tags/approach.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [autonomous](<https://devfeed.tech/tags/autonomous.md>), [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [autonomous-vehicle](<https://devfeed.tech/tags/autonomous-vehicle.md>), [av](<https://devfeed.tech/tags/av.md>), [behaviors](<https://devfeed.tech/tags/behaviors.md>), [but](<https://devfeed.tech/tags/but.md>), [cases](<https://devfeed.tech/tags/cases.md>), [challenge](<https://devfeed.tech/tags/challenge.md>), [complex](<https://devfeed.tech/tags/complex.md>), [critical](<https://devfeed.tech/tags/critical.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [driving](<https://devfeed.tech/tags/driving.md>), [generation](<https://devfeed.tech/tags/generation.md>), [learning](<https://devfeed.tech/tags/learning.md>), [multi-agent](<https://devfeed.tech/tags/multi-agent.md>), [play](<https://devfeed.tech/tags/play.md>)

### AI overview

The framework targets safety-critical driving scenarios that static map-location goals in existing goal-conditioned self-play do not reliably produce, including aggressive tailgating and adversarial cut-offs. It adds agent-relative dynamic goals and conditions policies on them to enable targeted scenario synthesis. The abstract reports that this approach generates interactive behaviors static-goal baselines cannot simulate, offering a tool for long-tail autonomous vehicle testing.

### Source excerpt

arXiv:2611.24876v1 Announce Type: cross Abstract: Large-scale, multi-agent self-play trains robust driving policies effectively in simulation, but controlling these models to generate specific, safety-critical edge cases remains a key challenge. Existing goal-conditioned self-play frameworks rely primarily on static map-location goals and fail to reliably produce complex agent interactions such as aggressive tailgating or adversarial cut-offs. These agent interactions are necessary for rigorous autonomous vehicle (AV) testing. To address this, we present an extended multi-agent self-play framework that introduces agent-relative dynamic goals. By conditioning policies on this extended goal representation, our framework enables targeted, controllable scenario synthesis. We demonstrate that our approach successfully generates interactive driving behaviors that static-goal baselines cannot simulate, providing a flexible tool for long-tail scenario generation in AV testing.

## FedS2R: One-Shot Federated Domain Generalization for Synthetic-to-Real Semantic Segmentation in Autonomous Driving

DevFeed: [FedS2R: One-Shot Federated Domain Generalization for Synthetic-to-Real Semantic Segmentation in Autonomous Driving](<https://devfeed.tech/articles/feds2r-one-shot-federated-domain-generalization-for-synthetic-to-real-semantic-segmentation-in-autonomous-driving-142496.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2507.19881>)

Author: Tao Lian, Jose L. G\\'omez, Antonio M. L\\'opez

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Federated Learning](<https://devfeed.tech/topics/federated-learning.md>), [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [data augmentation](<https://devfeed.tech/topics/data-augmentation.md>), [Post-training optimization](<https://devfeed.tech/topics/post-training-optimization.md>)

Tags: [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [classification](<https://devfeed.tech/tags/classification.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [data-augmentation](<https://devfeed.tech/tags/data-augmentation.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [federated](<https://devfeed.tech/tags/federated.md>), [federated-learning](<https://devfeed.tech/tags/federated-learning.md>), [fusion](<https://devfeed.tech/tags/fusion.md>), [knowledge-distillation](<https://devfeed.tech/tags/knowledge-distillation.md>)

### AI overview

FedS2R targets synthetic-to-real semantic segmentation for autonomous driving while keeping client data local. It combines inconsistency-driven augmentation to generate images for unstable classes with multi-client knowledge distillation and feature fusion to build a global model from client models in a one-shot federated setting. On Cityscapes, BDD100K, Mapillary, IDD, and ACDC, the global model reportedly outperforms individual client models and comes within 2 mIoU points of a model trained with simultaneous access to all client data.

### Source excerpt

arXiv:2507.19881v4 Announce Type: replace-cross Abstract: Federated domain generalization has shown promising progress in image classification by enabling collaborative training across multiple clients without sharing raw data. However, its potential in the semantic segmentation of autonomous driving remains underexplored. In this paper, we propose FedS2R, the first one-shot federated domain generalization framework for synthetic-to-real semantic segmentation in autonomous driving. FedS2R comprises two components: an inconsistency-driven data augmentation strategy that generates images for unstable classes, and a multi-client knowledge distillation scheme with feature fusion that distills a global model from multiple client models. Experiments on five real-world datasets, Cityscapes, BDD100K, Mapillary, IDD, and ACDC, show that the global model significantly outperforms individual client models and is only 2 mIoU points behind the model trained with simultaneous access to all client data. These results demonstrate the effectiveness of FedS2R in synthetic-to-real semantic segmentation for autonomous driving under federated learning

## Attention Is Not Relevance: Challenging the Causality of Attention in Autonomous Driving

DevFeed: [Attention Is Not Relevance: Challenging the Causality of Attention in Autonomous Driving](<https://devfeed.tech/articles/attention-is-not-relevance-challenging-the-causality-of-attention-in-autonomous-driving-142746.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24051>)

Author: Luca Lusvarghi, Javier Gozalvez

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [causality](<https://devfeed.tech/topics/causality.md>), [Transformer](<https://devfeed.tech/topics/transformer.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [attention](<https://devfeed.tech/tags/attention.md>), [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [autonomous-vehicle](<https://devfeed.tech/tags/autonomous-vehicle.md>), [causality](<https://devfeed.tech/tags/causality.md>), [counterfactual-analysis](<https://devfeed.tech/tags/counterfactual-analysis.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [natural-language-processing](<https://devfeed.tech/tags/natural-language-processing.md>), [planning](<https://devfeed.tech/tags/planning.md>), [relevance](<https://devfeed.tech/tags/relevance.md>), [synthetic](<https://devfeed.tech/tags/synthetic.md>), [transformer](<https://devfeed.tech/tags/transformer.md>)

### AI overview

Across more than 80,000 synthetic driving scenes evaluated with a vehicle based on PlanT 2.0, attention scores were correlational rather than reliable measures of how much individual objects causally affect driving decisions. Compared with counterfactual estimates of object relevance, attention methods missed some relevant objects and often labeled objects with little or no impact as relevant. They performed effectively in simple, straight single-lane scenarios, but accuracy declined on multi-lane roads and at intersections. The findings caution against using attention alone as a proxy for causal object relevance; the abstract calls for methods that distinguish causal impact from correlation.

### Source excerpt

arXiv:2611.24051v1 Announce Type: new Abstract: Attention has become one of the most widely adopted solutions for estimating the relevance of surrounding objects and interpreting an autonomous vehicle's driving decisions. However, its ability to capture the causal impact of individual input elements on an AI model's output has long been discussed in the literature, particularly in the Natural Language Processing (NLP) domain. This work brings this discussion into the autonomous driving domain by analyzing the accuracy of attention in estimating the impact of an input object on an autonomous vehicle's driving, i.e., its relevance. To this end, we compare different attention-based relevance estimation methods against a causal reference of object relevance obtained through counterfactual analysis. We perform our analysis on more than 80,000 synthetic driving scenes using an autonomous vehicle based on PlanT 2.0, a state-of-the-art Transformer-based model for object-level planning. Results show that attention provides a correlational rather than causal indication of object relevance. Attention-based relevance estimation methods do not consistently identify all relevant objects and tend to incorrectly classify as relevant objects with little or no impact on the vehicle's driving. In particular, results show that attention can effectively identify relevant objects in simple single-lane, straight-road scenarios, but its accuracy degrades in more complex settings, such as multi-lane roads and intersections. These findings highlight the limitations of attention as a proxy for object relevance, calling for novel methods able to accurately capture the causal impact of individual objects on the vehicle's driving and distinguish it from correlational associations.

## FedE2E: One-Shot Federated Learning for End-to-End Autonomous Driving with Closed-Loop Evaluation

DevFeed: [FedE2E: One-Shot Federated Learning for End-to-End Autonomous Driving with Closed-Loop Evaluation](<https://devfeed.tech/articles/fede2e-one-shot-federated-learning-for-end-to-end-autonomous-driving-with-closed-loop-evaluation-142772.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24254>)

Author: Tao Lian, Antonio M. L\\'opez

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Federated Learning](<https://devfeed.tech/topics/federated-learning.md>), [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [Post-training optimization](<https://devfeed.tech/topics/post-training-optimization.md>)

Tags: [alignment](<https://devfeed.tech/tags/alignment.md>), [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [consensus](<https://devfeed.tech/tags/consensus.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [distillation](<https://devfeed.tech/tags/distillation.md>), [end-to-end-autonomous-driving](<https://devfeed.tech/tags/end-to-end-autonomous-driving.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [federated-learning](<https://devfeed.tech/tags/federated-learning.md>), [stat-ml](<https://devfeed.tech/tags/stat-ml.md>)

### AI overview

FedE2E targets end-to-end autonomous driving with one-shot federated learning, where clients collaborate without sharing datasets. It combines multi-client calibration, anchor-based feature alignment, and token-wise consensus distillation to transfer knowledge across heterogeneous models. In closed-loop Bench2Drive evaluation, the method reports a one-shot Driving Score of 55.85, 4.07 points above prior work. With five communication rounds, it reports 60.35, the best score among compared methods at the same round count.

### Source excerpt

arXiv:2611.24254v1 Announce Type: new Abstract: Federated learning enables collaborative model training without sharing datasets. However, existing federated learning methods for autonomous driving typically require multi-round communication and lack closed-loop evaluation, while one-shot methods mainly focus on perception tasks. To address these limitations, we propose \method, a one-shot federated learning method for end-to-end autonomous driving. It comprises multi-client calibration, anchor-based feature alignment, and token-wise consensus distillation to distill knowledge from heterogeneous models. Closed-loop evaluation on Bench2Drive demonstrates the effectiveness of \method in both one-shot and multi-round federated learning. In the one-shot setting, it achieves a Driving Score of 55.85, which is 4.07 points higher than prior work. In the multi-round setting, it reaches 60.35 after five communication rounds, the best performance among all compared methods under the same number of communication rounds.

## Does the Action Matter? Probing Action-Conditioned Semantic Forecasting as a World Model for Autonomous Driving

DevFeed: [Does the Action Matter? Probing Action-Conditioned Semantic Forecasting as a World Model for Autonomous Driving](<https://devfeed.tech/articles/does-the-action-matter-probing-action-conditioned-semantic-forecasting-as-a-world-model-for-autonomous-driving-142837.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24840>)

Author: Binay Kumar Singh, Niels Da Vitoria Lobo

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [World models](<https://devfeed.tech/topics/world-models.md>), [model architecture](<https://devfeed.tech/topics/model-architecture.md>)

Tags: [actions](<https://devfeed.tech/tags/actions.md>), [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [driving](<https://devfeed.tech/tags/driving.md>), [forecasting](<https://devfeed.tech/tags/forecasting.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [planning](<https://devfeed.tech/tags/planning.md>), [prediction](<https://devfeed.tech/tags/prediction.md>), [predictions](<https://devfeed.tech/tags/predictions.md>), [semantic](<https://devfeed.tech/tags/semantic.md>), [synthetic](<https://devfeed.tech/tags/synthetic.md>), [world-model](<https://devfeed.tech/tags/world-model.md>)

### AI overview

The study tests whether autonomous-driving semantic forecasts actually depend on the ego action, using test-time action interventions scored with segmentation metrics. The executed action improves mid-term mIoU by at most 2.5 points on Cityscapes and 0.6 on BDD100K; supplying a wrong action lowers it by up to 23.2 and 7.0 points, respectively, below a model without action input. On real data, feature-wise action conditioning is 1.6 times more action-dependent than input-level conditioning at similar accuracy; in a synthetic setting where history does not determine action, their dependence is equal. The findings indicate that accuracy gains show action use but do not establish how strongly forecasts rely on actions.

### Source excerpt

arXiv:2611.24840v1 Announce Type: cross Abstract: World models are increasingly used in autonomous driving to predict how a scene evolves under the ego vehicle's actions, supporting counterfactual reasoning and model-based planning. However, existing evaluations focus on prediction fidelity and planning performance, and rarely verify that the predictions depend on the conditioning action. In this paper, we study action dependence in action-conditioned semantic forecasting, which predicts future semantic segmentation from past segmentations and the ego action. We compare a forecaster with feature-wise and input-level action conditioning against an identical model without action input, and measure action dependence with test-time action interventions scored by standard segmentation metrics. The evaluation is validated in a synthetic environment with known action-dependent dynamics and applied to Cityscapes and BDD100K, both within each dataset and across the two vehicle platforms. Experiments show that the executed action improves mid-term mIoU by at most 2.5 points on Cityscapes and 0.6 points on BDD100K, whereas a wrong action reduces it by up to 23.2 and 7.0 points, below the model without action input. On real data, feature-wise conditioning depends 1.6 times more on the action than input-level conditioning at similar accuracy, whereas both depend on it equally in the synthetic environment, where the history does not determine the action. These results show that an accuracy gain indicates that a driving world model uses its action, but not how strongly its forecasts depend on it. Code is available at https://github.com/binayksingh/does-action-matter.

## RiskWorld: Risk-Aware World Modeling with Flow-Guided Occupancy Evolution for Selective Trajectory Planning in Automated Driving

DevFeed: [RiskWorld: Risk-Aware World Modeling with Flow-Guided Occupancy Evolution for Selective Trajectory Planning in Automated Driving](<https://devfeed.tech/articles/riskworld-risk-aware-world-modeling-with-flow-guided-occupancy-evolution-for-selective-trajectory-planning-in-automated-driving-142561.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2609.18442>)

Author: Rongxiang Zeng, Linsen Cai, Jiafu Zhang, Yijie Zhong, Yide Tao, Shuai Wang, Nan Zheng, Hai L. Vu, Alvaro Garcia Hernandez, Yongqi Dong

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [World models](<https://devfeed.tech/topics/world-models.md>)

Tags: [3](<https://devfeed.tech/tags/3.md>), [abstract](<https://devfeed.tech/tags/abstract.md>), [actor](<https://devfeed.tech/tags/actor.md>), [after](<https://devfeed.tech/tags/after.md>), [anchor](<https://devfeed.tech/tags/anchor.md>), [annotation](<https://devfeed.tech/tags/annotation.md>), [art](<https://devfeed.tech/tags/art.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [automated](<https://devfeed.tech/tags/automated.md>), [automated-driving](<https://devfeed.tech/tags/automated-driving.md>), [best](<https://devfeed.tech/tags/best.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-et](<https://devfeed.tech/tags/cs-et.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [cs-sy](<https://devfeed.tech/tags/cs-sy.md>), [driving](<https://devfeed.tech/tags/driving.md>), [eess-sy](<https://devfeed.tech/tags/eess-sy.md>), [evolution](<https://devfeed.tech/tags/evolution.md>), [flow](<https://devfeed.tech/tags/flow.md>), [modeling](<https://devfeed.tech/tags/modeling.md>), [planning](<https://devfeed.tech/tags/planning.md>), [risk](<https://devfeed.tech/tags/risk.md>), [trajectory-planning](<https://devfeed.tech/tags/trajectory-planning.md>), [with](<https://devfeed.tech/tags/with.md>), [world](<https://devfeed.tech/tags/world.md>)

### AI overview

RiskWorld forecasts evolving occupancy to estimate added collision risk and selectively replace a planned trajectory. It fuses spatial risk fields and actor history with bird's-eye-view features, transports occupancy and scene features using flow, and corrects occupancy with signed residuals. One forecast per planning step is reused across candidates; each is compared with a persistence reference, and replacement occurs only when predicted risk triggers intervention and an alternative meets component-wise risk and trajectory-error constraints. Candidate geometries remain unchanged. In open-loop nuScenes evaluation, it had the lowest collision rate at a 3-second horizon and the second-best average L2 error among the tested baselines. It ran at 11.5 FPS with 90.81 million parameters on one NVIDIA RTX 4090. Within-setting ablations report lower collision rates than current-state rescoring, while forecast reuse makes extra candidate evaluation inexpensive at the margin.

### Source excerpt

arXiv:2609.18442v2 Announce Type: replace Abstract: Safe motion planning in automated driving requires anticipating evolving traffic risks and deciding when to revise the current planned trajectory. We introduce RiskWorld, a risk-aware world modeling framework for shared occupancy forecasting and selective trajectory replacement. Spatial risk fields and temporal actor context are fused with visual bird's-eye-view features. Flow-guided evolution transports occupancy and scene features, while signed residuals correct occupancy after transport. One forecast is generated per planning step and reused across candidates. Each candidate is compared with a current-state persistence reference, yielding a nonnegative collision-score correction. The trajectory selected by current-world evaluation serves as the planning anchor and is replaced only when additional predicted risk triggers intervention and an alternative satisfies component-wise constraints on predicted risk and trajectory error. Candidate geometries remain unchanged. We evaluate RiskWorld for open-loop planning on nuScenes using camera features, annotation-derived current and historical actor states, and dataset-provided map context. RiskWorld achieves the lowest collision rate at a long evaluation horizon of 3 s, and the second-best average L2 error among various state-of-the-art baselines, while running at 11.5 FPS on a single NVIDIA RTX 4090 with 90.81 M parameters. Within-setting ablations show that RiskWorld achieves lower collision rates than the current-state rescoring baseline, while forecast reuse enables additional candidates to be evaluated at low marginal computational cost.

## DRIFT: Detachable Reasoning for Runtime-Flexible and Efficient End-to-End Driving

DevFeed: [DRIFT: Detachable Reasoning for Runtime-Flexible and Efficient End-to-End Driving](<https://devfeed.tech/articles/drift-detachable-reasoning-for-runtime-flexible-and-efficient-end-to-end-driving-143548.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24719>)

Author: Emad Aghajanzadeh, Bethany Anne Wong, Leonhard Kunze, Moritz Thoma, Maximilian Forstenh\\"ausler, Nael Fasfous, Manoj Rohit Vemparala, Pierpaolo Mori, Christos Anagnostopoulos, Daniel Mueller-Gritschne

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>)

Tags: [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [commentary](<https://devfeed.tech/tags/commentary.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [detachable](<https://devfeed.tech/tags/detachable.md>), [drift](<https://devfeed.tech/tags/drift.md>), [driving](<https://devfeed.tech/tags/driving.md>), [e2e](<https://devfeed.tech/tags/e2e.md>), [efficiently](<https://devfeed.tech/tags/efficiently.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [features](<https://devfeed.tech/tags/features.md>), [flexible](<https://devfeed.tech/tags/flexible.md>), [framework](<https://devfeed.tech/tags/framework.md>), [inference](<https://devfeed.tech/tags/inference.md>), [integration](<https://devfeed.tech/tags/integration.md>), [intermediate](<https://devfeed.tech/tags/intermediate.md>), [language](<https://devfeed.tech/tags/language.md>), [language-model](<https://devfeed.tech/tags/language-model.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [runtime](<https://devfeed.tech/tags/runtime.md>)

### AI overview

DRIFT combines a compact language model (under 150M parameters) for visual question answering and action commentary with a planning module that can use either the model's reasoning or distilled surrogate features. This lets deployment bypass the language model when constraints require it, while the authors report no loss of driving performance. The 255M-parameter system interleaves language and surrogate reasoning at a chosen rate; on Bench2Drive it reports a Driving Score up to 97.03 and an 89.39% success rate averaged over three runs, on par with the strongest non-language models. The abstract also reports competitive NAVSIM and AlpaSim results at lower computational cost than existing VLM-based approaches. These are abstract-level claims; comparative details and evaluation conditions are not provided here.

### Source excerpt

arXiv:2611.24719v1 Announce Type: cross Abstract: The integration of vision-language models (VLMs) into end-to-end (E2E) autonomous driving has demonstrated strong potential by providing scene description and reasoning capabilities. However, VLMs are computationally expensive, and switching language reasoning on and off at runtime without hurting closed-loop performance has not been demonstrated, which hinders practical adoption. To address these issues, we propose DRIFT, an E2E autonomous driving framework that integrates a lightweight language model (LM) for visual question answering and action commentary. By efficiently projecting intermediate driving representations into the language embedding space, we demonstrate that a compact LM (<150M parameters) can achieve strong scene description and action commentary. Furthermore, we introduce a runtime-flexible planning module that is trained on surrogate reasoning features distilled from the LM and can be conditioned on either the LM or the surrogate reasoning features at inference. This design enables bypassing the LM entirely when required by deployment constraints, without sacrificing driving performance. With only 255M parameters, DRIFT reaches up to a Driving Score (DS) of 97.03 and a Success Rate of 89.39% (mean over three runs) on Bench2Drive by interleaving its LM and surrogate reasoning at a chosen reasoning rate. This is on par with the strongest non-language models while being far more compact than existing VLM-based models. DRIFT further achieves competitive results on the real-world NAVSIM and AlpaSim benchmarks at significantly lower computational cost than existing VLM-based approaches. Project page: https://drift-e2e.github.io/

## Waymo Robotaxis Pulled From Freeways Indefinitely

DevFeed: [Waymo Robotaxis Pulled From Freeways Indefinitely](<https://devfeed.tech/articles/waymo-robotaxis-pulled-from-freeways-indefinitely-141014.md>)

Original publisher: [Read original article](<https://tech.slashdot.org/story/26/11/18/1743211/waymo-robotaxis-pulled-from-freeways-indefinitely>)

Author: BeauHD

Published: 2026-11-18T18:00:00Z

Content type: news

Language: en

Sources: [Slashdot](<https://devfeed.tech/sources/slashdot.md>)

Topics: [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>)

Tags: [california](<https://devfeed.tech/tags/california.md>), [construction](<https://devfeed.tech/tags/construction.md>), [dmv](<https://devfeed.tech/tags/dmv.md>), [highway](<https://devfeed.tech/tags/highway.md>), [incidents](<https://devfeed.tech/tags/incidents.md>), [recall](<https://devfeed.tech/tags/recall.md>), [regulators](<https://devfeed.tech/tags/regulators.md>), [robotaxis](<https://devfeed.tech/tags/robotaxis.md>), [software-updates](<https://devfeed.tech/tags/software-updates.md>), [transportation](<https://devfeed.tech/tags/transportation.md>), [waymo](<https://devfeed.tech/tags/waymo.md>)

### AI overview

California regulators restricted Waymo freeway operations after repeated construction-zone encounters on U.S. 101, and Waymo temporarily suspended freeway service in its other markets while it evaluates performance. The move follows a June recall of nearly 3,800 vehicles and software updates that did not prevent further incidents, including one robotaxi passing a California Highway Patrol rolling roadblock. Waymo said the recent encounters involved no injuries or collisions, and that surface-street ride-hailing continues, with more than half a million trips each week. It is working with California officials to resume freeway operations. Before the suspension, freeway service was limited to Los Angeles, the Bay Area, and Arizona.

### Source excerpt

Waymo has temporarily suspended freeway operations across all its robotaxi markets after California regulators ordered the company off the state's highways over repeated incidents involving construction zones. The restriction follows a June recall (PDF) of nearly 3,800 vehicles and subsequent software updates (PDF) that failed to prevent further incidents, including a robotaxi driving past a California Highway Patrol rolling roadblock. Ars Technica reports: "Safety is at the foundation of everything we do," Waymo told Ars. "Following recent freeway construction zone encounters on U.S. 101 in California that did not involve any injuries or collisions, the California DMV has implemented an operating restriction on freeway operations in the state. In alignment with our safety-first principles, we have also temporarily restricted freeway operations across our other operating markets to evaluate our performance. Our ride-hailing service continues to operate safely on surface streets, serving over half a million trips each week. We are working with the California DMV and other state officials diligently and responsibly to resume freeway operations." Waymo also told Ars it was continuing to work with the various California agencies that regulate transport. Until the suspension, Waymo was only conducting highway operations in Los Angeles and the Bay Area in California, as well as in Arizona. Read more of this story at Slashdot.

## Waymo pulls driverless cars from highways nationwide after California ban

DevFeed: [Waymo pulls driverless cars from highways nationwide after California ban](<https://devfeed.tech/articles/waymo-pulls-driverless-cars-from-highways-nationwide-after-california-ban-140873.md>)

Original publisher: [Read original article](<https://www.techspot.com/news/114606-waymo-pulls-driverless-cars-highways-nationwide-after-california.html>)

Author: Skye Jacobs

Published: 2026-11-18T16:38:00Z

Content type: news

Language: en

Sources: [TechSpot](<https://devfeed.tech/sources/techspot.md>)

Topics: [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [Physical AI](<https://devfeed.tech/topics/physical-ai.md>), [Resilience](<https://devfeed.tech/topics/resilience.md>)

Tags: [airport](<https://devfeed.tech/tags/airport.md>), [autonomous](<https://devfeed.tech/tags/autonomous.md>), [autonomous-vehicle](<https://devfeed.tech/tags/autonomous-vehicle.md>), [autonomous-vehicle-safety](<https://devfeed.tech/tags/autonomous-vehicle-safety.md>), [ban](<https://devfeed.tech/tags/ban.md>), [california](<https://devfeed.tech/tags/california.md>), [car-tech](<https://devfeed.tech/tags/car-tech.md>), [construction](<https://devfeed.tech/tags/construction.md>), [dmv](<https://devfeed.tech/tags/dmv.md>), [highway](<https://devfeed.tech/tags/highway.md>), [regulations](<https://devfeed.tech/tags/regulations.md>), [tech-culture](<https://devfeed.tech/tags/tech-culture.md>), [waymo](<https://devfeed.tech/tags/waymo.md>)

### AI overview

After California ordered Waymo to stop operating and testing driverless vehicles on state freeways, citing an imminent public-safety hazard, the company removed its cars from highways nationwide. The order followed three vehicles entering a closed construction lane on Highway 101 and one attempting to pass police vehicles slowing traffic on Interstate 280. California requires Waymo to submit its next corrective fix for regulatory review before freeway operations resume; the order has no stated timeline. Waymo said it would review vehicle performance, but has not described proposed changes or a return date. The incidents exposed difficulty responding to temporary lane closures and police-directed traffic at freeway speeds. The restriction may hinder airport trips, which often use freeways, though surface-street routes remain possible and may be less convenient.

### Source excerpt

The DMV directive requires Waymo to stop both operating and testing its driverless vehicles on all California freeways, citing "an imminent hazard to public safety." The order will remain in effect until the company takes "effective corrective actions," the agency said. It did not provide a timeline. Read Entire Article

## Multimodal Masked Diffusion Autoencoder for Modeling Impaired Driving

DevFeed: [Multimodal Masked Diffusion Autoencoder for Modeling Impaired Driving](<https://devfeed.tech/articles/multimodal-masked-diffusion-autoencoder-for-modeling-impaired-driving-141861.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23211>)

Author: John Gideon, Anshul Gupta, Megan Applegate-Kenton, Kayli Battel, Todd J Rowell, Patricio Reyes Gomez, Laporsha Dees, Emily Sumner, Avinash Balachandran, Guy Rosman

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Transformers](<https://devfeed.tech/topics/transformers.md>), [diffusion-transformers](<https://devfeed.tech/topics/diffusion-transformers.md>), [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [Image](<https://devfeed.tech/topics/image.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [attention](<https://devfeed.tech/tags/attention.md>), [autoencoder](<https://devfeed.tech/tags/autoencoder.md>), [behavior](<https://devfeed.tech/tags/behavior.md>), [code](<https://devfeed.tech/tags/code.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [data](<https://devfeed.tech/tags/data.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [decoding](<https://devfeed.tech/tags/decoding.md>), [design](<https://devfeed.tech/tags/design.md>), [detection](<https://devfeed.tech/tags/detection.md>), [diffusion](<https://devfeed.tech/tags/diffusion.md>), [driving](<https://devfeed.tech/tags/driving.md>), [effects](<https://devfeed.tech/tags/effects.md>), [environment](<https://devfeed.tech/tags/environment.md>), [improvements](<https://devfeed.tech/tags/improvements.md>), [inference](<https://devfeed.tech/tags/inference.md>), [input](<https://devfeed.tech/tags/input.md>), [modeling](<https://devfeed.tech/tags/modeling.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>)

### AI overview

ID-MAE combines impairment-label prediction with self-supervised reconstruction of masked gaze and trajectory, aiming to improve impairment inference when cognitive-state labels are costly. The authors introduce DIVERT, a driving-simulator dataset with 103 hours from 109 participants, covering ten cognitive, visual, and emotional impairment inductions and recording gaze, vehicle state, and scene video. On location-matched DIVERT pairs, ID-MAE reaches a paired AUC of 0.706 for impairment detection, versus 0.590 without reconstruction loss; the abstract also reports improvements on existing datasets and strong trajectory and gaze prediction. The authors report that visually demanding distractions are separable from cognitive distractions. Code and data are planned for release upon acceptance.

### Source excerpt

arXiv:2611.23211v1 Announce Type: cross Abstract: Human cognitive state (e.g., distraction, stress), gaze, and behavior interact with the driving environment in subtle ways that AI could use to assist drivers, but ground-truth labels for human cognitive state levels are costly to obtain at scale. We propose a multimodal masked-diffusion autoencoder, ID-MAE, that adds a self-supervised objective to impairment prediction: alongside predicting the impairment label as a masked token, it reconstructs masked gaze and trajectory. To probe the effects of different modalities and types of impairments on model inference, we introduce DIVERT, a driving-simulator dataset containing 103 hours of driving data (n = 109) with ten impairment inductions spanning cognitive, visual, and emotional states, recorded with gaze, vehicle state, and scene video. We demonstrate how ID-MAE affords significant improvements in impairment inference results on both the DIVERT dataset and existing datasets, and enables strong results in additional tasks, such as trajectory and gaze prediction. For location-matched pairs, our model achieves a paired AUC of 0.706 for impairment detection on DIVERT, compared to 0.590 without reconstruction loss, improving over existing baselines. We probe the design space in terms of input modalities, masking scheme, positional encoding, attention mechanism, and decoding. We also investigate the interaction between various impairments in training and inference, demonstrating that visually demanding distractions are separable from cognitive distractions. Code and data will be available upon acceptance.

## Guarded Swarms in the Loop: A ROS 2/PX4 Digital Twin for Hybrid Digital-Analog Coordination of UAV/UGV Swarms

DevFeed: [Guarded Swarms in the Loop: A ROS 2/PX4 Digital Twin for Hybrid Digital-Analog Coordination of UAV/UGV Swarms](<https://devfeed.tech/articles/guarded-swarms-in-the-loop-a-ros-2-px4-digital-twin-for-hybrid-digital-analog-coordination-of-uav-ugv-swarms-141498.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22773>)

Author: Uwe M. Borghoff, Paolo Bottoni, Luca D'Aurizio, Remo Pareschi

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>)

Topics: [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [Physical AI](<https://devfeed.tech/topics/physical-ai.md>), [Security](<https://devfeed.tech/topics/security.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [abstract](<https://devfeed.tech/tags/abstract.md>), [all](<https://devfeed.tech/tags/all.md>), [also](<https://devfeed.tech/tags/also.md>), [analog](<https://devfeed.tech/tags/analog.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [attack](<https://devfeed.tech/tags/attack.md>), [attack-surface](<https://devfeed.tech/tags/attack-surface.md>), [authorization](<https://devfeed.tech/tags/authorization.md>), [autopilot](<https://devfeed.tech/tags/autopilot.md>), [based](<https://devfeed.tech/tags/based.md>), [board](<https://devfeed.tech/tags/board.md>), [bounded](<https://devfeed.tech/tags/bounded.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [cs-ma](<https://devfeed.tech/tags/cs-ma.md>), [digital](<https://devfeed.tech/tags/digital.md>), [digital-twin](<https://devfeed.tech/tags/digital-twin.md>), [hybrid](<https://devfeed.tech/tags/hybrid.md>), [in-the-loop](<https://devfeed.tech/tags/in-the-loop.md>), [ros](<https://devfeed.tech/tags/ros.md>), [ros-2](<https://devfeed.tech/tags/ros-2.md>)

### AI overview

The study implements Guarded Swarms as a ROS 2, PX4 software-in-the-loop, and Gazebo digital twin with two UAVs and one UGV. Its TB-CSPN coordination chain maps to ROS 2 nodes, while a per-vehicle Virtual Safety Board gates commands through an independent safety layer. Across 60 counterfactual runs, the three stated guarantees against missions based on conflicting, temporally incoherent, or unauthorized evidence held at three chain stages. Fault injection showed the safety veto prevented all collisions caused by forged missions or compromised workers only when enforced by an independent gate; a veto controlled by the compromised worker prevented none. The abstract also reports implementation hazards beyond the architecture specification and distinguishes properties testable in simulation from those requiring hardware.

### Source excerpt

arXiv:2611.22773v1 Announce Type: new Abstract: Swarms of unmanned aerial and ground vehicles (UAV/UGV) operating in contested environments cannot rely on software alone for physical safety, since the software stack and its networks are part of the attack surface. The Guarded Swarms architecture addresses this by pairing a digital coordination layer, built on Topic-Based Communication Space Petri Nets (TB-CSPN), with an independent analog safety layer that can veto unsafe actuation commands. So far, the architecture has been specified and argued for, but not executed. We present the first executable instantiation of Guarded Swarms as a digital twin built on ROS 2, the PX4 autopilot in software-in-the-loop mode, and Gazebo, with two UAVs and one UGV in a coastal counter-UAS scenario. The TB-CSPN transition chain, from multi-modal sensing through human authorization to vehicle tasking, is mapped one-to-one onto ROS 2 nodes, and the analog layer is modeled as a per-vehicle Virtual Safety Board that gates every command. Eight groups of experiments show that the three negative guarantees of the architecture (no mission from conflicting, temporally incoherent, or unauthorized evidence) hold at three distinct stages of the chain in all 60 counterfactual runs; that threat confirmation is bounded by the narrowest sensing modality; that the safety layer exercises its full modeled envelope independently of the coordination layer; and, under fault injection, that it prevents every collision caused by a forged mission or a compromised worker once its veto is enforced by an independent gate, whereas a veto left to the compromised worker prevents none. The twin also exposes implementation-level hazards that the architectural specification does not address, and it draws an explicit line between the properties that simulation can validate and those that only hardware can.

## AR-WAM: efficient streaming world-action modeling for autonomous driving

DevFeed: [AR-WAM: efficient streaming world-action modeling for autonomous driving](<https://devfeed.tech/articles/ar-wam-efficient-streaming-world-action-modeling-for-autonomous-driving-139919.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.21851>)

Author: Baiting Luo, Shatadal Mishra, Ahmadreza Moradipari, Nejib Ammar

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [World models](<https://devfeed.tech/topics/world-models.md>), [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [Reinforcement learning](<https://devfeed.tech/topics/reinforcement-learning.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>)

Tags: [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [autoregressive](<https://devfeed.tech/tags/autoregressive.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [streaming](<https://devfeed.tech/tags/streaming.md>)

### AI overview

AR-WAM reduces the cost of driving-world prediction by incrementally reusing visual history with a causal video backbone, then computing future features in one pass to condition trajectory generation. Reinforcement learning further optimizes driving rewards. With a single front camera, it reports 91.5 PDMS after supervised training and 94.0 after reinforcement learning on NAVSIM-v1, outperforming the compared end-to-end world-action models. In continuous driving, supervised AR-WAM retains visual history across decisions and outperforms the cited baselines. These results are reported in the supplied abstract.

### Source excerpt

arXiv:2611.21851v1 Announce Type: cross Abstract: Autonomous driving requires anticipating how traffic will evolve while responding quickly to new observations. Video foundation models offer the first ability, but repeated history encoding and iterative video generation make them costly to use for driving. We present AR-WAM, an efficient streaming world-action model that combines autoregressive temporal modeling with single-pass future conditioning. Because its video backbone is causal, AR-WAM updates its visual context incrementally, reusing past computation and conditioning future prediction on observed motion. We further hypothesize that future features computed from recent observations can improve generalization in dynamic traffic without iterative video generation. AR-WAM therefore obtains these features in one forward pass and uses them to condition trajectory generation, and reinforcement learning then improves the policy through direct optimization of driving rewards. With a single front camera, AR-WAM achieves 91.5 PDMS after supervised training and 94.0 after reinforcement learning on NAVSIM-v1, outperforming the compared strong end-to-end world-action models. In a dynamic setting of continuous driving, supervised AR-WAM keeps its visual history across decisions and outperforms strong world-action baselines.

## AutoE2E: Don't speak - Language free end-to-end autonomy A Real-Time Driving Model for L2++ ADAS and L4 Robotaxis

DevFeed: [AutoE2E: Don't speak - Language free end-to-end autonomy A Real-Time Driving Model for L2++ ADAS and L4 Robotaxis](<https://devfeed.tech/articles/autoe2e-don-t-speak-language-free-end-to-end-autonomy-a-real-time-driving-model-for-l2-adas-and-l4-robotaxis-140020.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22374>)

Author: Muhammad Zain Khawaja, Zaynab El Mawas, Ryota Yamada, Gabriela Cordova, Arseni Lysak, Intisar Chowdhury, Bharat Jayaprakash, Apostolos Georgiadis, Shri Harsha Adapala, Jatin Gautam, Christoph Bank, Al

Published: 2026-11-18T05:00:00Z

Content type: release

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [NVIDIA DRIVE](<https://devfeed.tech/topics/nvidia-drive.md>)

Tags: [adas](<https://devfeed.tech/tags/adas.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [autonomous](<https://devfeed.tech/tags/autonomous.md>), [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [autonomy](<https://devfeed.tech/tags/autonomy.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [camera](<https://devfeed.tech/tags/camera.md>), [checkpoint](<https://devfeed.tech/tags/checkpoint.md>), [code](<https://devfeed.tech/tags/code.md>), [collaboration](<https://devfeed.tech/tags/collaboration.md>), [community](<https://devfeed.tech/tags/community.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [dashboard](<https://devfeed.tech/tags/dashboard.md>), [driving](<https://devfeed.tech/tags/driving.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [experimentation](<https://devfeed.tech/tags/experimentation.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [fde](<https://devfeed.tech/tags/fde.md>), [model](<https://devfeed.tech/tags/model.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [robotaxis](<https://devfeed.tech/tags/robotaxis.md>)

### AI overview

AutoE2E is an open-source end-to-end driving model that combines multi-camera perception, HD-map information and route conditioning in a temporal bird's-eye-view architecture to predict vehicle motion. Its v1.0 release includes checkpoints, training and evaluation code, and DataModelConsole for inspecting experiments. On KITScenes validation, the fine-tuned checkpoint reports 0.745 m average displacement error and 2.020 m final displacement error over a three-second horizon. The paper also describes preliminary real-vehicle research on TUM's EDGAR platform and ongoing collaboration with KIT. The release is an early research baseline: quantitative results are open-loop, and validated closed-loop autonomous driving has not been demonstrated.

### Source excerpt

arXiv:2611.22374v1 Announce Type: new Abstract: AutoE2E is an open-source end-to-end driving model developed by the Autoware Foundation Robotaxi Working Group. It introduces a temporal bird's-eye-view (BEV) architecture that combines multi-camera perception, HD-map information and route conditioning to predict future vehicle motion. The evaluated model uses a pretrained camera-BEV backbone, temporal feature fusion and a lightweight recurrent trajectory planner. It contains approximately 79.9 million parameters, of which approximately 1.45 million are trainable in the evaluated configuration. The v1.0 release provides model checkpoints, training and evaluation code, and DataModelConsole, a dashboard for visualizing and inspecting model experiments. On the KITScenes validation benchmark, the fine-tuned checkpoint achieves an average displacement error (ADE) of 0.745 m and a final displacement error (FDE) of 2.020 m at a three-second prediction horizon. The paper also reports preliminary real-vehicle research conducted with the Technical University of Munich's EDGAR platform, alongside ongoing collaboration with the Karlsruhe Institute of Technology. AutoE2E v1.0 is an early open research release. Its quantitative evaluation is open-loop, and the model has not yet demonstrated validated closed-loop autonomous driving. The release is intended to provide the autonomous-driving community with an inspectable baseline for further research, experimentation and collaborative development.

## Learning Agent-Centric Vision-Language-Action World Models for Autonomous Driving

DevFeed: [Learning Agent-Centric Vision-Language-Action World Models for Autonomous Driving](<https://devfeed.tech/articles/learning-agent-centric-vision-language-action-world-models-for-autonomous-driving-140090.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22880>)

Author: Guoqing Wang, Pin Tang, Xiangxuan Ren, Chao Ma

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [World models](<https://devfeed.tech/topics/world-models.md>), [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [vlm](<https://devfeed.tech/topics/vlm.md>), [Representation learning](<https://devfeed.tech/topics/representation-learning.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>)

Tags: [3d](<https://devfeed.tech/tags/3d.md>), [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [planning](<https://devfeed.tech/tags/planning.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [supervised-fine-tuning](<https://devfeed.tech/tags/supervised-fine-tuning.md>), [vision-language-action](<https://devfeed.tech/tags/vision-language-action.md>), [world-models](<https://devfeed.tech/tags/world-models.md>)

### AI overview

AgentWorld models driving futures with compact, structured agent tokens instead of dense pixel-level predictions, aiming to focus planning on object geometry, motion, and interactions. Each discrete token is grounded to a surrounding agent and represents properties such as semantic identity, 3D geometry, motion, and interaction context; the tokens support both reasoning and trajectory planning. The model learns them through explicit geometric grounding, reasoning-oriented supervised fine-tuning, and agent-oriented reinforcement learning. The abstract reports improved planning in open-loop and closed-loop experiments across diverse driving scenarios, along with interpretable agent-centric world states. It provides no quantitative results or comparison details.

### Source excerpt

arXiv:2611.22880v1 Announce Type: cross Abstract: Recent progress in integrating vision-language-action (VLA) models with world modeling has significantly advanced end-to-end autonomous driving by allowing systems to reason about imagined futures instead of merely reacting to current observations. However, most world VLA models generate future frames at the pixel level with plenty of dense visual tokens. Although such generated futures can be visually plausible, they preserve many driving-irrelevant appearance details, i.e., only a small portion of the tokens directly encode critical planning-relevant factors, such as agent geometry, motion dynamics, and interactions. This introduces a significant performance bottleneck. An important question thus arises: what world state should a world VLA model reason over to support planning beyond pixel-level prediction? We argue that planning-oriented world modeling should focus on a compact and structured agent-centric latent state that captures the interactions between objects in the driving scene over time. As such, we introduce AgentWorld, an agent-centric VLA world model that uses discrete agent tokens jointly for reasoning and trajectory planning. Each token is dynamically grounded to a surrounding agent associated with its object's state, such as semantic identity, 3D geometry, motion, and interaction context. AgentWorld learns these tokens through three key processes: explicit geometric grounding, reasoning-oriented supervised fine-tuning, and agent-oriented reinforcement learning. Extensive open-loop and closed-loop experiments under diverse driving scenarios show that AgentWorld enhances planning capabilities, fully exploits visual evidence and agent dynamics, and yields interpretable agent-centric world states.

## Human-like Semantic Navigation for Autonomous Driving using Knowledge Representation and Large Language Models

DevFeed: [Human-like Semantic Navigation for Autonomous Driving using Knowledge Representation and Large Language Models](<https://devfeed.tech/articles/human-like-semantic-navigation-for-autonomous-driving-using-knowledge-representation-and-large-language-models-139741.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2505.16498>)

Author: Augusto Luis Ballardini, Miguel \\'Angel Sotelo

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [база знаний](<https://devfeed.tech/topics/tag-c51cc4bf76e5.md>), [rule-engine](<https://devfeed.tech/topics/rule-engine.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [automation](<https://devfeed.tech/tags/automation.md>), [autonomous](<https://devfeed.tech/tags/autonomous.md>), [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [autonomous-navigation](<https://devfeed.tech/tags/autonomous-navigation.md>), [autonomous-vehicles](<https://devfeed.tech/tags/autonomous-vehicles.md>), [based](<https://devfeed.tech/tags/based.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [driving](<https://devfeed.tech/tags/driving.md>), [knowledge](<https://devfeed.tech/tags/knowledge.md>), [language](<https://devfeed.tech/tags/language.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [large](<https://devfeed.tech/tags/large.md>), [large-language-models](<https://devfeed.tech/tags/large-language-models.md>), [like](<https://devfeed.tech/tags/like.md>), [models](<https://devfeed.tech/tags/models.md>), [navigation](<https://devfeed.tech/tags/navigation.md>), [semantic](<https://devfeed.tech/tags/semantic.md>), [semantic-navigation](<https://devfeed.tech/tags/semantic-navigation.md>), [using](<https://devfeed.tech/tags/using.md>)

### AI overview

The method translates informal navigation instructions into Answer Set Programming (ASP) constraints using large language models, turning human-expressed intent into logic-based rules for autonomous driving. ASP's non-monotonic reasoning is intended to help vehicles adapt to changing road layouts, detours, or missing map data without relying on predefined maps. The abstract reports experimental evaluation and claims improved adaptability and explainability, but provides no quantitative results or implementation details.

### Source excerpt

arXiv:2505.16498v2 Announce Type: replace-cross Abstract: Achieving full automation in self-driving vehicles remains a challenge, especially in dynamic urban environments where navigation requires real-time adaptability. Existing systems struggle to handle navigation plans when faced with unpredictable changes in road layouts, spontaneous detours, or missing map data, due to their heavy reliance on predefined cartographic information. In this work, we explore the use of Large Language Models to generate Answer Set Programming rules by translating informal navigation instructions into structured, logic-based reasoning. ASP provides non-monotonic reasoning, allowing autonomous vehicles to adapt to evolving scenarios without relying on predefined maps. We present an experimental evaluation in which LLMs generate ASP constraints that encode real-world urban driving logic into a formal knowledge representation. By automating the translation of informal navigation instructions into logical rules, our method improves adaptability and explainability in autonomous navigation. Results show that LLM-driven ASP rule generation supports semantic-based decision-making, offering an explainable framework for dynamic navigation planning that aligns closely with how humans communicate navigational intent.

## FIRE-Drive: Feasibility-Informed Risk Evaluation for End-to-End Diffusion Planning

DevFeed: [FIRE-Drive: Feasibility-Informed Risk Evaluation for End-to-End Diffusion Planning](<https://devfeed.tech/articles/fire-drive-feasibility-informed-risk-evaluation-for-end-to-end-diffusion-planning-140006.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22297>)

Author: Qifeng Xie, Kai-Yuan Feng, Wenkang Wan, Yue Wu, Maoguo Gong, Kai Sheng

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [Model Development](<https://devfeed.tech/topics/model-development.md>)

Tags: [autonomous](<https://devfeed.tech/tags/autonomous.md>), [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [candidate](<https://devfeed.tech/tags/candidate.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [diffusion](<https://devfeed.tech/tags/diffusion.md>), [driving](<https://devfeed.tech/tags/driving.md>), [end-to-end-autonomous-driving](<https://devfeed.tech/tags/end-to-end-autonomous-driving.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [eye](<https://devfeed.tech/tags/eye.md>), [framework](<https://devfeed.tech/tags/framework.md>), [interaction](<https://devfeed.tech/tags/interaction.md>), [lightweight](<https://devfeed.tech/tags/lightweight.md>), [local](<https://devfeed.tech/tags/local.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [performance](<https://devfeed.tech/tags/performance.md>), [planning](<https://devfeed.tech/tags/planning.md>), [plausible](<https://devfeed.tech/tags/plausible.md>), [progress](<https://devfeed.tech/tags/progress.md>), [risk](<https://devfeed.tech/tags/risk.md>), [safety](<https://devfeed.tech/tags/safety.md>)

### AI overview

FIRE-Drive aims to improve diffusion-based autonomous driving plans by addressing infeasible trajectory initialization and difficulty distinguishing similar candidates by safety, interaction risk, and progress. It combines dynamic feasible anchor initialization, candidate-specific bird's-eye-view risk evidence for scoring, and compact high-quality candidate supervision with lightweight refinement. The authors report a Predictive Driver Model Score of 91.5 on NAVSIM v1 with a ResNet34 backbone; in closed-loop evaluation on 220 Bench2Drive routes, it scores 71.43 with a 42.73% success rate. Component ablations and a scorer comparison using matched candidate inputs support the contributions of these design elements. These results are those reported in the supplied abstract excerpt.

### Source excerpt

arXiv:2611.22297v1 Announce Type: cross Abstract: Diffusion-based end-to-end autonomous driving models have shown strong potential in generating multimodal planning trajectories. However, their performance still depends heavily on trajectory initialization, mode evaluation, and supervision quality. Weakly constrained noisy initialization may introduce infeasible proposals and increase the burden of denoising. Moreover, selecting the optimal mode remains challenging when candidate trajectories are geometrically similar but differ in safety, interaction risk, and progress. To address these issues, we propose FIRE-Drive, a feasibility-informed risk evaluation framework for end-to-end autonomous driving. FIRE-Drive improves diffusion-based planning through dynamic feasible anchor initialization, candidate-specific bird's-eye-view risk evidence, and compact high-quality candidate supervision with lightweight refinement. This design aligns the initial support, risk-aware scoring, and multimodal supervision of trajectory modes under a unified planning objective. It enables the diffusion decoder to focus on refining plausible trajectories while the scorer distinguishes modes using local risk evidence. Experiments on NAVSIM v1 show that FIRE-Drive achieves a Predictive Driver Model Score of 91.5 with a ResNet34 backbone. Additional closed-loop evaluation on 220 Bench2Drive routes yields a Driving Score of 71.43 and a Success Rate of 42.73%. Component ablations and a scorer comparison under matched candidate inputs support the contributions of feasible initialization, auxiliary supervision, and risk-informed selection. Our code is available at https://github.com/Latte00/FIRE-drive.

## Making the World React Realistically: A Closed-Loop Interactive World Model for Autonomous Driving

DevFeed: [Making the World React Realistically: A Closed-Loop Interactive World Model for Autonomous Driving](<https://devfeed.tech/articles/making-the-world-react-realistically-a-closed-loop-interactive-world-model-for-autonomous-driving-140067.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22691>)

Author: Jia Hu, Yang Chang, Panqu Wang, Zhijun Fu, Chang Liu, Changjian Yu, Jintao Lai

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [World models](<https://devfeed.tech/topics/world-models.md>), [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [gaussian splatting](<https://devfeed.tech/topics/gaussian-splatting.md>)

Tags: [3d](<https://devfeed.tech/tags/3d.md>), [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [behavior](<https://devfeed.tech/tags/behavior.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [gaussian](<https://devfeed.tech/tags/gaussian.md>), [interaction](<https://devfeed.tech/tags/interaction.md>), [interactive](<https://devfeed.tech/tags/interactive.md>), [multi-agent](<https://devfeed.tech/tags/multi-agent.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [rendering](<https://devfeed.tech/tags/rendering.md>), [vehicle](<https://devfeed.tech/tags/vehicle.md>), [vehicles](<https://devfeed.tech/tags/vehicles.md>), [world-model](<https://devfeed.tech/tags/world-model.md>)

### AI overview

The proposed closed-loop world model couples background-vehicle behavior with the images an ego planner sees. It fine-tunes imitation-learned vehicle policies through multi-agent reinforcement learning against an image-reactive planner; uses interaction viewpoints to reduce view-dependent color on under-observed 3D Gaussians and fill unseen vehicle surfaces with generated Gaussians; and edits signal lights to reflect driving intentions, learning unobserved states through counterfactual fine-tuning with a light-state classifier. In long-tail closed-loop scenarios, it reports 85% lower divergence from real interaction behavior and a 2.0 dB gain in novel-view vehicle PSNR over the state-of-the-art world model. Rendered vehicle signals indirectly affect ego behavior in a quarter of scenarios.

### Source excerpt

arXiv:2611.22691v1 Announce Type: cross Abstract: World models (WMs) generate driving scenarios beyond recorded logs, enabling the training and evaluation of autonomous driving systems in unseen interactions. However, existing WMs struggle to ensure both behavioral realism and visual fidelity, since they overlook the relationship between vehicle interactions and the ego visual observations. We propose a closed-loop interactive WM that couples behavior modeling and visual rendering. First, imitation-learned background-vehicle (BV) policies are fine-tuned with multi-agent reinforcement learning in the closed loop against an end-to-end ego planner that reacts to the rendered images, so that their interaction behaviors match those in real logs. Second, the viewpoints exposed by these interactions guide a per-Gaussian diagnosis of each 3D Gaussian vehicle asset, which attenuates view-dependent colors on under-observed Gaussians and fills never-observed surfaces with generated Gaussians, while preserving the observed appearance. Third, signal lights are rendered according to the driving intentions of the vehicles, by an editor that learns the light states unobserved for a vehicle through counterfactual fine-tuning with a light-state classifier. On long-tail closed-loop scenarios, our method reduces the divergence from real-world interaction behaviors by 85% and improves novel-view vehicle PSNR by 2.0dB over the state-of-the-art WM. The significance of BV light signaling in WMs is shown, as the rendered signal lights conveying BV driving intentions indirectly impact ego driving behaviors in a quarter of the scenarios.

## The Defense Rests: A Courtroom-Inspired Multi-Agent LLM Framework for Automated Safety Case Generation

DevFeed: [The Defense Rests: A Courtroom-Inspired Multi-Agent LLM Framework for Automated Safety Case Generation](<https://devfeed.tech/articles/the-defense-rests-a-courtroom-inspired-multi-agent-llm-framework-for-automated-safety-case-generation-139578.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.21618>)

Author: Gerhard Yu (Alex), Amanuel Aknaw (Alex), Amir Ali Mohaghegh (Alex), Yong Song (Alex), Cao, Alvine B. Belle

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Software Engineering](<https://devfeed.tech/sources/arxiv-software-engineering.md>)

Topics: [Multi Agent Systems](<https://devfeed.tech/topics/multi-agent-systems.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [ai safety](<https://devfeed.tech/topics/ai-safety.md>), [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-framework](<https://devfeed.tech/tags/agent-framework.md>), [agents](<https://devfeed.tech/tags/agents.md>), [analyst](<https://devfeed.tech/tags/analyst.md>), [argument](<https://devfeed.tech/tags/argument.md>), [arguments](<https://devfeed.tech/tags/arguments.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [automated](<https://devfeed.tech/tags/automated.md>), [autonomous](<https://devfeed.tech/tags/autonomous.md>), [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [autonomous-vehicles](<https://devfeed.tech/tags/autonomous-vehicles.md>), [board](<https://devfeed.tech/tags/board.md>), [case](<https://devfeed.tech/tags/case.md>), [cases](<https://devfeed.tech/tags/cases.md>), [cs-ma](<https://devfeed.tech/tags/cs-ma.md>), [cs-se](<https://devfeed.tech/tags/cs-se.md>), [defense](<https://devfeed.tech/tags/defense.md>), [framework](<https://devfeed.tech/tags/framework.md>), [generation](<https://devfeed.tech/tags/generation.md>), [llm](<https://devfeed.tech/tags/llm.md>), [multi-agent](<https://devfeed.tech/tags/multi-agent.md>), [safety](<https://devfeed.tech/tags/safety.md>)

### AI overview

eTrustWare uses coordinated LLM agents to generate and review safety cases for mission-critical systems. Its courtroom-inspired roles assign hazard identification to a safety analyst, safety argument construction and evidence to an assurance case developer, interaction coordination to an orchestrator, and completeness and persuasiveness review to a board. Experiments on several safety cases for ML-enabled autonomous driving systems demonstrate the feasibility of this approach; the excerpt provides no detailed performance results.

### Source excerpt

arXiv:2611.21618v1 Announce Type: new Abstract: Safety cases are widely used to demonstrate that mission-critical systems, such as autonomous vehicles and unmanned aerial systems, can operate safely after deployment. However, manually constructing safety cases is complex, time-consuming, and labor-intensive, which calls for the proposal of automated approaches to support their creation. Inspired by the legal nature of safety case construction, we formalize the safety case creation problem through a courtroom analogy, where stakeholders collaboratively propose, examine, criticize, review, improve and validate safety claims and their supporting evidence. In this analogy, the safety analyst acts as a prosecutor by identifying hazards and safety concerns, while the assurance case developer serves as a defense attorney by constructing and substantiating safety arguments. An orchestrator acts as a judge by coordinating stakeholder interactions, and a review board serves as a jury by assessing argument completeness and persuasiveness. Based on this formalization, we propose eTrustWare, a Large Language Model (LLM)-based multi-agent framework for automated safety case generation and review. Our experiments on several safety cases of ML-enabled autonomous driving systems demonstrate the feasibility of coordinated LLM-based agents for generating safety cases.

[Next page](<https://devfeed.tech/topics/autonomous-vehicles.md?cursor=WyIyMDI2LTExLTE4VDA1OjAwOjAwKzAwOjAwIiwgIjBmMWYxMDBjLWY3ODEtNGUzZC04YmZiLWUyYzVkYzM4ZTE5OSJd>)