# Digital-Twin-Referenced Belief-Guided Q-Learning for Jammer Identification and Beam-Power Control in a mmWave Model

DevFeed: [Digital-Twin-Referenced Belief-Guided Q-Learning for Jammer Identification and Beam-Power Control in a mmWave Model](<https://devfeed.tech/articles/digital-twin-referenced-belief-guided-q-learning-for-jammer-identification-and-beam-power-control-in-a-mmwave-model-100257.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2610.16770>)

Author: Parmida Geranmayeh, Onur G\\"unl\\"u

Published: 2026-10-26T04:00:00Z

Content type: article

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>)

Topics: [AI Networking](<https://devfeed.tech/topics/ai-networking.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Digital Trust](<https://devfeed.tech/topics/digital-trust.md>)

Tags: [6g](<https://devfeed.tech/tags/6g.md>), [beam](<https://devfeed.tech/tags/beam.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [cs-gt](<https://devfeed.tech/tags/cs-gt.md>), [cs-it](<https://devfeed.tech/tags/cs-it.md>), [digital-twin](<https://devfeed.tech/tags/digital-twin.md>), [energy-efficiency](<https://devfeed.tech/tags/energy-efficiency.md>), [localization](<https://devfeed.tech/tags/localization.md>), [math-it](<https://devfeed.tech/tags/math-it.md>), [mmwave](<https://devfeed.tech/tags/mmwave.md>), [power](<https://devfeed.tech/tags/power.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [security](<https://devfeed.tech/tags/security.md>), [simulation](<https://devfeed.tech/tags/simulation.md>)

## AI overview

In a site-specific 28-GHz simulation, belief-guided Q-learning (BGQL) jointly identifies jammers and controls beam power by incorporating a normalized suspicion vector--built from receiver-level residuals and candidate jamming footprints--into its state, reward, and exploratory beam selection. Across 30 paired Monte Carlo runs per configuration with jammer counts known, BGQL reports link-rate scores of 437.4-564.2 Mbit/s, rate-to-device-power scores of 60.37-76.79 Mbit/J, and localization recall of 100% for one jammer and 78%-81% for two, compared with SARSA, Greedy, and Random. Its runtime is higher than SARSA's: 80-130 seconds per run versus 5-14 seconds. The findings are a matched-model simulation proof of concept, not evidence from a deployed network.

## Source excerpt

arXiv:2610.16770v2 Announce Type: replace-cross Abstract: Next-generation wireless networks are expected to support high data rates and reliable connectivity while meeting requirements for energy efficiency, resource management, and communication security. Digital Twin (DT) technology represents expected network behavior and enables the actual network state to be assessed against it. Integrating DT technology with reinforcement learning (RL) supports adaptive resource allocation and security-aware decision-making. This paper presents a simulation-based DT reference and a belief-guided Q-learning (BGQL) method for joint jammer identification and beam-power control in a site-specific 28-GHz network model. Receiver-level residuals between attack-free and attacked configurations are combined with candidate spatial jamming footprints and accumulated into a normalized suspicion vector. BGQL incorporates this vector into its state, reward, and exploratory beam-selection rule. Compared with SARSA, Greedy, and Random across 30 paired Monte Carlo runs per configuration, with known jammer counts, BGQL achieves link-rate scores of 437.4-564.2 Mbit/s, rate-to-device-power scores of 60.37-76.79 Mbit/J, and localization recall of 100% for one jammer and 78%-81% for two jammers. BGQL requires 80-130 s per run versus 5-14 s for SARSA. These findings provide a matched-model simulation proof of concept for DT-referenced belief-guided learning for security-aware beam-power control in 6G networks.