Abstract:With conventional anti-jamming solutions like frequency hopping or spread spectrum, legitimate transceivers often tend to "escape" or "hide" themselves from jammers. These reactive anti-jamming approaches are constrained by the lack of timely knowledge of jamming attacks. Bringing together the latest advances in neural network architectures and ambient backscattering communications, this work allows wireless nodes to effectively "face" the jammer by first learning its jamming strategy, then adapting the rate or transmitting information right on the jamming signal. Specifically, to deal with unknown jamming attacks, existing work often relies on reinforcement learning algorithms, e.g., Q-learning. However, the Q-learning algorithm is notorious for its slow convergence to the optimal policy, especially when the system state and action spaces are large. This makes the Q-learning algorithm pragmatically inapplicable. To overcome this problem, we design a novel deep reinforcement learning algorithm using the recent dueling neural network architecture. Our proposed algorithm allows the transmitter to effectively learn about the jammer and attain the optimal countermeasures thousand times faster than that of the conventional Q-learning algorithm. Through extensive simulation results, we show that our design (using ambient backscattering and the deep dueling neural network architecture) can improve the average throughput by up to 426% and reduce the packet loss by 24%. By augmenting the ambient backscattering capability on devices and using our algorithm, it is interesting to observe that the (successful) transmission rate increases with the jamming power. Our proposed solution can find its applications in both civil (e.g., ultra-reliable and low-latency communications or URLLC) and military scenarios (to combat both inadvertent and deliberate jamming).

Smart Shield: Prevent Aerial Eavesdropping Via Cooperative Intelligent Jamming Based on Multi-Agent Reinforcement Learning

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

UAV-Enabled Secure Communications by Multi-Agent Deep Reinforcement Learning

UAV Communication Against Intelligent Jamming: A Stackelberg Game Approach With Federated Reinforcement Learning

Multi-Agent Deep Reinforcement Learning for Secure UAV Communications

Improving Physical Layer Security for Multi-Uav Systems Against Hybrid Wireless Attacks

Anti-Intelligent UAV Jamming Strategy Via Deep Q-Networks

Penalized Reinforcement Learning-Based Energy-Efficient UAV-RIS Assisted Maritime Uplink Communications Against Jamming

Joint Optimization of Trajectory and Jamming Power for Multiple UAV-aided Proactive Eavesdropping

Research on Efficient Multiagent Reinforcement Learning for Multiple UAVs' Distributed Jamming Strategy

Secure Swarm UAV-Assisted Communications With Cooperative Friendly Jamming

Proactive Eavesdropping Via Jamming in UAV-Enabled Suspicious Multiuser Communications.

Deep reinforcement learning aided secure UAV communications in the presence of moving eavesdroppers

Maxmin Fairness for UAV-Enabled Proactive Eavesdropping with Jamming over Distributed Transmit Beamforming-Based Suspicious Communications

Secure UAV Communication with Cooperative Jamming and Trajectory Control

UAV-aided Secure Communication with Imperfect Eavesdropper Location: Robust Design for Jamming Power and Trajectory

Reinforcement Learning-Based Anti-Jamming in Networked UAV Radar Systems

Jamming Mitigation in JRC Systems via Deep Reinforcement Learning and Backscatter-supported Intelligent Deception Strategy.

UAV-Aided Covert Communication With a Multi-Antenna Jammer

"Jam Me If You Can'': Defeating Jammer with Deep Dueling Neural Network Architecture and Ambient Backscattering Augmented Communications

Distributed reinforcement learning based framework for energy-efficient UAV relay against jamming