Abstract:With conventional anti-jamming solutions like frequency hopping or spread spectrum, legitimate transceivers often tend to "escape" or "hide" themselves from jammers. These reactive anti-jamming approaches are constrained by the lack of timely knowledge of jamming attacks. Bringing together the latest advances in neural network architectures and ambient backscattering communications, this work allows wireless nodes to effectively "face" the jammer by first learning its jamming strategy, then adapting the rate or transmitting information right on the jamming signal. Specifically, to deal with unknown jamming attacks, existing work often relies on reinforcement learning algorithms, e.g., Q-learning. However, the Q-learning algorithm is notorious for its slow convergence to the optimal policy, especially when the system state and action spaces are large. This makes the Q-learning algorithm pragmatically inapplicable. To overcome this problem, we design a novel deep reinforcement learning algorithm using the recent dueling neural network architecture. Our proposed algorithm allows the transmitter to effectively learn about the jammer and attain the optimal countermeasures thousand times faster than that of the conventional Q-learning algorithm. Through extensive simulation results, we show that our design (using ambient backscattering and the deep dueling neural network architecture) can improve the average throughput by up to 426% and reduce the packet loss by 24%. By augmenting the ambient backscattering capability on devices and using our algorithm, it is interesting to observe that the (successful) transmission rate increases with the jamming power. Our proposed solution can find its applications in both civil (e.g., ultra-reliable and low-latency communications or URLLC) and military scenarios (to combat both inadvertent and deliberate jamming).

Intelligent Anti-Jamming Communication with Continuous Action Decision for Ultra-Dense Network

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

Deep Reinforcement Learning-Based Anti-Jamming Algorithm Using Dual Action Network

A Double Network Structure Anti-Jamming Algorithm Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Multi-User Anti Jamming Strategy

Intelligent Anti-jamming Decision Algorithm for Frequency Hopping Network Based on Multi-agent Fuzzy Deep Reinforcemnet Learning

Learning-Based Multi-Domain Anti-Jamming Communication with Unknown Information

"Jam Me If You Can'': Defeating Jammer with Deep Dueling Neural Network Architecture and Ambient Backscattering Augmented Communications

Flexible Channel Access Against Unknown Dynamic Jamming Attack: A Reinforcement Learning Approach.

Dynamic Spectrum Anti-Jamming in Broadband Communications: A Hierarchical Deep Reinforcement Learning Approach

A hidden anti-jamming method based on deep reinforcement learning

Jamming-Resilient Algorithm For Underwater Cognitive Acoustic Networks

QoS and Jamming-Aware Wireless Networking Using Deep Reinforcement Learning

A New Anti-Jamming Strategy Based on Deep Reinforcement Learning for MANET

Efficient Jamming Resource Allocation Against Frequency-Hopping Spread Spectrum in WSNs with Asynchronous Deep Reinforcement Learning

Intelligent Anti-jamming based on Deep Reinforcement Learning and Transfer Learning

Against Jamming Attack in Wireless Communication Networks: A Reinforcement Learning Approach

Intelligent Anti-Jamming Communication for Wireless Sensor Networks: A Multi-Agent Reinforcement Learning Approach

Intelligent Anti-Jamming Decision with Continuous Action and State in Bivariate Frequency Agility Communication System

Deep Reinforcement Learning Based Hopping Strategy for Wideband Anti-Jamming Wireless Communications

A Fast Anti-Jamming Algorithm Based on Imitation Learning for WSN