Fast Adaptive Jamming Resource Allocation Against Frequency-Hopping Spread Spectrum in Wireless Sensor Networks via Meta Deep Reinforcement Learning

Partial-band noise jamming is an important countermeasure against frequency-hopping spread spectrum technology in wireless sensor networks, and the jamming resource allocation (JRA) problem involved is a high-dimensional combinatorial optimization and also an NP-hard problem. Moreover, the users can dynamically alter their communication status, such as changing the channel spectrum distributions of hopping sets, posing additional difficulties for JRA. This paper develops two methods to address above challenges. First, a deep reinforcement learning (DRL)-based method is proposed for efficient JRA optimization, with the jamming scheme of each jamming node decided sequentially by the policy neural network, and its parameters are updated through trust region policy optimization (TRPO) within a trust region to ensure stable and fast convergence. Second, we propose a meta-TRPO based method to improve the generalization capability of the policy network. After the meta-training process, it can update the meta policy network with just a few fine-tuning steps and quickly obtain a task-specific policy for the fresh task. Extensive simulation results show the proposed DRL-based method converges faster than other DRL methods. Additionally, the proposed meta-TRPO based method can rapidly adapt to unseen jamming tasks with only a small quantity of training trajectories.