Abstract:Wireless powered mobile edge computing (MEC) networks, where wireless devices (WDs) are allowed to offload parts of computation-intensive tasks to remote servers and charge the built-in batteries over the air, have been envisaged as a promising technology to ensure the ultra-low-power requirement and enhance the continuous work capacity of WDs. However, when multiple WDs coexist in the network, it is non-trivial to minimize the total tasks delay since the optimization variables are intrinsically coupled. Even more, channels are dynamically varying from time to time and the tasks are unpredictable, which aggravates the difficulty to obtain the closed-form solution. Although reinforcement learning (RL) has been proved to be effective for such complex optimization problems, there is still the challenge that the training of neural networks is time-consuming. This paper considers a challenging hybrid tasks offloading scenario, where offloading tasks can be partially executed locally and remotely in parallel, and each WD is endowed to take both the active RF-transmission and passive backscatter communication (BackCom) for remote tasks offloading. Furthermore, a game-combined multi-agent deep deterministic policy gradient (MADDPG) algorithm is proposed to minimize the total tasks delay with the fairness consideration of multiple WDs, i.e., potential game for offloading decision and MADDPG for time scheduling and harvested energy splitting. The introduction of potential game which can be proved to converge with finite iterations, helps to accelerate the training and reduce the computation complexity. Equipped with the feature of ‘centralized training with decentralized execution,’ once well trained, each agent in MADDPG can figure out the proper time scheduling and harvested energy splitting independently without sharing information with others. Besides the unilateral contention among WDs for the offloading decision by potential game, a fully decentralized framework is finally designed for the proposed algorithm. Numerical results demonstrate that the game-combined MADDPG algorithm can achieve the near-optimal performance compared with existing centralized approaches, and reduce the convergence time compared with other no-game learning approaches.

Multi-agent Competitive Spectrum Handoff Based on Improved MADDPG Algorithm

An MDP-based Handoff Decision Algorithm for Multi-Domain Heterogeneous Wireless Access Networks

Joint Spectrum Sensing and Access for Stable Dynamic Spectrum Aggregation.

Learning Fair and Efficient Multiple Access Schemes with Decomposed MADDPG

Multi-Agent Reinforcement Learning for Dynamic Spectrum Access.

DQN-Based Predictive Spectrum Handoff via Hybrid Priority Queuing Model

An Efficient Distributed Algorithm for Spectrum Allocation in Multi-Hop Cognitive Radio Networks

Multi - Agent Deep Deterministic Policy Gradient Based Satellite Spectrum/Code Resource Scheduling with Multi-constraint

A Handoff Strategy of Spectrum Aggregation in Cognitive Radio System

Autonomous handover parameter optimisation for 5G cellular networks using deep deterministic policy gradient

Dynamic Spectrum Sharing with Multiple Primary and Secondary Users.

Spectrum Handoffs Based on Preemptive Repeat Priority Queue in Cognitive Radio Networks

Spectrum Handoffs Based on Preemptive Repeat Priority Queue in Cognitive Radio Networks.

A hybrid handoff strategy based on dynamic spectrum aggregation in cognitive radio system

Mixed Spectrum Handoff Algorithm for Cognitive Radio Based on Channel State Prediction

Intelligent Access to Unlicensed Spectrum: A Mean Field Based Deep Reinforcement Learning Approach

Multi-agent deep reinforcement learning (MADRL) meets multi-user MIMO systems

Joint Optimization of Handover Control and Power Allocation Based on Multi-Agent Deep Reinforcement Learning

Multi-Agent Deep Reinforcement Learning-Based Cooperative Spectrum Sensing With Upper Confidence Bound Exploration

Stochastic Power Adaptation with Multiagent Reinforcement Learning for Cognitive Wireless Mesh Networks

Game-Combined Multi-Agent DRL for Tasks Offloading in Wireless Powered MEC Networks