Abstract:The advanced Internet of Things (IoT) enables more and more interactions between people and machines in the emerging applications, which rely on real-time communication and computing. However, the limited battery capacity and low computing capacity of IoT nodes can hardly support high-performance computing applications. The integration of wireless power transmission (WPT) and mobile edge computing (MEC) is a feasible and promising solution to address the energy shortage and computing capacity limitation of IoT nodes by harvesting radio frequency signal's energy and offloading the nodes' computation tasks to edge computing servers (ECSs). In this work, we focus on the wireless powered MEC network with an ECS and multiple edge devices (EDs), and study the joint optimization of WPT duration, transmission time allocation of each ED and partial offloading decision to maximize the sum computation rate. First, we formulate this as a non-convex problem which is hard to solve. Second, to conquer this problem, we decompose the original offloading problem into the sub-problem of optimizing the offloading time allocation among EDs and the proportion of harvested energy allocated for offloading at each ED under a given WPT duration and the top-problem of optimizing the WPT duration. Finally, we design an online DRL-based framework where one DNN together with its exploration strategy and training strategy is adopted to learn the near-optimal WPT duration and an efficient optimal algorithm is designed to solve the sub-problem. Numerical results show that the DRL-based offloading algorithm achieves the near-maximal sum computation rate while greatly reducing the processing time by at least three orders of magnitude compared with using the solver CVX for the sub-problem and the DNN for the top-problem.

Learning-Based Computation Offloading for IoT Devices With Energy Harvesting

Dynamic Edge Computation Offloading for Internet of Things with Energy Harvesting: A Learning Method.

Learning-Based Privacy-Aware Offloading for Healthcare IoT with Energy Harvesting.

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Computation Offloading In Energy Harvesting Systems Via Continuous Deep Reinforcement Learning

Energy Harvesting Assisted Intelligent Computation Offloading Method for the IoT in Mining

An Efficient Computation Offloading Approach in Multi-access Edge Computing Using Deep Reinforcement Learning

A Meta Reinforcement Learning-Based Task Offloading Strategy for IoT Devices in an Edge Cloud Computing Environment

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

Backscatter-Assisted Computation Offloading for Energy Harvesting IoT Devices via Policy-based Deep Reinforcement Learning

Dynamic Computation Offloading With Energy Harvesting Devices: A Hybrid-Decision-Based Deep Reinforcement Learning Approach

Deep Reinforcement Learning Aided Computation Offloading and Resource Allocation for IoT

Advanced Energy-Efficient Computation Offloading Using Deep Reinforcement Learning in MTC Edge Computing

Reinforcement Learning Based Offloading for Realtime Applications in Mobile Edge Computing.

Hybrid Decision Based Deep Reinforcement Learning for Energy Harvesting Enabled Mobile Edge Computing.

Deep Reinforcement Learning Empowers Wireless Powered Mobile Edge Computing: Towards Energy-Aware Online Offloading

DRL-Based Partial Offloading for Maximizing Sum Computation Rate of Wireless Powered Mobile Edge Computing Network

Optimal Computation Resource Allocation in Energy-Efficient Edge IoT Systems with Deep Reinforcement Learning

Backscatter-Aided Hybrid Data Offloading for Mobile Edge Computing via Deep Reinforcement Learning

A Q-learning based Method for Energy-Efficient Computation Offloading in Mobile Edge Computing

Deep Reinforcement Learning for Time-Energy Tradeoff Online Offloading in MEC-Enabled Industrial Internet of Things