Abstract:In view of the randomness distribution of multiple users in the dynamic large-scale Internet of Things (IoT) scenario, comprehensively formulating available resources for fog nodes in the area and achieving computation services at low cost have become great challenges. As a result, this paper studies an efficient and intelligent computation offloading mechanism with resource allocation. Specifically, an optimization problem is formulated to minimize the total energy consumption of all tasks under the joint optimization of computation offloading decisions, bandwidth resources and transmission power. Meanwhile, a Twin Delayed Deep Deterministic Policy Gradient-based Intelligent Computation Offloading (TD3PG-ICO) algorithm is proposed to solve this optimization problem. By combining the concept of the actor critic algorithm, the proposed algorithm designs two independent critic networks that can avoid the subjective prediction of a single critic network and better guide the policy network to generate the global optimal computation offloading policy. Additionally, this algorithm introduces a continuous variable discretization operation to select the target offloading node with random probability. The available resources of the target node are dynamically allocated to improve the model decision-making effect. Finally, the simulation results show that this proposed algorithm has faster convergence speed and good robustness. It can always approach the greedy algorithm with respect to the lowest total energy consumption. Furthermore, compared with full local and Deep Q-learning Network (DQN)-based computation offloading schemes, the total energy consumption can be reduced by an average of 15.53% and 6.41%, respectively.

Deep Reinforcement Learning-Based Computation Offloading and Resource Allocation in IoT

Computation Offloading in Resource-constrained Edge Computing Systems based on Deep Reinforcement Learning

A Meta Reinforcement Learning-Based Task Offloading Strategy for IoT Devices in an Edge Cloud Computing Environment

Deep Reinforcement Learning for Task Offloading in Edge Computing Assisted Power IoT

Edge QoE: Computation Offloading With Deep Reinforcement Learning for Internet of Things

Reinforcement Learning-Based Computing and Transmission Scheduling for LTE-U-Enabled IoT

Resource Allocation with Edge Computing in IoT Networks Via Machine Learning

Joint Computation Offloading and Resource Allocation for D2D-Assisted Mobile Edge Computing

Deep Reinforcement Learning-Based Resource Allocation for Content Distribution in IoT-Edge-Cloud Computing Environments

Collaborative Computation Offloading and Resource Management in Space–Air–Ground Integrated Networking: A Deep Reinforcement Learning Approach

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Online Computation Offloading and Resource Scheduling in Mobile-Edge Computing

Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing

Task Offloading Based on LSTM Prediction and Deep Reinforcement Learning for Efficient Edge Computing in IoT

QDRL: Queue-Aware Online DRL for Computation Offloading in Industrial Internet of Things

Optimal Computation Resource Allocation in Energy-Efficient Edge IoT Systems with Deep Reinforcement Learning

Computation Offloading with Multiple Agents in Edge-Computing-Supported IoT

Real-Time Offloading for Dependent and Parallel Tasks in Cloud-Edge Environments Using Deep Reinforcement Learning

Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning

Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems

Twin delayed deep deterministic policy gradient-based intelligent computation offloading for IoT