Abstract:By leveraging the concept of mobile edge computing (MEC), massive amount of data generated by a large number of Internet of Things (IoT) devices could be offloaded to MEC server at the edge of wireless network for further computational intensive processing. However, due to the resource constraint of IoT devices and wireless network, both the communications and computation resources need to be allocated and scheduled efficiently for better system performance. In this paper, we propose a joint computation offloading and multi-user scheduling algorithm for IoT edge computing system to minimize the long-term average weighted sum of delay and power consumption under stochastic traffic arrival. We formulate the dynamic optimization problem as an infinite-horizon average-reward continuous-time Markov decision process (CTMDP) model. One critical challenge in solving this MDP problem for the multi-user resource control is the curse-of-dimensionality problem, where the state space of the MDP model and the computation complexity increase exponentially with the growing number of users or IoT devices. In order to overcome this challenge, we use the deep reinforcement learning (RL) techniques and propose a neural network architecture to approximate the value functions for the post-decision system states. The designed algorithm to solve the CTMDP problem supports semi-distributed auction-based implementation, where the IoT devices submit bids to the BS to make the resource control decisions centrally. Simulation results show that the proposed algorithm provides significant performance improvement over the baseline algorithms, and also outperforms the RL algorithms based on other neural network architectures.

Deep Reinforcement Learning-Based Dynamic Resource Management for Mobile Edge Computing in Industrial Internet of Things

Deep Reinforcement Learning-Based Task Offloading and Resource Allocation for Industrial IoT in MEC Federation System

Multi-user Resource Control with Deep Reinforcement Learning in IoT Edge Computing

Adaptive Resource Allocation for Mobile Edge Computing in Internet of Vehicles: A Deep Reinforcement Learning Approach

Dynamic Task Offloading for Internet of Things in Mobile Edge Computing Via Deep Reinforcement Learning

Deep Reinforcement Learning Aided Computation Offloading and Resource Allocation for IoT

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing

Dynamic Offloading Strategy for Delay-Sensitive Task in Mobile-Edge Computing Networks

Dynamic Resource Management in MEC Powered by Edge Intelligence for Smart City Internet of Things

Dynamic task offloading for digital twin-empowered mobile edge computing via deep reinforcement learning

Deep Reinforcement Learning for Computation and Communication Resource Allocation in Multiaccess MEC Assisted Railway IoT Networks

Energy-Efficient Resource Allocation for Blockchain-Enabled Industrial Internet of Things with Deep Reinforcement Learning

Deep reinforcement learning-based task scheduling and resource allocation for NOMA-MEC in Industrial Internet of Things

DRJOA: Intelligent Resource Management Optimization Through Deep Reinforcement Learning Approach in Edge Computing

Deep Reinforcement Learning for RIS-Aided Secure Mobile Edge Computing in Industrial Internet of Things

Federated Deep Reinforcement Learning-Based Task Offloading and Resource Allocation for Smart Cities in a Mobile Edge Network

Energy and Delay-Aware Task Offloading and Resource Allocation in Mobile Edge Computing

Deep Reinforcement Learning for Dynamic Access Control with Battery Prediction for Mobile-Edge Computing in Green IoT Networks

Deep Reinforcement Learning Based Delay-Sensitive Task Scheduling and Resource Management Algorithm for Multi-User Mobile-Edge Computing Systems