Abstract:By leveraging the concept of mobile edge computing (MEC), massive amount of data generated by a large number of Internet of Things (IoT) devices could be offloaded to MEC server at the edge of wireless network for further computational intensive processing. However, due to the resource constraint of IoT devices and wireless network, both the communications and computation resources need to be allocated and scheduled efficiently for better system performance. In this paper, we propose a joint computation offloading and multi-user scheduling algorithm for IoT edge computing system to minimize the long-term average weighted sum of delay and power consumption under stochastic traffic arrival. We formulate the dynamic optimization problem as an infinite-horizon average-reward continuous-time Markov decision process (CTMDP) model. One critical challenge in solving this MDP problem for the multi-user resource control is the curse-of-dimensionality problem, where the state space of the MDP model and the computation complexity increase exponentially with the growing number of users or IoT devices. In order to overcome this challenge, we use the deep reinforcement learning (RL) techniques and propose a neural network architecture to approximate the value functions for the post-decision system states. The designed algorithm to solve the CTMDP problem supports semi-distributed auction-based implementation, where the IoT devices submit bids to the BS to make the resource control decisions centrally. Simulation results show that the proposed algorithm provides significant performance improvement over the baseline algorithms, and also outperforms the RL algorithms based on other neural network architectures.

Multi-user Edge-assisted Video Analytics Task Offloading Game Based on Deep Reinforcement Learning

Multi-server Multi-user Game at Edges for Heterogeneous Video Analytics

Edge-Cloud Collaborative Streaming Video Analytics with Multi-agent Deep Reinforcement Learning

Reinforcement Learning-based Mobile Edge Computing and Transmission Scheduling for Video Surveillance

Multi-Queue-Based Offloading Strategy for Deep Reinforcement Learning Tasks

Intelligent Video Streaming at Network Edge: An Attention-Based Multiagent Reinforcement Learning Solution

A Meta Reinforcement Learning-Based Task Offloading Strategy for IoT Devices in an Edge Cloud Computing Environment

Data-Intensive Application Deployment at Edge: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning-Based Video Offloading and Resource Allocation in NOMA-Enabled Networks

Fast Adaptive Task Offloading in Edge Computing based on Meta Reinforcement Learning

EdgeVision: Towards Collaborative Video Analytics on Distributed Edges for Performance Maximization

Dynamic Offloading for Multiuser Muti-CAP MEC Networks: A Deep Reinforcement Learning Approach

Dynamic Computation Offloading and Server Deployment for UAV-Enabled Multi-Access Edge Computing

Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-assisted Mobile Edge Computing

Task Offloading and Resource Allocation Strategy Based on Deep Learning for Mobile Edge Computing

Task Graph offloading via Deep Reinforcement Learning in Mobile Edge Computing

Multi-user Resource Control with Deep Reinforcement Learning in IoT Edge Computing

NOMA-Based Multi-User Mobile Edge Computation Offloading via Cooperative Multi-Agent Deep Reinforcement Learning

Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning