Abstract:Edge computing is emerging to empower the future of Internet of Things (IoT) applications. However, due to heterogeneity of applications, it is a significant challenge for the edge cloud to effectively allocate multidimensional limited resources (CPU, memory, storage, bandwidth, etc.) with constraints of applications’ Quality of Service (QoS) requirements. In this paper, we address the resource allocation problem in Edge-IoT systems through developing a novel framework named DeepEdge that allocates resources to the heterogeneous IoT applications with the goal of maximizing users’ Quality of Experience (QoE). To achieve this goal, we develop a novel QoE model that considers aligning the heterogeneous requirements of IoT applications to the available edge resources. The alignment is achieved through selection of QoS requirement range that can be satisfied by the available resources. In addition, we propose a novel two-stage deep reinforcement learning (DRL) scheme that effectively allocates edge resources to serve the IoT applications and maximize the users’ QoE. Unlike the typical DRL, our scheme exploits deep neural networks (DNN) to improve actions’ exploration by using DNN to map the Edge-IoT state to joint resource allocation action that consists of resource allocation and QoS class. The joint action not only maximize users’ QoE and satisfies heterogeneous applications’ requirements but also align the QoS requirements to the available resources. In addition, we develop a Q-value approximation approach to tackle the large space problem of Edge-IoT. Further evaluation shows that DeepEdge brings considerable improvements in terms of QoE, latency and application tasks’ success ratio in comparison to the existing resource allocation schemes.

Deep reinforcement learning based resource allocation in edge-cloud gaming

Deep-Reinforcement-Learning-Based Resource Allocation for Cloud Gaming via Edge Computing

Deep Reinforcement Learning Based Resource Allocation Strategy in Cloud-Edge Computing System

Resource Management in Cloud Based on Deep Reinforcement Learning

Deep Reinforcement Learning-Based Resource Allocation for Content Distribution in IoT-Edge-Cloud Computing Environments

Deep Reinforcement Learning Based Rendering Service Placement for Cloud Gaming in Mobile Edge Computing Systems.

Reinforcement Learning-Based Resource Partitioning for Improving Responsiveness in Cloud Gaming

Improving Scalability, Sustainability and Availability Via Workload Distribution in Edge-Cloud Gaming

Security computing resource allocation based on deep reinforcement learning in serverless multi-cloud edge computing

Minimizing Play Request Rejection Through Workload Splitting in Edge-Cloud Gaming

Cost-Efficient and Quality of Experience-aware Player Request Scheduling and Rendering Server Allocation for Edge Computing Assisted Multiplayer Cloud Gaming

RADEAN: A Resource Allocation Model Based on Deep Reinforcement Learning and Generative Adversarial Networks in Edge Computing

Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach

A2C-DRL: Dynamic Scheduling for Stochastic Edge-Cloud Environments Using A2C and Deep Reinforcement Learning

Reinforcement Learning-Based Resource Allocation in Edge Computing

Deep Reinforcement Learning for Edge Computing and Resource Allocation in 5G Beyond

DeepEdge: A New QoE-Based Resource Allocation Framework Using Deep Reinforcement Learning for Future Heterogeneous Edge-IoT Applications

Towards scalable and efficient Deep-RL in edge computing: A game-based partition approach

Intelligent Resource Allocation for Edge-Cloud Collaborative Networks: A Hybrid DDPG-D3QN Approach

Adaptive and Efficient Resource Allocation in Cloud Datacenters Using Actor-Critic Deep Reinforcement Learning

Efficient Resource Allocation Policy for Cloud Edge End Framework by Reinforcement Learning