Abstract:Edge computing is emerging to empower the future of Internet of Things (IoT) applications. However, due to heterogeneity of applications, it is a significant challenge for the edge cloud to effectively allocate multidimensional limited resources (CPU, memory, storage, bandwidth, etc.) with constraints of applications’ Quality of Service (QoS) requirements. In this paper, we address the resource allocation problem in Edge-IoT systems through developing a novel framework named DeepEdge that allocates resources to the heterogeneous IoT applications with the goal of maximizing users’ Quality of Experience (QoE). To achieve this goal, we develop a novel QoE model that considers aligning the heterogeneous requirements of IoT applications to the available edge resources. The alignment is achieved through selection of QoS requirement range that can be satisfied by the available resources. In addition, we propose a novel two-stage deep reinforcement learning (DRL) scheme that effectively allocates edge resources to serve the IoT applications and maximize the users’ QoE. Unlike the typical DRL, our scheme exploits deep neural networks (DNN) to improve actions’ exploration by using DNN to map the Edge-IoT state to joint resource allocation action that consists of resource allocation and QoS class. The joint action not only maximize users’ QoE and satisfies heterogeneous applications’ requirements but also align the QoS requirements to the available resources. In addition, we develop a Q-value approximation approach to tackle the large space problem of Edge-IoT. Further evaluation shows that DeepEdge brings considerable improvements in terms of QoE, latency and application tasks’ success ratio in comparison to the existing resource allocation schemes.

Qoe Driven Resource Allocation In Massive Iot: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Deep-Reinforcement-Learning-Based Energy-Efficient Resource Management for Social and Cognitive Internet of Things

Deep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks

Green Resource Allocation Based on Deep Reinforcement Learning in Content-Centric IoT

Deep Reinforcement Learning for Online Resource Allocation in IoT Networks: Technology, Development, and Future Challenges

Deep Reinforcement Learning-Based Resource Allocation for Content Distribution in IoT-Edge-Cloud Computing Environments

Multi-agent Reinforcement Learning for Resource Allocation in IoT networks with Edge Computing

Deep Reinforcement Learning-Based Resource Allocation for Satellite Internet of Things with Diverse QoS Guarantee

DeepEdge: A New QoE-Based Resource Allocation Framework Using Deep Reinforcement Learning for Future Heterogeneous Edge-IoT Applications

Energy‐efficient resource allocation over wireless communication systems through deep reinforcement learning

Multi-Agent Deep Reinforcement Learning Based Resource Allocation for Ultra-Reliable Low-Latency Internet of Controllable Things

Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing

Towards Deep Q-Network Based Resource Allocation in Industrial Internet of Things

Deep Reinforcement Learning-Based Power Allocation for Minimizing Age of Information and Energy Consumption in Multi-Input Multi-Output and Non-Orthogonal Multiple Access Internet of Things Systems

A Model-Driven Deep Reinforcement Learning Heuristic Algorithm for Resource Allocation in Ultra-Dense Cellular Networks

Multi-user Resource Control with Deep Reinforcement Learning in IoT Edge Computing

Deep Reinforcement Learning for Resource Allocation with Network Slicing in Cognitive Radio Network.

Deep Reinforcement Learning Based Dynamic Resource Allocation in 5G Ultra-Dense Networks

Deep-Reinforcement-Learning-Based Spectrum Resource Management for Industrial Internet of Things