Abstract:Edge computing is emerging to empower the future of Internet of Things (IoT) applications. However, due to heterogeneity of applications, it is a significant challenge for the edge cloud to effectively allocate multidimensional limited resources (CPU, memory, storage, bandwidth, etc.) with constraints of applications’ Quality of Service (QoS) requirements. In this paper, we address the resource allocation problem in Edge-IoT systems through developing a novel framework named DeepEdge that allocates resources to the heterogeneous IoT applications with the goal of maximizing users’ Quality of Experience (QoE). To achieve this goal, we develop a novel QoE model that considers aligning the heterogeneous requirements of IoT applications to the available edge resources. The alignment is achieved through selection of QoS requirement range that can be satisfied by the available resources. In addition, we propose a novel two-stage deep reinforcement learning (DRL) scheme that effectively allocates edge resources to serve the IoT applications and maximize the users’ QoE. Unlike the typical DRL, our scheme exploits deep neural networks (DNN) to improve actions’ exploration by using DNN to map the Edge-IoT state to joint resource allocation action that consists of resource allocation and QoS class. The joint action not only maximize users’ QoE and satisfies heterogeneous applications’ requirements but also align the QoS requirements to the available resources. In addition, we develop a Q-value approximation approach to tackle the large space problem of Edge-IoT. Further evaluation shows that DeepEdge brings considerable improvements in terms of QoE, latency and application tasks’ success ratio in comparison to the existing resource allocation schemes.

Deep Reinforcement Learning for Intelligent Computing and Content Edge Service in ICN-based IoV

Deep Reinforcement Learning-based Edge Caching and Multi-link Cooperative Communication in Internet-of-Vehicles

Towards Intelligent Adaptive Edge Caching using Deep Reinforcement Learning

Novel Edge Caching Approach Based on Multi-Agent Deep Reinforcement Learning for Internet of Vehicles

Deep Reinforcement Learning-Based Resource Allocation for Content Distribution in IoT-Edge-Cloud Computing Environments

Intelligent Online Traffic Optimization Based on Deep Reinforcement Learning for Information-Centric Networks

In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning

Deep Reinforcement Learning for Social-Aware Edge Computing and Caching in Urban Informatics

Intelligent Edge Computing in Internet of Vehicles: A Joint Computation Offloading and Caching Solution

Joint Computing and Caching in 5G-Envisioned Internet of Vehicles: A Deep Reinforcement Learning-Based Traffic Control System

Edge Content Caching with Deep Spatiotemporal Residual Network for IoV in Smart City

Deploying Network Functions for Multiaccess Edge-IoT with Deep Reinforcement Learning

Collaborative on-demand dynamic deployment via deep reinforcement learning for IoV service in multi edge clouds

Edge Caching Based on Collaborative Filtering for Heterogeneous ICN-IoT Applications

Intelligent Driving Task Scheduling Service in Vehicle-Edge Collaborative Networks Based on Deep Reinforcement Learning

Edge-MapReduce-Based Intelligent Information-Centric IoV: Cognitive Route Planning

Deep Reinforcement Learning for Containerized Edge Intelligence Inference Request Processing in IoT Edge Computing

Serving at the Edge: An Edge Computing Service Architecture Based on ICN

DeepEdge: A New QoE-Based Resource Allocation Framework Using Deep Reinforcement Learning for Future Heterogeneous Edge-IoT Applications

Deep Reinforcement Learning based Approach for Online Service Placement and Computation Resource Allocation in Edge Computing