Abstract:Complex dynamic services and heterogeneous network environments make the asymmetrical control a curial issue to handle on the Internet. With the advent of the Internet of Things (IoT) and the fifth generation (5G), the emerging network applications lead to the explosive growth of mobile traffic while bringing forward more challenging service requirements to future radio access networks. Therefore, how to effectively allocate limited heterogeneous network resources to improve content delivery for massive application services to ensure network quality of service (QoS) becomes particularly urgent in heterogeneous network environments. To cope with the explosive mobile traffic caused by emerging Internet services, this paper designs an intelligent optimization strategy based on deep reinforcement learning (DRL) for resource allocation in heterogeneous cloud-edge-end collaboration environments. Meanwhile, the asymmetrical control problem caused by complex dynamic services and heterogeneous network environments is discussed and overcome by distributed cooperation among cloud-edge-end nodes in the system. Specifically, the multi-layer heterogeneous resource allocation problem is formulated as a maximal traffic offloading model, where content caching and request aggregation mechanisms are utilized. A novel DRL policy is proposed to improve content distribution by making cache replacement and task scheduling for arriving content requests in accordance with the information about users' history requests, in-network cache capacity, available link bandwidth and topology structure. The performance of our proposed solution and its similar counterparts are analyzed in different network conditions.

DQN Based Joint Computing Offloading and Resource Allocation for Network Slicing in F-RAN

Mobility-Aware Task Offloading and Migration Schemes in Fog Computing Networks.

Computation Offloading and Resource Allocation in F-RANs: A Federated Deep Reinforcement Learning Approach

Computational Resource Constrained Multi-Cell Joint Processing in Fog Radio Access Networks.

Federated Learning Assisted Deep Q-Learning for Joint Task Offloading and Fronthaul Segment Routing in Open RAN

Multiuser Computation Offloading and Resource Allocation for Cloud–Edge Heterogeneous Network

Computation Offloading and Resource Allocation Based on Cell-Free Radio Access Network

Using Deep Reinforcement Learning for 5G RAN Slicing Resource Allocation in New Power Load Management System

Computation Offloading in Resource-constrained Edge Computing Systems based on Deep Reinforcement Learning

Computation Offloading and Resource Allocation in C-RAN Supporting Wireless Charging

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

Deep Reinforcement Learning-Based Computation Offloading and Resource Allocation in IoT

Delay-Optimal Joint Processing in Computation-Constrained Fog Radio Access Networks

Deep Reinforcement Learning Based Resource Allocation for Content Distribution in Fog Radio Access Networks

Joint Communication and Computation Resource Allocation in Fog-Based Vehicular Networks

A Federated Reinforcement Learning Method with Quantization for Cooperative Edge Caching in Fog Radio Access Networks

Edge Intelligence for Energy-efficient Computation Offloading and Resource Allocation in 5G Beyond

Joint Resource Allocation for Device-to-Device Communication Assisted Fog Computing

Deep Reinforcement Learning-Based Energy Minimization Task Offloading and Resource Allocation for Air Ground Integrated Heterogeneous Networks

Joint DNN Partition and Resource Allocation for Task Offloading in Edge-Cloud-Assisted IoT Environments

A DRL-Driven Intelligent Optimization Strategy for Resource Allocation in Cloud-Edge-End Cooperation Environments