Abstract:Complex dynamic services and heterogeneous network environments make the asymmetrical control a curial issue to handle on the Internet. With the advent of the Internet of Things (IoT) and the fifth generation (5G), the emerging network applications lead to the explosive growth of mobile traffic while bringing forward more challenging service requirements to future radio access networks. Therefore, how to effectively allocate limited heterogeneous network resources to improve content delivery for massive application services to ensure network quality of service (QoS) becomes particularly urgent in heterogeneous network environments. To cope with the explosive mobile traffic caused by emerging Internet services, this paper designs an intelligent optimization strategy based on deep reinforcement learning (DRL) for resource allocation in heterogeneous cloud-edge-end collaboration environments. Meanwhile, the asymmetrical control problem caused by complex dynamic services and heterogeneous network environments is discussed and overcome by distributed cooperation among cloud-edge-end nodes in the system. Specifically, the multi-layer heterogeneous resource allocation problem is formulated as a maximal traffic offloading model, where content caching and request aggregation mechanisms are utilized. A novel DRL policy is proposed to improve content distribution by making cache replacement and task scheduling for arriving content requests in accordance with the information about users' history requests, in-network cache capacity, available link bandwidth and topology structure. The performance of our proposed solution and its similar counterparts are analyzed in different network conditions.

Traffic Prediction and Random Access Control Optimization: Learning and Non-Learning-Based Approaches

Delay-Aware Massive Random Access for Machine-Type Communications Via Hierarchical Stochastic Learning

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Reinforcement Learning for Improved Random Access in Delay-Constrained Heterogeneous Wireless Networks

DDPG with Transfer Learning and Meta Learning Framework for Resource Allocation in Underlay Cognitive Radio Network

Reinforcement Learning Random Access for Delay-Constrained Heterogeneous Wireless Networks: A Two-User Case

Deep Reinforcement Learning for Random Access in Machine-Type Communication

Deep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks

Dynamic multiple access based on deep reinforcement learning for Internet of Things

Learning to Branch: Accelerating Resource Allocation in Wireless Networks

Deep Learning based Wireless Resource Allocation with Application to Vehicular Networks

A DRL-Driven Intelligent Optimization Strategy for Resource Allocation in Cloud-Edge-End Cooperation Environments

Sparsity-Aware Intelligent Massive Random Access Control in Open RAN: A Reinforcement Learning Based Approach

Reinforcement Learning based Interconnection Routing for Adaptive Traffic Optimization

Load-Aware Distributed Resource Allocation for MF-TDMA Ad Hoc Networks: A Multi-Agent DRL Approach.

Traffic Priority-Aware Multi-User Distributed Dynamic Spectrum Access: A Multi-Agent Deep RL Approach

Reinforcement learning based multi-parameter joint optimization in dense multi-hop wireless networks

Intelligent O-RAN Traffic Steering for URLLC Through Deep Reinforcement Learning

Deep Reinforcement Learning for Optimizing Restricted Access Window in IEEE 802.11ah MAC Layer

RAN Information-Assisted TCP Congestion Control Using Deep Reinforcement Learning with Reward Redistribution

Almost Optimal Dynamically-Ordered Channel Sensing and Accessing for Cognitive Networks.