Abstract:With the popularity of smart devices and the growth of high-bandwidth applications, the wireless industry is facing an increased surge in data traffic. This challenge highlights the limitations of traditional edge-caching solutions, especially in terms of content-caching effectiveness and network-communication latency. To address this problem, we investigated efficient caching strategies in heterogeneous network environments. The caching decision process becomes more complex due to the heterogeneity of the network environment, as well as due to the diversity of user behaviors and content requests. To address the problem of increased system latency due to the dynamically changing nature of content popularity and limited cache capacity, we propose a novel content placement strategy, the long-short-term-memory–content-population-prediction model, to capture the correlation of request patterns between different contents and the periodicity in the time domain, in order to improve the accuracy of the prediction of content popularity. Then, to address the heterogeneity of heterogeneous network environments, we propose an efficient content delivery strategy: the multi-intelligent critical collaborative caching policy. This strategy models the edge-caching problem in heterogeneous scenarios as a Markov decision process using multi-base-station-environment information. In order to fully utilize the multi-intelligence information, we have improved the actor–critic approach by integrating the attention mechanism into a neural network. Whereas the actor network is responsible for making decisions based on local information, the critic network evaluates and enhances the actor's performance. We conducted extensive simulations, and the results showed that the Long Short Term Memory content population prediction model was more advantageous, in terms of content-popularity-prediction accuracy, with a 28.61% improvement in prediction error, compared to several other existing methods. The proposed multi-intelligence actor–critic collaborative caching policy algorithm improved the cache-hit-rate metric by up to 32.3% and reduced the system latency by 1.6%, demonstrating the feasibility and effectiveness of the algorithm.

PSAC: Proactive Sequence-Aware Content Caching via Deep Learning at the Network Edge

PA-Cache: Evolving Learning-Based Popularity-Aware Content Caching in Edge Networks

Mixed Timescale Online PHY Caching and Content Delivery for Content-Centric Wireless Networks.

Delay-Optimal Edge Cache Replacement with Non-Markovian Content Fetching

Predictive edge caching through deep mining of sequential patterns in user content retrievals

Content Caching at Sleeping-Enabled Base Stations in Heterogeneous Networks.

Dynamic Content Update for Wireless Edge Caching via Deep Reinforcement Learning

Proactive Content Caching Based on Actor-Critic Reinforcement Learning for Mobile Edge Networks

Cache-Enabled Multicast Content Pushing with Structured Deep Learning

Enhancing Heterogeneous Network Performance: Advanced Content Popularity Prediction and Efficient Caching

Content Caching Policy Based on GAN and Distributional Reinforcement Learning

A novel user preference-aware content caching algorithm in mobile edge networks

A Survey of Deep Learning for Data Caching in Edge Network

Attention-Enhanced Prioritized Proximal Policy Optimization for Adaptive Edge Caching

Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks

How to Cache Important Contents for Multi-modal Service in Dynamic Networks: A DRL-based Caching Scheme

Learning-Based Hierarchical Edge Caching for Cloud-Aided Heterogeneous Networks

Intelligent Video Caching at Network Edge: A Multi-Agent Deep Reinforcement Learning Approach

Cooperative Edge Caching Based on Temporal Convolutional Networks

Adaptive Scheme for Caching YouTube Content in a Cellular Network: Machine Learning Approach