Abstract:With the popularity of smart devices and the growth of high-bandwidth applications, the wireless industry is facing an increased surge in data traffic. This challenge highlights the limitations of traditional edge-caching solutions, especially in terms of content-caching effectiveness and network-communication latency. To address this problem, we investigated efficient caching strategies in heterogeneous network environments. The caching decision process becomes more complex due to the heterogeneity of the network environment, as well as due to the diversity of user behaviors and content requests. To address the problem of increased system latency due to the dynamically changing nature of content popularity and limited cache capacity, we propose a novel content placement strategy, the long-short-term-memory–content-population-prediction model, to capture the correlation of request patterns between different contents and the periodicity in the time domain, in order to improve the accuracy of the prediction of content popularity. Then, to address the heterogeneity of heterogeneous network environments, we propose an efficient content delivery strategy: the multi-intelligent critical collaborative caching policy. This strategy models the edge-caching problem in heterogeneous scenarios as a Markov decision process using multi-base-station-environment information. In order to fully utilize the multi-intelligence information, we have improved the actor–critic approach by integrating the attention mechanism into a neural network. Whereas the actor network is responsible for making decisions based on local information, the critic network evaluates and enhances the actor's performance. We conducted extensive simulations, and the results showed that the Long Short Term Memory content population prediction model was more advantageous, in terms of content-popularity-prediction accuracy, with a 28.61% improvement in prediction error, compared to several other existing methods. The proposed multi-intelligence actor–critic collaborative caching policy algorithm improved the cache-hit-rate metric by up to 32.3% and reduced the system latency by 1.6%, demonstrating the feasibility and effectiveness of the algorithm.

Content Caching Policy Based on GAN and Distributional Reinforcement Learning

Distributed Cache Replacement for Caching-Enable Base Stations in Cellular Networks.

Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks

Deep Reinforcement Learning for Adaptive Caching in Hierarchical Content Delivery Networks

Content Caching at Sleeping-Enabled Base Stations in Heterogeneous Networks.

Dynamic Content Update for Wireless Edge Caching via Deep Reinforcement Learning

Content Caching at the Wireless Network Edge: A Distributed Algorithm Via Belief Propagation

PSAC: Proactive Sequence-Aware Content Caching via Deep Learning at the Network Edge

Joint Cache Allocation and Replacement for Content-Centric Network-Based Private 5G Networks: Deep Reinforcement Learning Approach

PA-Cache: Evolving Learning-Based Popularity-Aware Content Caching in Edge Networks

Enhancing Heterogeneous Network Performance: Advanced Content Popularity Prediction and Efficient Caching

Distributed Caching in Converged Networks: A Deep Reinforcement Learning Approach

Joint Model Caching and Resource Allocation in Generative AI-Enabled Wireless Edge Networks

Edge Caching at Base Stations With Device-to-Device Offloading

How to Cache Important Contents for Multi-modal Service in Dynamic Networks: A DRL-based Caching Scheme

Cooperative Cache in Cognitive Radio Networks: A Heterogeneous Multi-Agent Learning Approach

Localized Small Cell Caching: A Machine Learning Approach Based on Rating Data

Distributed Caching Popular Services by Using Deep Q-Learning in Converged Networks

Reinforcement Learning Based Cooperative Coded Caching under Dynamic Popularities in Ultra-Dense Networks

A contextual multi-armed bandit approach to caching in wireless small cell network