Abstract:With the popularity of smart devices and the growth of high-bandwidth applications, the wireless industry is facing an increased surge in data traffic. This challenge highlights the limitations of traditional edge-caching solutions, especially in terms of content-caching effectiveness and network-communication latency. To address this problem, we investigated efficient caching strategies in heterogeneous network environments. The caching decision process becomes more complex due to the heterogeneity of the network environment, as well as due to the diversity of user behaviors and content requests. To address the problem of increased system latency due to the dynamically changing nature of content popularity and limited cache capacity, we propose a novel content placement strategy, the long-short-term-memory–content-population-prediction model, to capture the correlation of request patterns between different contents and the periodicity in the time domain, in order to improve the accuracy of the prediction of content popularity. Then, to address the heterogeneity of heterogeneous network environments, we propose an efficient content delivery strategy: the multi-intelligent critical collaborative caching policy. This strategy models the edge-caching problem in heterogeneous scenarios as a Markov decision process using multi-base-station-environment information. In order to fully utilize the multi-intelligence information, we have improved the actor–critic approach by integrating the attention mechanism into a neural network. Whereas the actor network is responsible for making decisions based on local information, the critic network evaluates and enhances the actor's performance. We conducted extensive simulations, and the results showed that the Long Short Term Memory content population prediction model was more advantageous, in terms of content-popularity-prediction accuracy, with a 28.61% improvement in prediction error, compared to several other existing methods. The proposed multi-intelligence actor–critic collaborative caching policy algorithm improved the cache-hit-rate metric by up to 32.3% and reduced the system latency by 1.6%, demonstrating the feasibility and effectiveness of the algorithm.

Monte-Carlo Tree Search Aided Contextual Online Learning Approach for Wireless Caching

A contextual multi-armed bandit approach to caching in wireless small cell network

Multi-Objective Learning for Efficient Content Caching for Mobile Edge Networks

Learning-Based Cooperative Content Caching Policy for Mobile Edge Computing.

Multi-agent Multi-armed Bandit Learning for Content Caching in Edge Networks

Multi-Agent Reinforcement Learning Based Cooperative Content Caching for Mobile Edge Networks

User Preference Learning-Aided Collaborative Edge Caching for Small Cell Networks

Collaborative Multi-Agent Multi-Armed Bandit Learning for Small-Cell Caching

Localized Small Cell Caching: A Machine Learning Approach Based on Rating Data

Context-aware Data Caching for 5G Heterogeneous Small Cells Networks.

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Cache Placement Optimization in Mobile Edge Computing Networks with Unaware Environment -- An Extended Multi-armed Bandit Approach

Collective Behavior Aware Collaborative Caching for Mobile Edge Computing.

Efficient D2D Content Caching Using Multi-Agent Reinforcement Learning

UGC Online Learning Proactive Caching Strategy for Multi-levels Wireless Networks

Cost-Aware Variable-Size-Content Caching in MEC-Enabled Mobile Wireless Networks.

Caching on the Move: A User Interest-Driven Caching Strategy for D2D Content Sharing

Efficient Caching Strategy in Wireless Networks with Mobile Edge Computing

Enhancing Heterogeneous Network Performance: Advanced Content Popularity Prediction and Efficient Caching

How to Cache Important Contents for Multi-modal Service in Dynamic Networks: A DRL-based Caching Scheme

Recommenadation aided Caching using Combinatorial Multi-armed Bandits