Abstract:Content delivery networks (CDNs) play a pivotal role in the modern internet infrastructure by enabling efficient content delivery across diverse geographical regions. As an essential component of CDNs, the edge caching scheme directly influences the user experience by determining the caching and eviction of content on edge servers. With the emergence of 5G technology, traditional caching schemes have faced challenges in adapting to increasingly complex and dynamic network environments. Consequently, deep reinforcement learning (DRL) offers a promising solution for intelligent zero-touch network governance. However, the black-box nature of DRL models poses challenges in understanding and making trusting decisions. In this paper, we propose an explainable reinforcement learning (XRL)-based intelligent edge service caching approach, namely XRL-SHAP-Cache, which combines DRL with an explainable artificial intelligence (XAI) technique for cache management in CDNs. Instead of focusing solely on achieving performance gains, this study introduces a novel paradigm for providing interpretable caching strategies, thereby establishing a foundation for future transparent and trustworthy edge caching solutions. Specifically, a multi-level cache scheduling framework for CDNs was formulated theoretically, with the D3QN-based caching scheme serving as the targeted interpretable model. Subsequently, by integrating Deep-SHAP into our framework, the contribution of each state input feature to the agent’s Q-value output was calculated, thereby providing valuable insights into the decision-making process. The proposed XRL-SHAP-Cache approach was evaluated through extensive experiments to demonstrate the behavior of the scheduling agent in the face of different environmental inputs. The results demonstrate its strong explainability under various real-life scenarios while maintaining superior performance compared to traditional caching schemes in terms of cache hit ratio, quality of service (QoS), and space utilization.

Recommendation-Enabled Edge Caching and D2D Offloading Via Incentive-Driven Deep Reinforcement Learning

Federated Deep Reinforcement Learning for Recommendation-Enabled Edge Caching in Mobile Edge-Cloud Computing Networks

Federated Distributed Deep Reinforcement Learning for Recommendation-enabled Edge Caching

Incentive-Driven Deep Reinforcement Learning for Content Caching and D2D Offloading

Attention-Weighted Federated Deep Reinforcement Learning for Device-to-Device Assisted Heterogeneous Collaborative Edge Caching

Content Update Via Deep Reinforcement Learning in Recommendation-Aware Edge Caching Network

Distributed Edge Caching with Content Recommendation in Fog-RANs Via Deep Reinforcement Learning

DRL-D: Revenue-Aware Online Service Function Chain Deployment Via Deep Reinforcement Learning

A3C-DO: A Regional Resource Scheduling Framework Based on Deep Reinforcement Learning in Edge Scenario

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing

Edge Caching for IoT Transient Data Using Deep Reinforcement Learning

Energy-Efficient Content Fetching Strategies in Cache-Enabled D2D Networks Via an Actor-Critic Reinforcement Learning Structure

Intelligent Cooperative Caching at Mobile Edge Based on Offline Deep Reinforcement LearningJust Accepted

Towards Intelligent Adaptive Edge Caching using Deep Reinforcement Learning

A DRL-Driven Intelligent Optimization Strategy for Resource Allocation in Cloud-Edge-End Cooperation Environments

Intelligent Cooperative Caching at Mobile Edge based on Offline Deep Reinforcement Learning

Personalized Federated Deep Reinforcement Learning for Heterogeneous Edge Content Caching Networks

Deep Reinforcement Learning for Cooperative Edge Caching in Future Mobile Networks.

Deep Reinforcement Learning for Mobile Edge Caching: Review, New Features, and Open Issues

XRL-SHAP-Cache: an Explainable Reinforcement Learning Approach for Intelligent Edge Service Caching in Content Delivery Networks

Distributed and Collective Deep Reinforcement Learning for Computation Offloading: A Practical Perspective.