Abstract:Content delivery networks (CDNs) play a pivotal role in the modern internet infrastructure by enabling efficient content delivery across diverse geographical regions. As an essential component of CDNs, the edge caching scheme directly influences the user experience by determining the caching and eviction of content on edge servers. With the emergence of 5G technology, traditional caching schemes have faced challenges in adapting to increasingly complex and dynamic network environments. Consequently, deep reinforcement learning (DRL) offers a promising solution for intelligent zero-touch network governance. However, the black-box nature of DRL models poses challenges in understanding and making trusting decisions. In this paper, we propose an explainable reinforcement learning (XRL)-based intelligent edge service caching approach, namely XRL-SHAP-Cache, which combines DRL with an explainable artificial intelligence (XAI) technique for cache management in CDNs. Instead of focusing solely on achieving performance gains, this study introduces a novel paradigm for providing interpretable caching strategies, thereby establishing a foundation for future transparent and trustworthy edge caching solutions. Specifically, a multi-level cache scheduling framework for CDNs was formulated theoretically, with the D3QN-based caching scheme serving as the targeted interpretable model. Subsequently, by integrating Deep-SHAP into our framework, the contribution of each state input feature to the agent’s Q-value output was calculated, thereby providing valuable insights into the decision-making process. The proposed XRL-SHAP-Cache approach was evaluated through extensive experiments to demonstrate the behavior of the scheduling agent in the face of different environmental inputs. The results demonstrate its strong explainability under various real-life scenarios while maintaining superior performance compared to traditional caching schemes in terms of cache hit ratio, quality of service (QoS), and space utilization.

RL-Cache: an Efficient Reinforcement Learning Based Cache Partitioning Approach for Multi-Tenant CDN Services

Reinforcement Learning Based Data Compression for Energy-Efficient Non-volatile Caches.

Learning from Optimal Caching for Content Delivery.

Reinforcement learning for cost-effective IoT service caching at the edge

XRL-SHAP-Cache: an Explainable Reinforcement Learning Approach for Intelligent Edge Service Caching in Content Delivery Networks

Federated Multi-Agent Reinforcement Learning for Collaborative Edge Caching in Content Delivery Networks

MECC: A Mobile Edge Collaborative Caching Framework Empowered by Deep Reinforcement Learning

Cost-Driven Data Caching in Edge-based Content Delivery Networks

Competitive Analysis of Online Elastic Caching of Transient Data in Multi-Tiered Content Delivery Network

How to Cache Important Contents for Multi-modal Service in Dynamic Networks: A DRL-based Caching Scheme

Joint Cache Size Scaling and Replacement Adaptation for Small Content Providers.

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

A Federated Deep Reinforcement Learning-based Low-power Caching Strategy for Cloud-edge Collaboration

DR-Cache: Distributed Resilient Caching with Latency Guarantees.

Resilient Collaborative Caching for Multi-Edge Systems with Robust Federated Deep Learning

Two-Time-Scale Hybrid Proactive and Reactive Edge Caching for Content Delivery Networks

A data-driven approach of performance evaluation for cache server groups in content delivery network.

Towards Intelligent Adaptive Edge Caching using Deep Reinforcement Learning

A Deep Reinforcement Learning-Based Caching Strategy for IoT Networks With Transient Data

Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks