Abstract:Today’s explosively growing Internet video traffics and viewers’ ever-increasing quality of experience (QoE) demands for video streaming bring tremendous pressures to the backbone network. As a new network paradigm, mobile edge caching provides a promising alternative by pushing video content closer at the network edge rather than the remote CDN servers so as to reduce both content access latency and redundant network traffic. However, our large-scale trace analysis shows that different from CDN based caching, edge caching environment is much more complicated with massively dynamic and diverse request patterns, which renders that existing rule-based and model-based caching solutions may not well fit such complicated edge environments. Moreover, although cooperative caching has been proposed to better afford limited storage on each individual edge server, our trace analysis also shows that the request similarity among neighboring edges can be highly dynamic and diverse, which is drastically different from CDN based caching environment, and can easily compromise the benefits from traditional cooperative caching mostly designed based on CDN environment. In this paper, we propose MacoCache, an intelligent edge caching framework that is carefully designed to afford the massively diversified and distributed caching environment to minimize both content access latency and traffic cost. Specifically, MacoCache leverages a multi-agent deep reinforcement learning (MADRL) based solution, where each edge is able to adaptively learn its own best policy in conjunction with other edges for intelligent caching. The real trace-driven evaluation further demonstrates that MacoCache is able to reduce an average of 21% latency and 26% cost compared with the state-of-the-art caching solution.

Joint Service Scheduling and Content Caching over Unreliable Channels

Delay-Optimal Edge Cache Replacement with Non-Markovian Content Fetching

Joint Content and Communication Resource Allocation for Privacy-Preserving Distributed Collaborative Edge Caching

Delay-Optimal Edge Caching with Imperfect Content Fetching Via Stochastic Learning

Joint Optimization of Preference-Aware Caching and Content Migration in Cost-Efficient Mobile Edge Networks

Multi-Agent Reinforcement Learning Based Cooperative Content Caching for Mobile Edge Networks

Privacy-Preserving Resource Management for Distributed Collaborative Edge Caching Systems

Joint optimization of cache placement and request routing in unreliable networks

Joint Optimization of Service Caching and Task Offloading for Customer Application in MEC: A Hybrid SAC Scheme

Multi-Agent Reinforcement Learning for Efficient Content Caching in Mobile D2D Networks

Learning-Based Cooperative Content Caching Policy for Mobile Edge Computing.

A Joint Caching and Offloading Strategy Using Reinforcement Learning for Multi-access Edge Computing Users

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Multi-Agent Deep Reinforcement Learning-Based Cooperative Edge Caching for Ultra-Dense Next-Generation Networks

Joint optimization of service chain caching and task offloading in mobile edge computing

Proactive Content Caching Based on Actor-Critic Reinforcement Learning for Mobile Edge Networks

Deadline-Aware Cache Placement Scheme Using Fuzzy Reinforcement Learning in Device-to-Device Mobile Edge Networks

Joint Device Caching And Channel Allocation For D2d-Assisted Wireless Content Delivery

Intelligent Video Caching at Network Edge: A Multi-Agent Deep Reinforcement Learning Approach

Federated Multi-Agent Reinforcement Learning for Collaborative Edge Caching in Content Delivery Networks

Efficient D2D Content Caching Using Multi-Agent Reinforcement Learning