Abstract:Today’s explosively growing Internet video traffics and viewers’ ever-increasing quality of experience (QoE) demands for video streaming bring tremendous pressures to the backbone network. As a new network paradigm, mobile edge caching provides a promising alternative by pushing video content closer at the network edge rather than the remote CDN servers so as to reduce both content access latency and redundant network traffic. However, our large-scale trace analysis shows that different from CDN based caching, edge caching environment is much more complicated with massively dynamic and diverse request patterns, which renders that existing rule-based and model-based caching solutions may not well fit such complicated edge environments. Moreover, although cooperative caching has been proposed to better afford limited storage on each individual edge server, our trace analysis also shows that the request similarity among neighboring edges can be highly dynamic and diverse, which is drastically different from CDN based caching environment, and can easily compromise the benefits from traditional cooperative caching mostly designed based on CDN environment. In this paper, we propose MacoCache, an intelligent edge caching framework that is carefully designed to afford the massively diversified and distributed caching environment to minimize both content access latency and traffic cost. Specifically, MacoCache leverages a multi-agent deep reinforcement learning (MADRL) based solution, where each edge is able to adaptively learn its own best policy in conjunction with other edges for intelligent caching. The real trace-driven evaluation further demonstrates that MacoCache is able to reduce an average of 21% latency and 26% cost compared with the state-of-the-art caching solution.

Cooperative Cache in Cognitive Radio Networks: A Heterogeneous Multi-Agent Learning Approach

Deep Reinforcement Learning for Cooperative Coded Caching Strategy in Fog Radio Access Network

Dual-Mode User-Centric Open-Loop Cooperative Caching for Backhaul-Limited Small-Cell Wireless Networks.

Multi-Agent Reinforcement Learning for Cooperative Coded Caching via Homotopy Optimization

Delay-Aware Cache-Enabled Cooperative D2D Transmission in Mobile Cellular Networks

Cooperative caching algorithm for mobile edge networks based on multi-agent meta reinforcement learning

Distributed Cache Replacement for Caching-Enable Base Stations in Cellular Networks.

Deadline-Aware Cache Placement Scheme Using Fuzzy Reinforcement Learning in Device-to-Device Mobile Edge Networks

Cooperative Edge Caching Based on Elastic Federated and Multi-Agent Deep Reinforcement Learning in Next-Generation Network

Cooperative Caching and Fetching in D2D Communications - A Fully Decentralized Multi-Agent Reinforcement Learning Approach

Cooperative Edge Caching Based on Elastic Federated and Multi-Agent Deep Reinforcement Learning in Next-Generation Networks

Toward Smart and Cooperative Edge Caching for 5G Networks: A Deep Learning Based Approach

Dynamic Coded Caching in Wireless Networks Using Multi-Agent Reinforcement Learning

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Caching and Computing Resource Allocation in Cooperative Heterogeneous 5G Edge Networks Using Deep Reinforcement Learning

Reinforcement learning for cost-effective IoT service caching at the edge

UAV-Assisted Wireless Cooperative Communication and Coded Caching: A Multiagent Two-Timescale DRL Approach

Intelligent Video Caching at Network Edge: A Multi-Agent Deep Reinforcement Learning Approach

Exploiting Deep Reinforcement Learning for Edge Caching in Cell-Free Massive MIMO Systems

Efficient Federated DRL-Based Cooperative Caching for Mobile Edge Networks

Pareto-Optimal Multi-Agent Cooperative Caching Relying on Multi-Policy Reinforcement Learning