Abstract:With the rapid development of smart city and 5C, user demand for Internet services has increased exponentially. Through collaborative content sharing, the storage limitation of a single edge server (ES) can be broken. However, when mobile users need to download the whole content through multiple regions, independently deciding the caching content for ESs in different regions may result in redundant caching. Furthermore, frequent switching of communication connection during user movement also causes retransmission delay. As a revolutionary approach in the artificial intelligence field, deep reinforcement learning (DRL) has earned great success in solving high-dimensional and network resource management related problems. Therefore, we integrate collaborative caching and DRL to build an intelligent edge caching framework, so as to realize collaborative caching between cloud and ESs. In this caching framework, a fed-erated-machine-learning-based user behavior prediction model is first designed to characterize the content preference and movement trajectory of mobile users. Next, to achieve efficient resource aggregation of ESs, a user-behavior-aware dynamic collaborative caching domain (DCCD) construction and management mechanism is devised to divide ESs into clusters, select cluster heads, and set the re-clustering rules. Then a DRL-based content caching and delivery algorithm is presented to decide the caching content of ESs in a DCCD from a global perspective and plan the transmission path for users, which reduces redundant content and transmission delay. Especially when a user request cannot be satisfied by the current DCCD, a cross-domain content delivery strategy is presented to allow ESs in other DCCDs to provide and forward content to the user, avoiding the traffic pressure and delay caused by requesting services from cloud. The simulation results show that the proposed collaborative caching framework can improve user satisfaction in terms of content hit rate an- service delay.

Cache-Aided MEC for IoT: Resource Allocation Using Deep Graph Reinforcement Learning

Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Joint Resource Allocation and Cache Placement for Location-Aware Multi-User Mobile Edge Computing

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing

Cooperative Task Offloading and Service Caching for Digital Twin Edge Networks: A Graph Attention Multi-Agent Reinforcement Learning Approach

Joint Computing, Pushing, and Caching Optimization for Mobile-Edge Computing Networks via Soft Actor–Critic Learning

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Joint Service Caching, Communication and Computing Resource Allocation in Collaborative MEC Systems: A DRL-based Two-timescale Approach

Multi-user Resource Control with Deep Reinforcement Learning in IoT Edge Computing

Joint Optimization of Service Caching and Task Offloading for Customer Application in MEC: A Hybrid SAC Scheme

Lyapunov-guided Deep Reinforcement Learning for service caching and task offloading in Mobile Edge Computing

A collaborative optimization strategy for computing offloading and resource allocation based on multi-agent deep reinforcement learning

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Deep reinforcement learning-based task offloading and service migrating policies in service caching-assisted mobile edge computing

Soft Actor-Critic Learning-Based Joint Computing, Pushing, and Caching Framework in MEC Networks

Joint Optimization for MEC Computation Offloading and Resource Allocation in IoV Based on Deep Reinforcement Learning

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

MECC: A Mobile Edge Collaborative Caching Framework Empowered by Deep Reinforcement Learning

Distributed Multi-Cloud Multi-Access Edge Computing by Multi-Agent Reinforcement Learning

Latency-Aware Resource Allocation for Mobile Edge Generation and Computing via Deep Reinforcement Learning

Computation Offloading and Resource Allocation in NOMA-MEC: A Deep Reinforcement Learning Approach