Abstract:A simultaneously transmitting and reflecting surface (STARS) enabled edge caching system is proposed for reducing backhaul traffic and ensuring the quality of service. A novel Caching-at-STARS structure, where a dedicated smart controller and cache memory are installed at the STARS, is proposed to satisfy user demands with fewer hops and desired channel conditions. Then, a joint caching replacement and information-centric hybrid beamforming optimization problem is formulated for minimizing the network power consumption. As long-term decision processes, the optimization problems based on independent and coupled phase-shift models of Caching-at-STARS contain both continuous and discrete decision variables, and are suitable for solving with deep reinforcement learning (DRL) algorithm. For the independent phase-shift Caching-at-STARS model, we develop a frequency-aware based twin delayed deep deterministic policy gradient (FA-TD3) algorithm that leverages user historical request information to serialize high-dimensional caching replacement decision variables. For the coupled phase-shift Caching-at-STARS model, we conceive a cooperative TD3 & deep-Q network (TD3-DQN) algorithm comprised of FA-TD3 and DQN agents to decide on continuous and discrete variables respectively by observing the network external and internal environment. The numerical results demonstrate that: 1) The Caching-at-STARS-enabled edge caching system has advantages over traditional edge caching, especially in scenarios where Zipf skewness factors or cache capacity is large; 2) Caching-at-STARS outperforms the RIS-assisted edge caching systems; 3) The proposed FA-TD3 and cooperative TD3-DQN algorithms are superior in reducing network power consumption than conventional TD3.

Digital Twin-Assisted Data-Driven Optimization for Reliable Edge Caching in Wireless Networks

Optimal D2d Cooperative Caching System In Sdn Based Wireless Network

Towards Intelligent Adaptive Edge Caching using Deep Reinforcement Learning

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Learn to Cache: Machine Learning for Network Edge Caching in the Big Data Era.

Edge Caching at Base Stations With Device-to-Device Offloading

Efficient Federated DRL-Based Cooperative Caching for Mobile Edge Networks

Caching-at-STARS: the Next Generation Edge Caching

Intelligent Cooperative Caching at Mobile Edge based on Offline Deep Reinforcement Learning

Exploiting Deep Reinforcement Learning for Edge Caching in Cell-Free Massive MIMO Systems

A Reinforcement Learning Based Smart Cache Strategy for Cache-Aided Ultra-Dense Network.

A Deep Reinforcement Learning-Based Caching Strategy for IoT Networks With Transient Data

Dynamic Content Update for Wireless Edge Caching via Deep Reinforcement Learning

Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks

Intelligent Cooperative Caching at Mobile Edge Based on Offline Deep Reinforcement LearningJust Accepted

Digital Twin-Assisted Edge Service Caching for Consumer Electronics Manufacturing

Multi-Agent Deep Reinforcement Learning-Based Cooperative Edge Caching for Ultra-Dense Next-Generation Networks

Combining Lyapunov Optimization and Deep Reinforcement Learning for D2D Assisted Heterogeneous Collaborative Edge Caching

Localized Small Cell Caching: A Machine Learning Approach Based on Rating Data

Toward Smart and Cooperative Edge Caching for 5G Networks: A Deep Learning Based Approach