Abstract:A simultaneously transmitting and reflecting surface (STARS) enabled edge caching system is proposed for reducing backhaul traffic and ensuring the quality of service. A novel Caching-at-STARS structure, where a dedicated smart controller and cache memory are installed at the STARS, is proposed to satisfy user demands with fewer hops and desired channel conditions. Then, a joint caching replacement and information-centric hybrid beamforming optimization problem is formulated for minimizing the network power consumption. As long-term decision processes, the optimization problems based on independent and coupled phase-shift models of Caching-at-STARS contain both continuous and discrete decision variables, and are suitable for solving with deep reinforcement learning (DRL) algorithm. For the independent phase-shift Caching-at-STARS model, we develop a frequency-aware based twin delayed deep deterministic policy gradient (FA-TD3) algorithm that leverages user historical request information to serialize high-dimensional caching replacement decision variables. For the coupled phase-shift Caching-at-STARS model, we conceive a cooperative TD3 & deep-Q network (TD3-DQN) algorithm comprised of FA-TD3 and DQN agents to decide on continuous and discrete variables respectively by observing the network external and internal environment. The numerical results demonstrate that: 1) The Caching-at-STARS-enabled edge caching system has advantages over traditional edge caching, especially in scenarios where Zipf skewness factors or cache capacity is large; 2) Caching-at-STARS outperforms the RIS-assisted edge caching systems; 3) The proposed FA-TD3 and cooperative TD3-DQN algorithms are superior in reducing network power consumption than conventional TD3.

Caching for Doubly Selective Fading Channels via Model-Agnostic Meta-Reinforcement Learning

Deep Reinforcement Learning for Cooperative Coded Caching Strategy in Fog Radio Access Network

Dual-Mode User-Centric Open-Loop Cooperative Caching for Backhaul-Limited Small-Cell Wireless Networks.

Delay-Optimal Edge Cache Replacement with Non-Markovian Content Fetching

Delay-Optimal Edge Caching with Imperfect Content Fetching Via Stochastic Learning

Frame-Level Video Caching and Transmission Scheduling Via Stochastic Learning

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Caching-at-STARS: the Next Generation Edge Caching

Delay-Aware Cache-Enabled Cooperative D2D Transmission in Mobile Cellular Networks

User Preference Learning Based Edge Caching for Fog Radio Access Network

Deep Q-Learning Aided Energy-Efficient Caching and Transmission for Adaptive Bitrate Video Streaming Over Dynamic Cellular Networks

Exploiting Deep Reinforcement Learning for Edge Caching in Cell-Free Massive MIMO Systems

User Preference Learning-Aided Collaborative Edge Caching for Small Cell Networks

Toward Smart and Cooperative Edge Caching for 5G Networks: A Deep Learning Based Approach

Cooperative caching algorithm for mobile edge networks based on multi-agent meta reinforcement learning

Cache-enabled Wireless Networks with Opportunistic Interference Alignment

Cluster Content Caching: A Deep Reinforcement Learning Approach to Improve Energy Efficiency in Cell-Free Massive Multiple-Input Multiple-Output Networks

Cooperative Edge Caching Based on Elastic Federated and Multi-Agent Deep Reinforcement Learning in Next-Generation Network

Storage-Efficient Edge Caching With Asynchronous User Requests

Cooperative Edge Caching Based on Elastic Federated and Multi-Agent Deep Reinforcement Learning in Next-Generation Networks