Abstract:A simultaneously transmitting and reflecting surface (STARS) enabled edge caching system is proposed for reducing backhaul traffic and ensuring the quality of service. A novel Caching-at-STARS structure, where a dedicated smart controller and cache memory are installed at the STARS, is proposed to satisfy user demands with fewer hops and desired channel conditions. Then, a joint caching replacement and information-centric hybrid beamforming optimization problem is formulated for minimizing the network power consumption. As long-term decision processes, the optimization problems based on independent and coupled phase-shift models of Caching-at-STARS contain both continuous and discrete decision variables, and are suitable for solving with deep reinforcement learning (DRL) algorithm. For the independent phase-shift Caching-at-STARS model, we develop a frequency-aware based twin delayed deep deterministic policy gradient (FA-TD3) algorithm that leverages user historical request information to serialize high-dimensional caching replacement decision variables. For the coupled phase-shift Caching-at-STARS model, we conceive a cooperative TD3 & deep-Q network (TD3-DQN) algorithm comprised of FA-TD3 and DQN agents to decide on continuous and discrete variables respectively by observing the network external and internal environment. The numerical results demonstrate that: 1) The Caching-at-STARS-enabled edge caching system has advantages over traditional edge caching, especially in scenarios where Zipf skewness factors or cache capacity is large; 2) Caching-at-STARS outperforms the RIS-assisted edge caching systems; 3) The proposed FA-TD3 and cooperative TD3-DQN algorithms are superior in reducing network power consumption than conventional TD3.

Cache-enabled Wireless Networks with Opportunistic Interference Alignment

Deep Reinforcement Learning for Cooperative Coded Caching Strategy in Fog Radio Access Network

Dual-Mode User-Centric Open-Loop Cooperative Caching for Backhaul-Limited Small-Cell Wireless Networks.

Cache-induced Opportunistic MIMO Cooperation: A New Paradigm for Future Wireless Content Access Networks

Joint Frequency Reuse and Cache Optimization in Backhaul-Limited Small-Cell Wireless Networks.

Improving the Degrees of Freedom in MIMO Interference Network Via PHY Caching.

Caching for Doubly Selective Fading Channels via Model-Agnostic Meta-Reinforcement Learning

Exploiting Deep Reinforcement Learning for Edge Caching in Cell-Free Massive MIMO Systems

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Cache-Enabled Dynamic Rate Allocation via Deep Self-Transfer Reinforcement Learning

Cooperative Cache in Cognitive Radio Networks: A Heterogeneous Multi-Agent Learning Approach

Dynamic Content Update for Wireless Edge Caching via Deep Reinforcement Learning

Artificial Intelligence for Wireless Caching: Schemes, Performance, and Challenges

Caching-at-STARS: the Next Generation Edge Caching

Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks

Cache-Aided Communications in MISO Networks with Dynamic User Behavior

Deadline-Aware Cache Placement Scheme Using Fuzzy Reinforcement Learning in Device-to-Device Mobile Edge Networks

Icacheos: In-Ran Caches Orchestration Strategy Through Content Joint Wireless and Backhaul Routing in Small-Cell Networks

Cluster Content Caching: A Deep Reinforcement Learning Approach to Improve Energy Efficiency in Cell-Free Massive Multiple-Input Multiple-Output Networks

A Reinforcement-Learning Approach to Proactive Caching in Wireless Networks