Abstract:Cell-free network is recognized as a novel networking architecture that allows multiple access points (APs) to provide collaborative signal processing for distributed user equipments (UEs). An important feature of cell-free networks is that the restriction of cell boundaries is removed to alleviate the coverage issue of cell-edge users. However, an intractable problem is that the line-of-sight (LoS) links between the AP and cell-edge users are likely to be blocked by high-rise buildings in the urban city. To address this issue, one promising solution to combat the unfavorable wireless propagation environment is the use of reconfigurable intelligent surfaces (RISs) for providing virtual LoS links between the AP and UEs. In order to maximize the energy efficiency of cell-free networks, the transmit beamforming should be designed carefully to eliminate inter-user interference and reduce the power consumed by transmitting per bit. In this paper, a long-term energy efficiency maximization problem is formulated by jointly optimizing the transceiver design and RIS deployment. Consider the uncertainty of wireless environments and the requirement of real-time control, a novel hybrid deep deterministic policy gradient (DDPG)-based algorithm is proposed, where a multi-agent DDPG framework is adopted for robustness enhancement. Simulation results verify the effectiveness of the proposed DDPG-based algorithm, and show the performance improvement brought by the deployment of multiple RISs in cell-free networks.

TACT: A Transfer Actor-Critic Learning Framework for Energy Saving in Cellular Radio Access Networks.

Energy Saving Through a Learning Framework in Greener Cellular Radio Access Networks.

FAMAC: A Federated Assisted Modified Actor-Critic Framework for Secured Energy Saving in 5G and Beyond Networks

Intelligent base station management in greener traffic-aware cellular networks

Collaborative Multi-BS Power Management for Dense Radio Access Network using Deep Reinforcement Learning

DDPG with Transfer Learning and Meta Learning Framework for Resource Allocation in Underlay Cognitive Radio Network

A Dynamic Power Allocation Scheme in Power-Domain NOMA Using Actor-Critic Reinforcement Learning.

Reconfigurable Intelligent Surface-Assisted Aerial-Terrestrial Communications Via Multi-Task Learning

Max-Min Security Energy Efficiency Optimization for RIS-Aided Cell-Free Networks

Adaptive Dynamic Programming for Energy-Efficient Base Station Cell Switching

Distributed RIS-Enhanced Cell-Free NOMA Networks

Robust Security Energy Efficiency Optimization for RIS-Aided Cell-Free Networks with Multiple Eavesdroppers.

A transfer learning framework for energy efficient Wi-Fi networks and performance analysis using real data

An Adaptive Cell Switch Off framework to Increase Energy Efficiency in Cellular Networks

Energy Optimization in Ultra-Dense Radio Access Networks via Traffic-Aware Cell Switching

Efficient Remote Radio Head Switching Scheme In Cloud Radio Access Network: A Load Balancing Perspective

Multi-Agent Deep Reinforcement Learning for Energy Efficient Multi-Hop STAR-RIS-Assisted Transmissions

Energy Savings Scheme in Radio Access Networks Via Compressive Sensing-Based Traffic Load Prediction

An Energy Efficiency policy for Communications with C-RAN, ICN and Transition Smooth

A Dynamic Energy Savings Scheme Based on Enhanced Mobility Load Balancing

Energy Saving in Cellular Networks by Dynamic RS–BS Association and BS Switching