Abstract:This paper investigates the network-assisted full-duplex (NAFD) cell-free millimeter-wave (mmWave) networks, where the distribution of the transmitting access points (T-APs) and receiving access points (R-APs) across distinct geographical locations mitigates cross-link interference, facilitating the attainment of a truly flexible duplex mode. To curtail deployment expenses and power consumption for mmWave band operations, each AP incorporates a hybrid digital-analog structure encompassing precoder/combiner functions. However, this incorporation introduces processing intricacies within channel estimation and precoding/combining design. In this paper, we first present a hybrid multiple-input multiple-output (MIMO) processing framework and derive explicit expressions for both uplink and downlink achievable rates. Then we formulate a power allocation problem to maximize the weighted bidirectional sum rates. To tackle this non-convex problem, we develop a collaborative multi-agent deep reinforcement learning (MADRL) algorithm called multi-agent twin delayed deep deterministic policy gradient (MATD3) for NAFD cell-free mmWave networks. Specifically, given the tightly coupled nature of both uplink and downlink power coefficients in NAFD cell-free mmWave networks, the MATD3 algorithm resolves such coupled conflicts through an interactive learning process between agents and the environment. Finally, the simulation results validate the effectiveness of the proposed channel estimation methods within our hybrid MIMO processing paradigm, and demonstrate that our MATD3 algorithm outperforms both multi-agent deep deterministic policy gradient (MADDPG) and conventional power allocation strategies.

Power Allocation Based on Deep Reinforcement Learning in HetNets with Varying User Activity.

Joint BS-User Association, Power Allocation, and User-Side Interference Cancellation in Cell-free Heterogeneous Networks

Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches

Cellular Network Power Allocation Algorithm Based on Deep Reinforcement Learning and Artificial Intelligence

A Deep Reinforcement Learning-Based Technique for Optimal Power Allocation in Multiple Access Communications

DQN-Based Multi-User Power Allocation for Hybrid RF/VLC Networks

A Dynamic Power Allocation Scheme in Power-Domain NOMA Using Actor-Critic Reinforcement Learning.

Multicell Power Control under QoS Requirements with CNet

An investigation of methods for the analysis of zinc concentrates for their total fluoride contents.

Joint Interference Alignment and Power Control for Dense Networks Via Deep Reinforcement Learning

Downlink Non-Orthogonal Multiple Access Power Allocation Algorithm Based on Double Deep Q Network for Ensuring User's Quality of Service

Power Allocation for Full-Duplex Communication Systems Based on Deep Deterministic Policy Gradient

Collaborative Multi-BS Power Management for Dense Radio Access Network using Deep Reinforcement Learning

Dynamic user-centric multi-dimensional resource allocation for a wide-area coverage signaling cell based on DQN

Joint Coordinated Beamforming and Power Splitting Ratio Optimization in MU-MISO SWIPT-Enabled HetNets: A Multi-Agent DDQN-Based Approach

Deep Reinforcement Learning for Multi-Agent Power Control in Heterogeneous Networks

Joint Optimization of Handover Control and Power Allocation Based on Multi-Agent Deep Reinforcement Learning

Energy-efficient access point clustering and power allocation in cell-free massive MIMO networks: a hierarchical deep reinforcement learning approach

Realtime Scheduling and Power Allocation Using Deep Neural Networks

Q-Learning-Based Adaptive Power Control in Wireless RF Energy Harvesting Heterogeneous Networks

Network-Assisted Full-Duplex Cell-Free mmWave Networks: Hybrid MIMO Processing and Multi-Agent DRL-Based Power Allocation