Abstract:In this paper, we are interested in symbiotic radio networks (SRNs), in which an Internet-of-Things (IoT) network parasitizes in a primary cellular network to achieve spectrum-, energy-, and infrastructure-efficient communications. Each IoT device transmits its own information by backscattering the signals from the primary network without using active radio-frequency (RF) transmitter chain. We consider the symbiosis between the cellular network and the IoT network and focus on the user association problem in SRN. Specifically, the base station (BS) in the primary network serves multiple cellular users using time division multiple access (TDMA) and each IoT device is associated with one cellular user for information transmission. The objective of user association is to link each IoT device to an appropriate cellular user by maximizing the sum rate of all IoT devices. However, the difficulty in obtaining the full real-time channel information makes it difficult to design an optimal policy for this problem. To overcome this issue, we propose two deep reinforcement learning (DRL) algorithms, both use historical information to infer the current information in order to make appropriate decisions. One algorithm, referred to as centralized DRL, makes decisions for all IoT devices at one time with globally available information. The other algorithm, referred to as distributed DRL, makes a decision only for one IoT device at one time using locally available information. Finally, simulation results show that the two proposed DRL algorithms achieve performance comparable to the optimal user association policy which requires perfect real-time information, and the distributed DRL algorithm has the advantage of scalability.

User Access Control in Open Radio Access Networks: A Federated Deep Reinforcement Learning Approach

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Sparsity-Aware Intelligent Massive Random Access Control in Open RAN: A Reinforcement Learning Based Approach

DDPG with Transfer Learning and Meta Learning Framework for Resource Allocation in Underlay Cognitive Radio Network

Design and Evaluation of Deep Reinforcement Learning for Energy Saving in Open RAN

Attention-based Open RAN Slice Management using Deep Reinforcement Learning

Harnessing DRL for URLLC in Open RAN: A Trade-off Exploration

DRL-based Joint Resource Scheduling of eMBB and URLLC in O-RAN

Distributed Learning Framework for eMBB-URLLC Multiplexing in Open Radio Access Networks

A Multi-Agent Deep Reinforcement Learning Approach for RAN Resource Allocation in O-RAN

Deep reinforcement learning for RAN optimization and control

CaRL: Cascade Reinforcement Learning with State Space Splitting for O-RAN based Traffic Steering

Intelligent O-RAN Traffic Steering for URLLC Through Deep Reinforcement Learning

Evolutionary Deep Reinforcement Learning for Dynamic Slice Management in O-RAN

Secure and Reliable Downlink Transmission for Energy-Efficient User-Centric Ultra-Dense Networks: An Accelerated DRL Approach

Intelligent User Association for Symbiotic Radio Networks Using Deep Reinforcement Learning

Safe and Accelerated Deep Reinforcement Learning-based O-RAN Slicing: A Hybrid Transfer Learning Approach

Dynamic Spectrum Sharing Based on Deep Reinforcement Learning in Mobile Communication Systems

Deep Reinforcement Learning for Computation and Communication Resource Allocation in Multiaccess MEC Assisted Railway IoT Networks

DRL-based Energy-Efficient Baseband Function Deployments for Service-Oriented Open RAN

Deep Reinforcement Learning Based Mode Selection and Resource Management for Green Fog Radio Access Networks