Abstract:This paper considers a wireless network with a base station (BS) conducting timely status updates to multiple clients via adaptive non-orthogonal multiple access (NOMA)/orthogonal multiple access (OMA). Specifically, the BS is able to adaptively switch between NOMA and OMA for the downlink transmission to optimize the information freshness of the network, characterized by the Age of Information (AoI) metric. For the simple two-client case, we formulate a Markov Decision Process (MDP) problem and develop the optimal policy for the BS to decide whether to use NOMA or OMA for each downlink transmission based on the instantaneous AoI of both clients. The optimal policy is shown to have a switching-type property with obvious decision switching boundaries. A suboptimal policy with lower computation complexity is also devised, which is shown to achieve near-optimal performance via numerical simulations. For the more general multi-client scenario, the optimal solution is the computationally intractable due to the large state and action spaces. As such, we devote to provide a feasible suboptimal policy with low computation complexity. Specifically, inspired by the proposed suboptimal policy of the two-client scenario, we formulate a nonlinear optimization problem to determine the optimal power allocated to each client by maximizing the expected AoI drop of the network in each time slot (i.e., minimizing the expected network-wide AoI of the next slot). The problem is shown to be non-convex, we manage to solve it by approximating it as a convex optimization problem. Simulation results validate the tightness of the adopted approximation. Specifically, the performance of the adaptive NOMA/OMA scheme by solving the convex optimization is shown to be close to that of the max-weight policy solved by exhaustive search. Besides, the adaptive NOMA/OMA scheme achieves significant performance improvement compared to the OMA scheme, especially when the number of clients in the network i- large and the transmission SNR is high.

Distributed Age-of-Information Scheduling with NOMA Via Deep Reinforcement Learning

Two-Tier Multi-Access Partial Computation Offloading Via NOMA: A Hybrid Deep Learning Approach for Energy Minimization

Energy-Efficient User Scheduling and Power Allocation for NOMA-Based Wireless Networks with Massive IoT Devices

Optimizing Age of Information in RIS-Assisted NOMA Networks: A Deep Reinforcement Learning Approach

Learning-Assisted Optimization for Energy-Efficient Scheduling in Deadline-Aware NOMA Systems

AoI-Oriented Resource Allocation for NOMA-Based Wireless Powered Cognitive Radio Networks Based on Multi-Agent Deep Reinforcement Learning

Matching Combined Heterogeneous Multi-Agent Reinforcement Learning for Resource Allocation in NOMA-V2X Networks

Energy Efficient Transmission in Underlay CR-NOMA Networks Enabled by Reinforcement Learning

Dual Dynamic Scheduling for Hierarchical QoS in Uplink-NOMA: A Reinforcement Learning Approach

A Dynamic Power Allocation Scheme in Power-Domain NOMA Using Actor-Critic Reinforcement Learning.

Deep reinforcement learning-based task scheduling and resource allocation for NOMA-MEC in Industrial Internet of Things

NOMA-Based Multi-User Mobile Edge Computation Offloading via Cooperative Multi-Agent Deep Reinforcement Learning

Task offloading and resource allocation in NOMA-VEC: A multi-agent deep graph reinforcement learning algorithm

Optimizing Information Freshness via Multiuser Scheduling With Adaptive NOMA/OMA

Computation Offloading and Resource Allocation in NOMA-MEC: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning-Assisted NOMA Age-Optimal Power Allocation for S-IoT Network

Reinforcement-Learning-Based Scheduling for Age of Information Optimization in MEC Multi-User Network

Resource Allocation in Uplink NOMA-IoT Networks: A Reinforcement-Learning Approach

Deep Reinforcement Learning-Based Power Allocation for Minimizing Age of Information and Energy Consumption in Multi-Input Multi-Output and Non-Orthogonal Multiple Access Internet of Things Systems

ACO-Based Scheme in Edge Learning NOMA Networks for Task-Oriented Communications

Age of Information-Based Scheduling for Wireless D2D Systems with a Deep Learning Approach