Abstract:The Age of Information (AoI) has recently gained recognition as a critical quality-of-service (QoS) metric for quantifying the freshness of status updates, playing a crucial role in supporting massive ultra-reliable and low-latency communications (mURLLC) services. In mURLLC scenarios, due to the inherent system dynamics and varying environmental conditions, optimizing AoI under such multi-QoS constraints considering both delay and reliability often results in non-convex and computationally intractable problems. Motivated by the demonstrated efficacy of deep reinforcement learning (DRL) in addressing large-scale networking challenges, this work aims to apply DRL techniques to derive optimal resource allocation solutions in real time. Despite its potential, the effective integration of FBC in DRL-based AoI optimization remains underexplored, especially in addressing the challenge of simultaneously upper-bounding both delay and error-rate. To address these challenges, we propose a DRL-based framework for AoI-aware optimal resource allocation in mURLLC-driven multi-QoS schemes, leveraging AoI as a core metric within the finite blocklength regime. First, we design a wireless communication architecture and AoI-based modeling framework that incorporates FBC. Second, we proceed by deriving upper-bounded peak AoI and delay violation probabilities using stochastic network calculus (SNC). Subsequently, we formulate an optimization problem aimed at minimizing the peak AoI violation probability through FBC. Third, we develop DRL algorithms to determine optimal resource allocation policies that meet statistical delay and error-rate requirements for mURLLC. Finally, to validate the effectiveness of the developed schemes, we have executed a series of simulations.

User Scheduling Based CLI Mitigation Scheme for NAFD Cell-Free Systems towards mURLLC

Joint URLLC Traffic Scheduling and Resource Allocation for Semantic Communication Systems

Joint User Scheduling and Channel Allocation for Cellular Networks with Full Duplex Base Stations.

Joint Beamforming Design and Blocklength Optimization for Low-Latency Multi-User MISO URLLC Systems

Adaptive Modulation and Coding for URLLC Retransmission

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Uplink Scheduling for Cognitive Radio Cellular Network with Primary User's QoS Protection

eMBB-URLLC Multiplexing: A Greedy Scheduling Strategy for URLLC Traffic with Multiple Delay Requirements

AoI-Aware Resource Allocation for Smart Multi-QoS Provisioning

A Hybrid Network User Satisfaction-Based Downlink Scheduling in LTE-A Network

Ultra-high Rate-Reliability Fairness in Grant-Free Massive URLLC NOMA System: Joint Power and Channel Allocation using Meta-Heuristic Search

Deep learning based user scheduling for massive MIMO downlink system

A Scheduling Algorithm Based on Downlink Performance for Full‐duplex MU‐MIMO Systems

Digital twin‐enabled deep reinforcement learning for joint scheduling of ultra‐reliable low latency communication and enhanced mobile broad band: A reliability‐guaranteed approach

Joint Scheduling Scheme for Embb/urllc Based on Multi-User Superposition Transmission

A Dynamic Resource Scheduling Algorithm Based on Traffic Prediction for Coexistence of eMBB and Random Arrival URLLC

Network-Assisted Full-Duplex Cell-Free mmWave Networks: Hybrid MIMO Processing and Multi-Agent DRL-Based Power Allocation

Hybrid Puncturing and Superposition Scheme for Joint Scheduling of URLLC and eMBB Traffic

Joint User Selection and Transceiver Design for Cell-Free With Network-Assisted Full Duplexing

Multiplexing URLLC Traffic within eMBB Services in 5G NR: Fair Scheduling