Abstract:Information freshness is essential to industrial wireless networks (IWNs) and can be quantified by the age-of-information (AoI) metric. This paper addresses an AoI-aware spectrum sharing (AgeS) problem in IWNs, where multiple device-to-device (D2D) links opportunistically access the spectrum to satisfy their AoI constraints while maximizing primal links’ throughput. Particularly, we orchestrate the access of D2D links in a distributed manner. Since distributed scheduling results in incomplete observation, D2D links share the spectrum with uncertainty on the transmission environment. Therefore, we propose a distributed scheduling scheme, called D-age, to deal with the transmission uncertainty in the AgeS problem, where an adaptation of actor-critic method is adopted with AoI constraints tackled in the dual domain. To address the non-stationary environment and multi-agent credit assignment issue, cooperative multi-agent reinforcement learning (MARL) approach is developed, where multiple local actors are designed to guide D2D links to make real-time decisions via distributed scheduling policies, which are evaluated by an edge-assisted global critic with action-aware advantage functions. Integrated with graph attention networks (GATs), the critic selectively learns contextual information by assigning different importances to neighboring links, which enables the evaluation of scheduling policies in a scalable and computation-efficient manner. Theoretical guarantee of the time-averaged AoI constraints is provided and the effectiveness of D-age in terms of both AoI violation ratio and the capacity of primal links is demonstrated by simulation.

Matching While Learning: Wireless Scheduling for Age of Information Optimization at the Edge

Minimizing the Age-of-Critical-Information: An Imitation Learning-based Scheduling Approach Under Partial Observations

Reinforcement-Learning-Based Scheduling for Age of Information Optimization in MEC Multi-User Network

Scheduling to Minimize Age of Synchronization in Multi-channel Time-sensitive Networks

Scheduling Algorithms for Minimizing Age of Information in Wireless Broadcast Networks with Random Arrivals

Optimizing Age of Information in Wireless Uplink Networks with Partial Observations

Scheduling Algorithms for Minimizing Age of Information in Wireless Broadcast Networks with Random Arrivals: The No-Buffer Case

Scheduling to Minimize Age of Synchronization in Wireless Broadcast Networks with Random Updates.

Towards Efficient Dynamic Uplink Scheduling over Multiple Unknown Channels

Scheduling Policies for Minimizing Age of Information in Broadcast Wireless Networks

Multiuser Scheduling for Minimizing Age of Information in Uplink MIMO Systems

Joint Freshness and Channel Aware Scheduling for Multi-User Wireless Communications

Minimizing Age of Information in Downlink Wireless Networks with Time-Varying Channels and Peak Power Constraint

Minimizing Age-of-Information with Joint Transmission and Computing Scheduling in Mobile Edge Computing

Competitive Algorithms for Minimizing the Maximum Age-of-Information

Edge-Assisted Spectrum Sharing for Freshness-Aware Industrial Wireless Networks: A Learning-Based Approach

Minimizing Age of Synchronization in No-buffer Wireless Networks with Random Arrivals

Timely Status Updating over Markov Channels in Downlink Wireless Networks with Stochastic Arrivals

Age of Information-based Scheduling for Wireless Device-to-Device Communications Using Deep Learning

Age of Information-Based Scheduling for Wireless D2D Systems with a Deep Learning Approach

Age-of-Information Aware Scheduling for Edge-Assisted Industrial Wireless Networks