Abstract: Motivated by the proliferation of real-time applications in multimedia communication systems, tactile Internet, networked controlled systems, and cyber-physical systems, supporting delay-constrained traffic becomes critical for such systems. In delay-constrained traffic, each packet has a hard deadline; when it is not delivered before its deadline is up, it becomes useless and will be removed from the system. In this work, we focus on designing the random access schemes for delay-constrained wireless communications. We first investigate three ALOHA-based random access schemes and prove that the system timely throughput of all three schemes under corresponding optimal transmission probabilities asymptotically converges to $1/e$, same as the well-know throughput limit for delay-unconstrained ALOHA systems. The fundamental reason why ALOHA-based schemes cannot achieve asymptotical system timely throughput beyond $1/e$ is that all active ALOHA stations access the channel with the same probability in any slot. Therefore, to go beyond $1/e$, we have to differentiate active stations' transmission probabilities to reduce the competition level. However, since all stations work in a distributed manner without any coordination, we should deploy the same policy (i.e., same piece of codes in practice) to all stations under which they will automatically differentiate their transmission probabilities. Toward that end, we propose a Reinforcement-Learning-based Random Access scheme for Delay-Constrained communications, called RLRA-DC, under which different stations collaboratively attain different transmission probabilities by only interacting with the access point. Our numerical result shows that the system timely throughput of RLRA-DC can be as high as 0.8 for tens of stations and can still reach 0.6 even for thousands of stations, much larger than $1/e$.

Bounded Mean-Delay Throughput and Non-Starvation Conditions in Aloha Network

Delay Analysis of Aloha Network.

A Novel Enhanced Frameless Slotted ALOHA Protocol based on Network Status

Throughput capacity of ALOHA MANETs

On Delivery Delay-Constrained Throughput and End-to-End Delay in MANETs

Achieving Stability for Aloha Networks with Multiple Receivers

VQ-CSMA: Throughput-Optimal Low-Delay Random Access

On the Rate of Successful Transmissions in Finite Slotted Aloha Manets

Binary Exponential Backoff Algorithm for Slotted ALOHA

On the Interplay between Deadline-Constrained Traffic and the Number of Allowed Retransmissions in Random Access Networks

Jamming Strategy Optimization for Dual-Channel ALOHA Network with Long Time Delay

Threshold ALOHA with sensing data lookup in low-duty-cycle wireless networks

Throughput Analysis of LAA and Wi-Fi Coexistence Network with Asynchronous Channel Access

Algorithm of optimal packet size and aggregation number for IEEE 802.11n system

Analysis of the Age of Information in Age-Threshold Slotted ALOHA

Throughput analysis of 2-D OCDMA/pure ALOHA networks with access control and two user classes of variable length for multimedia traffic

Age-Threshold Slotted ALOHA for Optimizing Information Freshness in Mobile Networks

Throughput and Delay Analysis of Wireless Random Access Networks

The Story of $1/e$: ALOHA-based and Reinforcement-Learning-based Random Access for Delay-Constrained Communications

Delay Analysis in Static Poisson Network

Maximum Throughput Analysis and Enhancement of Slotted ALOHA for Multihop Ad Hoc Networks