Abstract:C arrier S ense M ultiple A ccess with C ollision A void (CSMA/CA) restricts the channel utilization efficiency although it always is regarded as a promising distributed channel access scheme, especially in dynamic dense wireless network scenarios. This paper investigates a R einforcement L earning (RL) based multi-parameter joint optimization mechanism to build suitable access configuration for dense wireless multi-hop networks. Specifically, we propose a light-weight CSMA/CA mechanism based on Q - L earning (QL), namely QL-CSMA/CA, which jointly optimizes multiple channel access parameters, including C ontention W indow (CW), Max imum B ackoff E xponent (MaxBE), and Max imum CSMA B ackoffs (MaxCSMABackoffs), by setting mixed rewards and thus leading to higher network performance. Due to the limitation of the QL-CSMA/CA in large-scale state-space scenarios, we further present an enhanced CSMA/CA mechanism based on D eep Q - N etwork (DQN), namely DQN-CSMA/CA. Despite introducing a little complexity, the DQN-CSMA/CA can significantly improve transmission performance by utilizing more comprehensive network state information in complex dynamic network scenarios. Simulation results demonstrate the effectiveness of the proposed algorithms in terms of throughput, packet loss rate, delay, and collision rate, especially in high-density scenarios. Specifically, compared to SCAMA and traditional CSMA/CA algorithms, the QL-CSMA/CA algorithm achieves 9% and 5% performance improvements in terms of throughput, while DQN-CSMA/CA algorithm achieves 14% and 10% improvements in terms of throughput, respectively.

Modeling and parameter optimization of statistical priority-based multiple access protocol

Modeling and Performance Analysis of Statistical Priority-based Multiple Access Protocol

Modeling and Performance Analysis of Statistical Priority-based Multiple Access: A Stochastic Geometry Approach

A Spatio-Temporal Analytical Model for Statistical Priority-Based Multiple Access Network

Simulink-Based Dynamic Priority Scheduling for Optimization in Network-on-Chip Communication

Adaptive Priority-threshold Setting Strategy for Statistical Priority-based Multiple Access Network.

The Performance Analysis of SPMA Protocol in High Speed Mobile Ad Hoc Network

A User-Preference-Aware Terminal-Controlled Access Network Selection Scheme in Heterogeneous Wireless Networks.

A Dynamic Packet Scheduling Method for Multipath TCP in Heterogeneous Wireless Networks

On the Backoff Scheme for SPMA Network: A Spatio-temporal Mathematical Model

A Transmission and Backoff Method Based on Deep Reinforcement Learning for Statistical Priority-based Multiple Access Network

Mean-field MARL-based Priority-Aware CSMA/CA Strategy in Large-Scale MANETs

Dynamic Priority Scheduling-Based MAC for Wireless Sensor Networks.

On the Queue Dynamics of Multiuser Multichannel Cognitive Radio Networks

Performance Analysis of Statistical Priority-Based Multiple Access Network With Directional Antennas

Delay Analysis and Optimization in Wireless Mesh Networks Based on Queuing Model

A New Priority Calculation Method for Sorted-Priority Fair Queuing

Reinforcement learning based multi-parameter joint optimization in dense multi-hop wireless networks

AQMP : an adaptive QoS MAC protocol based on IEEE802.11 in ad hoc networks

MANET load and priority based optimization strategy

A Modified Bit-Map-assisted Dynamic Queue Protocol for Multiaccess Wireless Networks with Heterogeneous Users