Abstract:This paper studies the distributed scheduling of traffic flows with arbitrary deadlines that arrive at their source nodes and are transmitted to different destination nodes via multiple intermediate nodes in a wireless mesh network. When a flow is successfully delivered to its destination, a reward will be obtained, which is the embodiment of network performance and can be expressed by metrics such as throughput or network utility. The objective is to maximize the aggregate reward of all the deadline-constrained flows, which can be transformed into the constrained Markov decision process (CMDP). According to the transformation, a policy gradient-based distributed scheduling (PGDS) method is first proposed, where a primary reward and an auxiliary reward are designed to incentivize each node to independently schedule network resources such as power and subcarriers. The primary reward is generated when flows are successfully delivered to their destinations. The auxiliary reward, designed based on potential-based reward shaping (PBRS) using local information of data transmission, aims to accelerate the convergence speed. Inside this method, a reward feedback scheme is designed to let each node obtain the primary reward. Noting that each node selecting resources independently may cause interference and collision which leads to instability of data transmission, a policy gradient-based resource determination algorithm is proposed. Moreover, the optimality and convergence of the PGDS method are derived. Especially, when a policy obtained by the algorithm is not matched with the optimal policy but can better deal with the interference, an asymptotic optimum still exists and is further derived.

Maximizing Probability of Data Packet Delivery within Deadline.

Deadline Aware Retransmission Threshold Setting Protocol in Cyber-Physical Systems.

Maximizing Network Lifetime Online By Localized Probabilistic Load Balancing

Link Quality Based Path Delay Analysis in Wireless Sensor Networks

The Maximized Relay Capacity and Optimal Data Transmission for Wireless Sensor Networks.

Dynamic Optimization of Random Access in Deadline-Constrained Broadcasting

An Channel-Awared Transmission Protocol In Wireless Sensor Networks

Many-to-one Deliverability of Greedy Routing in 2-D Wireless Sensor Networks.

Random Early Detection with Priority in Scheduling of Wireless Network Coding

Probability Based Data Delivery Scheme for Mobile Sensor Network

A New Power-Efficient Scheme to Deliver Time-Sensitive Data in Sensor Networks

An Optimal Relaying Scheme for Delay-Tolerant Networks with Heterogeneous Mobile Nodes

Optimal Routing and Data Aggregation for Maximizing Lifetime of Wireless Sensor Networks

Distributed timely-throughput optimal scheduling for wireless networks

An Efficient Transmission Scheme for Data Aggregation in Wireless Sensor Networks.

On the Interplay between Deadline-Constrained Traffic and the Number of Allowed Retransmissions in Random Access Networks

Distributed Scheduling for Throughput Maximization under Deadline Constraint in Wireless Mesh Networks

Routing for Deadline-Constrained Bulk Data Transfers Based on Transfer Failure Probability

Optimal Relaying in Heterogeneous Delay Tolerant Networks

Minimum Latency Broadcasting with Conflict Awareness in Wireless Sensor Networks

Energy-Efficient Transmissions of Bursty Data Packets with Strict Deadlines over Time-Varying Wireless Channels