Abstract:This paper studies the packet scheduling problem in Broadband Wireless Access (BWA) networks. The key difficulties of the BWA scheduling problem lie in the high variability of wireless channel capacity and the unknown model of packet arrival process. It is difficult for traditional heuristic scheduling algorithms to handle the situation and guarantee satisfying performance in BWA networks. In this paper, we introduce learning-based approach for a better solution. Specifically, we formulate the packet scheduling problem as an average cost Semi-Markov Decision Process (SMDP). Then, we solve the SMDP by using reinforcement learning. A feature-based linear approximation and the Temporal-Difference learning technique are employed to produce a near optimal solution of the corresponding SMDP problem. The proposed algorithm, called Reinforcement Learning Scheduling (RLS), has in-built capability of self-training. It is able to adaptively and timely regulate its scheduling policy according to the instantaneous network conditions. Simulation results indicate that RLS outperforms two classical scheduling algorithms and simultaneously considers: (i) effective QoS differentiation, (ii) high bandwidth utilization, and (iii) both short-term and long-term fairness.

Packet Scheduling Algorithm for Real-Time Services in Broadband WMAN

A Weighted Fair Queuing Scheduling Algorithm With (M,K)-Firm Guarantee

Fair Packet Scheduling Algorithm for Adaptive Wireless Communication System

A New Scheme to Improve Fairness for Assured Service in Differentiated Services Network

MFLWQ: a fair and adaptive queue management algorithm for scavenger service

A Modified Fair Aggregate Marking Algorithm in DiffServ

Opportunistic Scheduling for Heterogeneous Services in Downlink OFDMA System

Enhanced Wfq Algorithm With (M,K)-Firm Guarantee

Resource Allocation and Scheduling Algorithm for Wireless Communication System with QoS Guaranteed

Delay-Based Weighted Proportional Fair Algorithm for LTE Downlink Packet Scheduling

QoS Differentiated and Fair Packet Scheduling in Broadband Wireless Access Networks

An Improved DRR Packet Scheduling Algorithm Based on Even Service Sequence

Packet-Mode Scheduling with Proportional Fairness for Input-Queued Switches.

A Fair and Efficient Packet Scheduling Scheme for IEEE 802.16 Broadband Wireless Access Systems

Dynamic WFQ scheduling for real-time traffic in wireless ATM links

NDPS: Packet Scheduling Algorithm for Wireless Multimedia Networks

A fast packet scheduling algorithm to provide QoS for streaming service in shared channels

A New Rate-Based Active Queue Management Scheme over Wired-cum-Wireless Networks

Packet Scheduling In Broadband Wireless Multimedia Networks

A Scheduling Algorithm Using Compensating Round Robin in Packet-Swtiching Broadband Networks

The Packet Scheduling Algorithm for GPRS