Abstract:Online task scheduling serves an integral role for task-intensive applications in cloud computing and crowdsourcing. Optimal scheduling can enhance system performance, typically measured by the reward-to-cost ratio, under some task arrival distribution. On one hand, both reward and cost are dependent on task context (e.g., evaluation metric) and remain black-box in practice. These render reward and cost hard to model thus unknown before decision making. On the other hand, task arrival behaviors remain sensitive to factors like unpredictable system fluctuation whereby a prior estimation or the conventional assumption of arrival distribution (e.g., Poisson) may fail. This implies another practical yet often neglected challenge, i.e., uncertain task arrival distribution. Towards effective scheduling under a stationary environment with various uncertainties, we propose a double-optimistic learning based Robbins-Monro (DOL-RM) algorithm. Specifically, DOL-RM integrates a learning module that incorporates optimistic estimation for reward-to-cost ratio and a decision module that utilizes the Robbins-Monro method to implicitly learn task arrival distribution while making scheduling decisions. Theoretically, DOL-RM achieves convergence gap and no regret learning with a sub-linear regret of $O(T^{3/4})$, which is the first result for online task scheduling under uncertain task arrival distribution and unknown reward and cost. Our numerical results in a synthetic experiment and a real-world application demonstrate the effectiveness of DOL-RM in achieving the best cumulative reward-to-cost ratio compared with other state-of-the-art baselines.

Online Task Scheduling and Termination with Throughput Constraint

Learning to Schedule Tasks with Deadline and Throughput Constraints.

Survey of Weakly-Hard Real Time Schedule Theory and Its Application

Optimal differentiated threshold characterization for multi-task stochastic deadline scheduling with queuing

Real Time Performance Evaluation for Dynamic Scheduling Algorithm

Learning to Schedule Online Tasks with Bandit Feedback

Throughput-Optimal Scheduling for Multi-Hop Networked Transportation Systems With Switch-Over Delay

Enhancing Throughput for TTEthernet via Co-optimizing Routing and Scheduling: An Online Time-Varying Graph-based Method

Online Scheduling to Minimize Modified Total Tardiness with an Availability Constraint

Learning-based Scheduling for Information Gathering with QoS Constraints

Online Scheduling Strategy to Minimize Penalty of Tardiness for Real-Time Tasks in Mobile Edge Computing Systems

Reinforcement Learning for Online Dispatching Policy in Real-Time Train Timetable Rescheduling

Developing Real-Time Scheduling Policy by Deep Reinforcement Learning

Single-machine Scheduling with a Time-Dependent Learning Effect

Single-Machine Scheduling with Simultaneous Learning Effects and Delivery Times

Asymptotically Optimal Lagrangian Priority Policy for Deadline Scheduling With Processing Rate Limits

A Near-Optimal Semi-Online Algorithm for Maximizing Throughput Scheduling Problem ⁄

Online Multi-User Scheduling for XR Transmissions with Hard-Latency Constraint: Performance Analysis and Practical Design

Online Strategy and Competitive Analysis in Order Scheduling Problem with Threshold Bound

A Best Possible Online Algorithm for Single-Machine Scheduling with Non-delayed Processing Constraint and Bounded Delivery Times

Group-Fair Online Allocation in Continuous Time