Abstract:Large-scale distributed machine learning (ML) systems involve extensive and costly computational resources. Pricing and scheduling, as two promising techniques for resource management, have garnered significant attention. However, existing job pricing and scheduling algorithms in cloud computing either charge fixed resource fees based on known job runtime or implement dynamic price setting with job preemption, unsuitable for distributed ML systems with high uncertainties and switching cost. First, whether the resources of a distributed ML job are placed together or not results in different job runtime. Second, various time-varying factors, including job arrival rates and competitors’ pricing, affect resource prices. Third, frequent price changes for the same resource can easily lead to system instability, ultimately jeopardizing user satisfaction. Addressing these uncertainties is challenging. This paper introduces APOS, an adaptive pricing and online scheduling framework, aiming at maximizing the operator’s overall revenue. APOS incorporates two innovations. 1) Intelligent Pricing: We represent each price using a feature vector that encapsulates relevant factors. Subsequently, based on the linear Upper Confidence Bound (UCB) techniques, we establish relationships between price features and two revenue-associated elements: job arrival rates and resource consumption rates. To ensure system stability, we introduce batch pricing to reduce the frequency of resource price updates. 2) Online Scheduling: We strive to compute a non-preemptive schedule that balances job utility with corresponding resource cost. We rigorously prove that APOS achieves truthfulness, individual rationality, system stability, and sublinear regret in polynomial time. Finally, extensive trace-driven simulations confirm that APOS outperforms four state-of-the-art baselines, yielding a minimum of 23.3% improvement in total operator revenue.

Online Scheduling Algorithms for Unbiased Distributed Learning over Wireless Edge Networks

Online Scheduling of Machine Learning Jobs in Edge-Cloud Networks

Online Scheduling Algorithm for Heterogeneous Distributed Machine Learning Jobs

Adaptive Partitioning and Efficient Scheduling for Distributed DNN Training in Heterogeneous IoT Environment

Reinforcement Learning Based Online Scheduling of Multiple Workflows in Edge Environment

Preemptive Scheduling for Distributed Machine Learning Jobs in Edge-Cloud Networks

Edge-Aided Computing and Transmission Scheduling for LTE-U-Enabled IoT

DPS: Dynamic Pricing and Scheduling for Distributed Machine Learning Jobs in Edge-Cloud Networks

Online Approximation Scheme for Scheduling Heterogeneous Utility Jobs in Edge Computing

Online Job Scheduling in Distributed Machine Learning Clusters

Joint Task Partitioning and Parallel Scheduling in Device-Assisted Mobile Edge Networks

Online job scheduling for distributed machine learning in optical circuit switch networks

Online Distributed Learning-Based Load-Aware Heterogeneous Vehicular Edge Computing

Deep Reinforcement Learning-based scheduling for optimizing system load and response time in edge and fog computing environments

Edge Collaborative Online Task Offloading Method Based on Reinforcement Learning

Adaptive Pricing and Online Scheduling for Distributed Machine Learning Jobs

Task Offloading Based on LSTM Prediction and Deep Reinforcement Learning for Efficient Edge Computing in IoT

A DRL-based online real-time task scheduling method with ISSA strategy

Dynamic Scheduling for Over-the-Air Federated Edge Learning With Energy Constraints

Task Scheduling with Optimized Transmission Time in Collaborative Cloud-Edge Learning

Real-Time Virtual Machine Scheduling in Industry IoT Network: A Reinforcement Learning Method