Abstract:Large-scale distributed machine learning (ML) systems involve extensive and costly computational resources. Pricing and scheduling, as two promising techniques for resource management, have garnered significant attention. However, existing job pricing and scheduling algorithms in cloud computing either charge fixed resource fees based on known job runtime or implement dynamic price setting with job preemption, unsuitable for distributed ML systems with high uncertainties and switching cost. First, whether the resources of a distributed ML job are placed together or not results in different job runtime. Second, various time-varying factors, including job arrival rates and competitors’ pricing, affect resource prices. Third, frequent price changes for the same resource can easily lead to system instability, ultimately jeopardizing user satisfaction. Addressing these uncertainties is challenging. This paper introduces APOS, an adaptive pricing and online scheduling framework, aiming at maximizing the operator’s overall revenue. APOS incorporates two innovations. 1) Intelligent Pricing: We represent each price using a feature vector that encapsulates relevant factors. Subsequently, based on the linear Upper Confidence Bound (UCB) techniques, we establish relationships between price features and two revenue-associated elements: job arrival rates and resource consumption rates. To ensure system stability, we introduce batch pricing to reduce the frequency of resource price updates. 2) Online Scheduling: We strive to compute a non-preemptive schedule that balances job utility with corresponding resource cost. We rigorously prove that APOS achieves truthfulness, individual rationality, system stability, and sublinear regret in polynomial time. Finally, extensive trace-driven simulations confirm that APOS outperforms four state-of-the-art baselines, yielding a minimum of 23.3% improvement in total operator revenue.

DPS: Dynamic Pricing and Scheduling for Distributed Machine Learning Jobs in Edge-Cloud Networks

Dynamic Pricing and Placing for Distributed Machine Learning Jobs: an Online Learning Approach.

Online Scheduling of Machine Learning Jobs in Edge-Cloud Networks

Adaptive Pricing and Online Scheduling for Distributed Machine Learning Jobs

Preemptive Scheduling for Distributed Machine Learning Jobs in Edge-Cloud Networks

Dynamic Pricing Scheme for Edge Computing Services: A Two-layer Reinforcement Learning Approach

Cost-Effective Traffic Scheduling and Resource Allocation for Edge Service Provisioning

DDPS: Dynamic Differential Pricing-based Edge Offloading System with Energy Harvesting Devices

Game-based distributed pricing and task offloading in multi-cloud and multi-edge environments

Dynamic Pricing based Near-Optimal Resource Allocation for Elastic Edge Offloading

A Novel Dynamic Pricing Approach for Preemptible Cloud Services

Occupation-Oblivious Pricing of Cloud Jobs via Online Learning.

Dynamic pricing in profit-driven task assignment: a domain-of-influence based approach

An Online Emergency Demand Response Mechanism for Cloud Computing

Dynamic Pricing and Profit Maximization for the Cloud with Geo-Distributed Data Centers.

Computational-Intelligence-Based Scheduling with Edge Computing in Cyber–Physical Production Systems

Pricing Model for Dynamic Resource Overbooking in Edge Computing

Pricing-based resource allocation in three-tier edge computing for social welfare maximization

Computing Resource Allocation Strategy Based on Cloud-Edge Cluster Collaboration in Internet of Vehicles

Real-Time Dynamic Pricing for Edge Computing Services: A Market Perspective

Towards Cost-Optimal Policies for DAGs to Utilize IaaS Clouds with Online Learning