Abstract:The essence of distributed computing systems is how to schedule incoming requests and how to allocate all computing nodes to minimize both time and computation costs. In this paper, we propose a cost-aware optimal scheduling and allocation strategy for distributed computing systems while minimizing the cost function including response time and service cost. First, based on the proposed cost function, we derive the optimal request scheduling policy and the optimal resource allocation policy synchronously. Second, considering the effects of incoming requests on the scheduling policy, the additive increase multiplicative decrease (AIMD) mechanism is implemented to model the relation between the request arrival and scheduling. In particular, the AIMD parameters can be designed such that the derived optimal strategy is still valid. Finally, a numerical example is presented to illustrate the derived results.

What problem does this paper attempt to address?

This paper attempts to solve the problems of resource scheduling and allocation in distributed computing systems, especially how to effectively schedule requests and allocate computing nodes while minimizing the cost function (including response time and service cost). Specifically, the paper focuses on the following aspects: 1. **Cost - aware Optimal Scheduling and Allocation Strategy**: The paper proposes a cost - considered optimal scheduling and allocation strategy, aiming to minimize the cost function by optimizing the request scheduling strategy and the resource allocation strategy. The cost function includes two aspects: response time and service cost. 2. **Modeling the Relationship between Request Arrival and Scheduling**: Considering the impact of request arrival on the scheduling strategy, the paper adopts the Additive Increase Multiplicative Decrease (AIMD) mechanism to model the relationship between request arrival and scheduling. In particular, the AIMD parameters are designed so that the derived optimal strategy remains valid. 3. **Dynamic Resource Management**: Since the price of each computing node (i.e., the cost of processing requests per unit time) affects which computing nodes are allocated to new requests, the proposed optimal strategy is dynamic. 4. **Convergence of Scheduling Rate under the AIMD Mechanism**: To verify the effectiveness of the optimal strategy derived under the AIMD mechanism, the AIMD parameters are designed so that the convergence point of the scheduling rate is the derived optimal scheduling rate. ### Specific Problem - Solving Methods - **Definition of Cost Function**: - Response time: \[ T=\frac{1}{\lambda}\sum_{i = 1}^{n}\frac{u_{i}}{\gamma_{i}-u_{i}} \] - Service cost: \[ C=\frac{1}{\lambda}\sum_{i = 1}^{n}u_{i}\phi_{i}(\gamma_{i}) \] - Total cost function: \[ J=\frac{1}{\lambda}\sum_{i = 1}^{n}\left(\frac{u_{i}}{\gamma_{i}-u_{i}}+K u_{i}\phi_{i}(\gamma_{i})\right) \] - **Construction of Optimization Problem**: - Objective: Minimize the cost function \(J\) - Constraints: - The sum of request scheduling rates is equal to the arrival rate: \[ \sum_{i = 1}^{n}u_{i}=\lambda \] - The service rate does not exceed the maximum value: \[ \gamma_{i}\leq\gamma_{\max}^{i} \] - The service rate is greater than the scheduling rate and non - negative: \[ \gamma_{i}>u_{i}\geq0 \] - **Derivation of Optimal Scheduling and Allocation Strategy**: - By introducing Lagrange multipliers, constructing the Lagrange function, and solving the KKT conditions, the optimal scheduling rate and service rate are obtained. - **Application of AIMD Mechanism**: - Adjust the scheduling rate through the AIMD mechanism to ensure that the scheduling rate can quickly converge to the optimal value in the case of changes in the request arrival rate or the scheduler has a backlog of requests. ### Conclusion The paper proposes a cost - aware optimal scheduling and allocation strategy, which minimizes the cost function of the distributed computing system by optimizing the request scheduling rate and service rate. At the same time, through the AIMD mechanism, the effectiveness of the scheduling strategy in a dynamic environment is ensured. These methods provide an effective resource management and scheduling scheme for distributed computing systems.

Optimal Resource Scheduling and Allocation in Distributed Computing Systems

A Deadline And Budget Constrained Cost-Time Optimization Algorithm For Scheduling Dependent Tasks In Grid Computing

An Exponentially Convergent Distributed Algorithm for Resource Allocation Problem

A Distributed Algorithm for Resource Allocation Over Dynamic Digraphs.

Optimal Resource Scheduling and Allocation under Allowable Over-Scheduling

How to Optimally Allocate Resources for Coded Distributed Computing?

Near-Optimal Scheduling Mechanisms for Deadline-Sensitive Jobs in Large Computing Clusters

Optimal Allocation of Tasks and Price of Anarchy of Distributed Optimization in Networked Computing Facilities

Scheduling Policies for Stability and Optimal Server Running Cost in Cloud Computing Platforms

Enhanced Parallel Application Scheduling Algorithm with Energy Consumption Constraint in Heterogeneous Distributed Systems

Optimal Divisible Load Scheduling for Resource-Sharing Network

Cost-Efficient Workflow Scheduling Algorithm for Applications With Deadline Constraint on Heterogeneous Clouds

On Minimizing Energy Cost in Internet-Scale Systems with Dynamic Data

Design and Implementation of Distributed Resource Management for Time Sensitive Applications

Reallocation Problems in Scheduling

Job scheduling optimization based on resource load balance in cloud computing

Adaptive Pricing and Online Scheduling for Distributed Machine Learning Jobs

Optimal Different Due-Date Assignment Scheduling with Group Technology and Resource Allocation

Scheduling for Cloud-Based Computing Systems to Support Soft Real-Time Applications

Maximizing Heterogeneous Server Utilization with Limited Availability Times for Divisible Loads Scheduling on Networked Systems

Energy Optimization Heuristics for Budget-Constrained Workflow in Heterogeneous Computing System.