Task scheduling based on swarm intelligence algorithms in high performance computing environment

Xuqing Chai
DOI: https://doi.org/10.1007/s12652-020-01994-0
IF: 3.662
2020-05-02
Journal of Ambient Intelligence and Humanized Computing
Abstract:The high-performance computing environment is a computing platform, which aggregates multiple distributed high-performance computers from indifferent organizations, providing users with unified access and usage patterns. Since the task scheduling strategy is lack of flexibility, an optimized task scheduling model in the high-performance computing environment is proposed in this paper, which introduces an improved swarm intelligence algorithm in task queues, refines the Core Scheduler for each task, and increases the configuration of task scheduling strategy. In core task scheduling, swarm intelligence algorithm is adopted to minimize the average scheduling time for completion tasks through optimal task allocation on each node. Simulation results show that the proposed scheduling algorithm is better than the traditional task scheduling algorithm. Therefore, according to the task scheduling strategy based on swarm intelligence algorithm, it can effectively reduce the task waiting, improve the system's throughput, the task response and system resource utilization has a better effect.
computer science, information systems,telecommunications, artificial intelligence
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the lack of flexibility in task - scheduling strategies in high - performance computing environments, which leads to resource waste and overly long task response times. Specifically, traditional task - scheduling algorithms are too simply designed, without considering user configurations and other situations, and are prone to falling into local optima, resulting in low resource utilization. Therefore, the paper proposes a task - scheduling model based on an improved swarm intelligence algorithm, aiming to minimize the average scheduling time for task completion through optimized task allocation and improve the system's throughput, task - response speed, and system - resource utilization. ### Background and Problem Description of the Paper In high - performance computing (HPC) environments, task scheduling is a crucial issue. HPC environments are usually composed of multiple distributed high - performance computers, which are connected through high - speed networks and support the execution of parallel applications. The effectiveness of task - scheduling strategies directly affects the performance of the system, including task execution time, resource utilization, and user satisfaction. However, existing task - scheduling strategies have the following problems: - **Lack of flexibility**: Traditional task - scheduling algorithms are too simply designed and cannot adapt to complex task requirements. - **Resource waste**: Task scheduling does not consider user configurations and other situations, leading to resource waste. - **Long task - response time**: Traditional algorithms are prone to falling into local optima, resulting in overly long task - response times. - **Low resource utilization**: Task scheduling is insufficient, resulting in low system - resource utilization. ### Solution To solve the above problems, the paper proposes a task - scheduling model based on an improved swarm intelligence algorithm. The main features of this model include: - **Introduction of an improved swarm intelligence algorithm**: An improved swarm intelligence algorithm is introduced into the task queue to optimize task allocation. - **Refinement of the core scheduler**: The core scheduler for each task is refined to increase the configuration of task - scheduling strategies. - **Optimization of task allocation**: Through optimal task allocation, the average scheduling time on each node is minimized. ### Experimental Verification To verify the effectiveness of the proposed scheduling algorithm, the paper conducted simulation experiments. The experimental results show that the scheduling algorithm based on the swarm intelligence algorithm is superior to traditional task - scheduling algorithms in the following aspects: - **Reduction of task - waiting time**: Effectively reduces the task - waiting time. - **Improvement of system throughput**: Significantly improves the system's throughput. - **Improvement of task - response speed**: Increases the task - response speed. - **Improvement of resource utilization**: Increases the utilization of system resources. ### Conclusion In summary, by introducing an improved swarm intelligence algorithm, the paper proposes a new task - scheduling model, which effectively solves the problems of lack of flexibility in task - scheduling strategies, resource waste, and overly long task - response times in high - performance computing environments. The experimental results verify the effectiveness and superiority of this model.