Design and implementation of an optimal job scheduling model in the high performance computing environment

Xiao-ning WANG,Hai-li XIAO,Rong-qiang CAO

DOI: https://doi.org/10.3969/j.issn.1007-130X.2017.04.002

2017-01-01

Abstract:The high performance computing environment is a computing platform,which aggregates multiple distributed high performance computers from indifferent organizations,providing users with unified access and usage patterns.The system middleware matches the appropriate high-performance computing resources according to users'job request.With the opening of the environment programming interface (API) and the substantial increase in the number of job submission requests,some job submission requests fail because of too many network connections under high concurrent job submission requests.Also,the job scheduling strategy is lack of flexibility.We propose an optimized job scheduling model in the high performance computing environment,which introduces environment job queues,refines the system-level status for each job,and increases the configuration of job scheduling strategy.We also implement a prototype system based on middleware SCE.Test results show that no job request fails under the workload of 200 job requests each minute in a single system service.In a total of 1000 jobs,nearly 500 job submissions are completed within 0.3 seconds,and more than 800 job submissions are completed in less than 0.5 seconds.