GEO-WMS: an Improved Approach to Geoscientific Workflow Management System on HPC
Jiaxu Guo,Yidan Xu,Haohuan Fu,Wei Xue,Lin Gan,Mengxuan Tan,Tingye Wu,Yutong Shen,Xianwei Wu,Liang Hu,Xilong Che
DOI: https://doi.org/10.1007/s42514-022-00131-x
2023-01-01
CCF Transactions on High Performance Computing
Abstract:With the increasing complexity of scientific computing, it is imperative to enhance the efficiency and ease of High Performance Computing (HPC) utilization. Scientific workflow is introduced to that aim, but the current infrastructure still needs optimization. In this paper, we discuss the current problems based on scientific computing scenarios and design a more user-friendly workflow system solution targeting HPC services. In the proposed solution, we introduce a structured method to describe the workflow and employ a more user-friendly interface for scientific workflows to bring a better experience than traditional command line approaches. We have integrated a variety of methods to enhance the user experience during geoscience experiments. Data analytics are being used to make more intelligent recommendations to users. Runtime predictions help users to better plan their schedules for research. The statistics of the testing period and user feedback show that the proposed workflow management system can effectively save the operating time and complexity of the scientists, while saving computing resources. Our proposed system has a variety of advantageous features, including the ease of use, uniform specification with scalability, improved utilization of computing resources, and exemplary significance.