Workflow Management System for Numerical Weather Prediction

Weifeng Wang,Wen Zhang,Qunbo Huang,Tingfang Wang,Kaijun Ren

DOI: https://doi.org/10.1007/978-981-10-1019-4_11

2016-01-01

Abstract:Numerical weather prediction system is a complicated software system which generally involves thousands of computational processes which must be controlled and operated automatically by computers for the efficiency and correctness. This paper designs and implements a workflow management system. With this system, a new kind of workflow process definition language is adopted and the corresponding parser is accordingly developed. On the base of the workflow process definition file, a workflow execution engine is deployed to automatically execute all defined business processes or jobs. During job execution, The monitoring commands which were inserted into the job shell script files in advance can be used to collect related information which also can be displayed on the monitor interface. Moreover, checkpoint strategies are employed to quickly recovery system after it crashes abnormally. Finally, a workflow demo is taken to demonstrate the management functions and operating rules of the system.