An implementation of workflow-based user environment for high performance computing

Ke Yang,Baoming Han,Zu J. Li

DOI: https://doi.org/10.1109/ICACC.2010.5487252

2010-01-01

Abstract:In high performance computing environment in many fields, to finish a task requires not only computing service, but also data service and all kinds of device services, which results in different relation dependences and is very complex, however, job management systems such as PBS, LSF, and Condor and so on, only support time dependence among jobs, and are short of fault-tolerance and complete flow control. Workflow-based user environment for high performance computing is successfully applied in railway survey, which not only benefits construction and control of task flow, but also enhances all kinds of relation dependences and flow semantics, especially for the work flow engine based on event model with checkpoint function. It provides good reliability. Thus, workflow-based user environment for high performance computing can be flexibly suitable for other different user environment.