The Research of Execute Unit's State Mechanism in Scientific Workflow System

Yanbo Geng,Hui Deng,Feng Wang,Kaifan Ji,Bo Liang,Yingbo Liu
DOI: https://doi.org/10.1109/ICINIS.2011.63
2011-01-01
Abstract:Scientific workflow system (SWFs) is a tool which is used in scientific research. SWFs is a useful tool that brings remote data access and management under distributed infrastructures to the desktop. Because the Scientific workflow is highly data-centric naturally, it makes the scientific data management, analysis, simulation on distributed infrastructures challenging. When scientist use a SWFs to computation or to analysis large data sets, it is important that the SWFs can monitor the execution state on the distributed infrastructures. We first develop a prototype of light-weight SWFs, and implement a scientific workflow engine (SWFe) which implements the basic function of the SWFs. We design the monitor state mechanism as part of the SWFe. Through the state mechanism, scientist can easily know if the remote resources or data can be used. They can also validate the computation result by means of the state mechanism.
What problem does this paper attempt to address?