Abstract:The role of scalable high-performance workflows and flexible workflow management systems that can support multiple simulations will continue to increase in importance. For example, with the end of Dennard scaling, there is a need to substitute a single long running simulation with multiple repeats of shorter simulations, or concurrent replicas. Further, many scientific problems involve ensembles of simulations in order to solve a higher-level problem or produce statistically meaningful results. However most supercomputing software development and performance enhancements have focused on optimizing single- simulation performance. On the other hand, there is a strong inconsistency in the definition and practice of workflows and workflow management systems. This inconsistency often centers around the difference between several different types of workflows, including modeling and simulation, grid, uncertainty quantification, and purely conceptual workflows. This work explores this phenomenon by examining the different types of workflows and workflow management systems, reviewing the perspective of a large supercomputing facility, examining the common features and problems of workflow management systems, and finally presenting a proposed solution based on the concept of common building blocks. The implications of the continuing proliferation of workflow management systems and the lack of interoperability between these systems are discussed from a practical perspective. In doing so, we have begun an investigation of the design and implementation of open workflow systems for supercomputers based upon common components.

The Problem-Based Scientific Workflow Design and Performance in Grid Environments

An Architecture Of Workflow In Grid Environment

On Design, Verification, and Dynamic Modification of the Problem-Based Scientific Workflow Model

Study on Pi-Calculus Based Equipment Grid Service Chain Model.

An Architectural Model for a Grid based Workflow Management Platform in Scientific Applications

Study on Equipment Interoperation Chain Model in Grid Environment

A Context- and Role-Driven Scientific Workflow Development Pattern

Grid Workflow Based on Dynamic Modeling and Scheduling

Grid Workflow Based On Performance Evaluation

Workflow Management in the Grid Era: A Goal-Driven Approach Based on Process Patterns

A Grid Workflow Framework with High Scalability and Usability

GEO-WMS: an Improved Approach to Geoscientific Workflow Management System on HPC

Workflow Management In Grid Era: From Process-Driven Paradigm To A Goal-Driven One

Towards a Grid Platform for Scientific Workflows Management

Process model based scale-free knowledge grid modeling technology

Grid Workflow Research and Existing Problems

A Grid-Computing-Based Solution To Science & Engineering Computing And Its Implementation

Study On Problem-Solving-Oriented Scale-Free Knowledge Grid

Toward Common Components for Open Workflow Systems

The Design of Dynamic Grid Workflow Web Portal for Remote Sensing Information Service

S-WFMS: A Service-Based Workflow Management System in Grid Environment