Abstract:With advances in scientific instrumentation and simulation, scientific data is growing fast in both size and analysis complexity. So-called Data Grids aim to provide high performance, distributed data analysis infrastructure for data-intensive sciences, where scientists distributed worldwide need to extract information from large collections of data, and to share both data products and the resources needed to produce and store them.However, the description, composition, and execution of even logically simple scientific workflows are often complicated by the need to deal with "messy" issues like heterogeneous storage formats and ad-hoc file system structures. We show how these difficulties can be overcome via a typed workflow notation called virtual data language, within which issues of physical representation are cleanly separated from logical typing, and by the implementation of this notation within the context of a powerful virtual data system that supports distributed execution. The resulting language and system are capable of expressing complex workflows in a simple compact form, enacting those workflows in distributed environments, monitoring and recording the execution processes, and tracing the derivation history of data products.We describe the motivation, design, implementation, and evaluation of the virtual data language and system, and the application of the virtual data paradigm in various science disciplines, including astronomy, cognitive neuroscience.

Virtual workflow system for distributed collaborative scientific applications on Grids

Grid Service-Based Parallel Finite Element Analysis

An Architecture Of Workflow In Grid Environment

An Engineering Computation Oriented Visual Grid Framework

A Public Grid Computing Framework Based on a Hierarchical Combination of Middleware

Multi-discipline computations and collaborative visualization on the campus grid

Portal Access to Scientific Computation and Customized Collaborative Visualization on Campus Grid

Decentralized Workflow Execution for Virtual Enterprises in Grid Environment

A Grid Workflow Framework with High Scalability and Usability

Virtual Workflow Management System in Grid Environment

A virtual data language and system for scientific workflow management in data grid environments

Introduction to an agent-based grid workflow management system

A distributed re-configurable grid workflow engine

Gridflow: Workflow Management for Grid Computing

Applying Computational Grid Technology to Power System

S-WFMS: A Service-Based Workflow Management System in Grid Environment

A Distributed-Computing Integrated Collaborative CAD System

Building the Distributed Geographic SQL Workflow in the Grid Environment.

Grid Workflow Based on Dynamic Modeling and Scheduling

A client-side workflow middleware in the grid

A QoS-Aware and Fault-Tolerant Workflow Composition for Grid