Abstract:Modern scientific applications predominantly run on large-scale computing platforms, necessitating collaboration between scientific domain experts and high-performance computing (HPC) experts. While domain experts are often skilled in customizing domain-specific scientific computing routines, which often involves various matrix computations, HPC experts are essential for achieving efficient execution of these computations on large-scale platforms. This process often involves utilizing complex parallel computing libraries tailored to specific matrix computation scenarios. However, the intricate programming procedure and the need for deep understanding in both application domains and HPC poses significant challenges to the widespread adoption of scientific computing. In this research, we observe that matrix computations can be transformed into equivalent graph representations, and that by utilizing graph processing engines, HPC experts can be freed from the burden of implementing efficient scientific computations. Based on this observation, we introduce a graph engine-based scientific computing (Graph for Science) paradigm, which provides a unified graph programming interface, enabling domain experts to promptly implement various types of matrix computations. The proposed paradigm leverages the underlying graph processing engine to achieve efficient execution, eliminating the needs for HPC expertise in programming large-scale scientific applications. Our results show that the graph engine-based scientific computing paradigm achieves performance comparable to the best-performing implementations based on existing parallel computing libraries and bespoke implementations. Importantly, the paradigm greatly simplifies the development of scientific computations on large-scale platforms, reducing the programming difficulty for scientists and facilitating broader adoption of scientific computing.

Using the High-Level Based Program Interface to Facilitate the Large Scale Scientific Computing

A Public Grid Computing Framework Based on a Hierarchical Combination of Middleware

Grid Service-Based Parallel Finite Element Analysis

Multi-discipline computations and collaborative visualization on the campus grid

Research On User Programming Environment In Grid

MASSIVE: A Multidisciplinary Applications-Oriented Simulation and Visualization Environment

Applying Computational Grid Technology to Power System

Portal Access to Scientific Computation and Customized Collaborative Visualization on Campus Grid

An Engineering Computation Oriented Visual Grid Framework

A Grid Service-Based Engineering Computation Architecture.

A Deadline And Budget Constrained Cost-Time Optimization Algorithm For Scheduling Dependent Tasks In Grid Computing

An Enabling Environment for Distributed Simulation and Visualization

A Grid-Computing-Based Solution To Science & Engineering Computing And Its Implementation

A Study Of Gridifying Scientific Computing Legacy Codes

A Grid Workflow Framework with High Scalability and Usability

Research and Implementation of Distributed Simulation and Parallel Rendering System Based on Grid

Realizing Fast, Scalable and Reliable Scientific Computations in Grid Environments

Design and Implementation of SCO-GADL — A Scientific Computing Oriented Grid Workflow

Graph for Science: From API based Programming to Graph Engine based Programming for HPC

Parallel Processing on Block-Based Gauss-Jordan Algorithm for Desktop Grid.

Computing Pool: A Simplified and Practical Computational Grid Model.