Abstract:Energy distribution networks represent crucial infrastructures for modern society, and various simulation tools have been widely used by energy suppliers to manage these intricate networks. However, simulation calculations include a large number of fluid control equations, and computational overhead limits the performance of simulation software. This paper proposes a universal parallel simulation framework for energy pipeline networks that takes advantages of data parallelism and computational independence between network elements. A non-pipe model of an energy supply network is optimized, and the input and output of the network model in the proposed framework are modified, which can reduce the development burden during the numerical computations of the pipeline network and weaken the computational correlation between different simulated components. In addition, independent computations can be performed concurrently through periodic data exchange procedures between component instances, improving the parallelism and efficiency of simulation computations. Further, a parallel water pipelines network simulation computing paradigm based on a heterogeneous computer hardware architecture is used to evaluate the proposed framework's performance. A series of tests are conducted to verify the accuracy of the proposed framework, and simulation errors of less than 5% are achieved. The results of multi-threaded simulation experiments have demonstrated the feasibility of the proposed framework in a parallel computing approach. Moreover, an Advanced Micro Devices (AMD) Deep Computing Unit (DCU)-parallel program is implemented into a water supply network simulation system; the computational efficiency of this system is compared with that of its serial counterpart. The experimental results show that the proposed framework is appropriate for high-performance computer architectures, and the 18x speed-up ratio demonstrates that the parallel program based on the proposed universal framework outperforms the serial program. That provides the basis for the application of pipe network simulation on high-performance computers.

PipeFlow Engine: Pipeline Scheduling with Distributed Workflow Made Simple

Design and Implementation of D-Flow Engine Supporting Dynamic Scheduling

Pipeflow: an Efficient Task-Parallel Pipeline Programming Framework Using Modern C++.

An Efficient Task-Parallel Pipeline Programming Framework.

Scalable-Grain Pipeline Parallelization Method For Multi-Core Systems

Bigflow: A General Optimization Layer for Distributed Computing Frameworks

Cloudflow: A Data-Aware Programming Model for Cloud Workflow Applications on Modern Hpc Systems

BigDataflow: A Distributed Interprocedural Dataflow Analysis Framework

ComPipe: A Novel Flow Placement and Measurement Algorithm for Programmable Composite Pipelines

Distributed Pipeline Programming Framework for State-Based Pattern

Progressive online aggregation in a distributed stream system

Dflow, a Python framework for constructing cloud-native AI-for-Science workflows

An On-the-Fly Scheduling Strategy for Distributed Stream Processing Platform.

Design And Analysis Of A New Distributed Scheduling Approach

Streaming Task Graph Scheduling for Dataflow Architectures

A Computational Framework based on the Dynamic Pipeline Approach

Taskflow: A Lightweight Parallel and Heterogeneous Task Graph Computing System

A Deadline-Aware Coflow Scheduling Approach for Big Data Applications.

A novel agent-based parallel ETL system for massive data

A universal parallel simulation framework for energy pipeline networks on high-performance computers

Taskflow: A General-Purpose Parallel and Heterogeneous Task Programming System