Research on Environment of Parallel Programming

唐斌,罗四维

DOI: https://doi.org/10.3969/j.issn.1005-8451.2003.07.002

2003-01-01

Abstract:It was examined the message-passing mechanism widely employed by cluster systems; designed and developed adistributed parallel system HPC (Heterogeneous Parallel Computing) on the heterogeneous platforms of Windows and UNIX.

What problem does this paper attempt to address?

A parallel computing method for irregular work

杨鑫,许端清,杨冰

DOI: https://doi.org/10.3785/j.issn.1008-973X.2013.11.026

2013-01-01

Abstract:In order to effectively use the powerful computing provided by the heterogeneous multi-core architecture, re-organize the data and a reasonable schedule for the execution of tasks is very necessary, according to the characteristics of the hardware architecture. This paper presents a parallel computing method for irregular work, the method is an multiple parallel integration of data parallelism, task parallelism, pipeline parallelism, is particularly suitable for the implementation of the work with dynamic behavior and complex irregular data structures algorithms, and run the program according to the storage locality and SIMD character, using priority-based dynamic scheduling and data management, to maximize the efficient use of CPU and GPU hardware computing resources and storage resources. The experiments results show that the approach can improve the parallel rendering algorithm performance for the dynamic execution and irregular data structures construction and maintenance.
Parallel Computing Technology for Wide Area Power System Modeling

SUN Jian-hua,ZENG Zi-qing,ZHOU Bing,JIN Yu-qing,JU Ping

DOI: https://doi.org/10.3969/j.issn.1673-9140.2012.01.002

2012-01-01

Abstract:Based on analyzing the needs of wide-area power system modeling,this paper proposed a parallel computing scheme.A particle swarm optimization based parallel computing algorithm was developed,and a software and hardware system was constructed.A simulation system was tested,results demonstrated the effectiveness and superiority of the model and the parallel computing technology.The parallel computing technology is valuable for engineering application.
Design, Implementation of the Parallel C Language Based on C/S Mode in Distributed Systems

Xiaohui Zou

DOI: https://doi.org/10.1109/tmee.2011.6199258

2011-01-01

Abstract:In this paper, we designed Parallel C Language, a kind of parallel programming Language, to implement parallel computing in distributed systems. It is to add some special identification statements on ANSI C Language. The parallel computing is based on C/S mode, incorporating multithread and RPC(remote procedure call). Multithread is used to cut tasks and concurrent the subtasks, and RPC is used to deploy and execute the subtasks on remote server nodes. The allocation of remote server nodes is dependent on load balancing mechanism. We also implemented the Pre-compiler of this Parallel C Language program, which parses the Parallel C Language program into several RPC application files. The other RPC application files are constructed by RPCGEN. The result of test shows that using this Parallel C Language to program in distributed systems reduces the codes size and makes full use of the system resources and improves efficiency.
Distributed Parallel Optimization Computation Environment Based on Matlab

张帆,邵之江,仲卫涛,钱积新

DOI: https://doi.org/10.3969/j.issn.1004-731x.2002.09.009

2002-01-01

Abstract:A distributed parallel optimization computation environment based on matlab is proposed. After details of parallel computation environment are discussed, the architecture of distributed parallel optimization computation environment is analyzed. Then four kinds of parallel functions are discussed, which include functions of initialization, sending and receiving data, computation, sending and integrating results. A parallel SQP is implemented using these four kinds of functions. Pseudo codes demonstrate the efficiency of this implement.
A Parallel Programming Environment with Domain Components for Cluster Computing

HS Yu,ZQ Xu,Y Liang,WK Ding

DOI: https://doi.org/10.1109/pdcat.2003.1236411

2003-01-01

Abstract:Due to the increased complexity of applications, the distributed hierarchy architecture of clusters and the deficiency of efficient compiling strategies, developing efficient applications for large-scale scientific and engineering computing on clusters is difficult. Our strategy to address this problem is to extend a generic data-parallel programming environment with an extensible component library. A component is a reusable routine that can be called by an alias in applications to perform some specific computation. All algorithmic and programming complexity as well as the specialized knowledge required to implement and optimize the computation are encapsulated in the routine. The alias is provided to the programming model as an extended operator for end users to develop new applications. Programmers use data-parallel construct and high-level operators to specify applications and its parallelism, and rely on sophisticated implementations of these programming systems to ensure that applications achieve high performance.
A Two-Level Parallel Decomposition Approach for Transient Stability Constrained Optimal Power Flow

Guangchao Geng,Quanyuan Jiang

DOI: https://doi.org/10.1109/naps.2013.6666908

IF: 7.326

2012-01-01

IEEE Transactions on Power Systems

Abstract:Transient stability constrained optimal power flow (TSCOPF) is one the most computational-intensive applications in power systems. Research efforts were made to utilize high performance computing (HPC) technology to parallelize and accelerate TSCOPF solving process, but challenges still exist in performance analysis to identify bottlenecks and improve efficiency on practical HPC platforms such as Beowulf clusters. Based on first two authors' previous work [8, 12] - two-level parallel TSCOPF with reduced-space interior point method (RIPM), a systematic performance analysis approach is demonstrated in this paper. Comprehensive performance analysis procedures - wall time analysis, MPI/OpenMP profiling and tracing - is employed in order to discover performance bottlenecks. State-of-the-art performance analysis software are employed to generate and visualize performance data, providing guidelines for parallel performance enhancement. Numerical results on a 2746-bus system show effectiveness of the proposed approach and relative low overhead in solving large-scale multi-contingency TSCOPF on a Beowulf cluster.
A Mechanism of Remote Sensing Image for Parallel Processing Base on Splitting Blocks

ZENG Zhi,LIU Ren-yi,LI Xian-tao,ZHANG Feng,BAO Wei-zheng

DOI: https://doi.org/10.3785/j.issn.1008-9497.2012.02.021

2012-01-01

Abstract:Large-scale parallel computing under cluster architecture is the basis of HPC(high performance computing).To enhance the efficiency of image processing for remote sensing depends on the application of technology of parallel computing.Towards the characteristic about the scarce quantity of objects on some images,this paper proposed an algorithm model for task allocating and image processing under distributed computing environment.Firstly,we split the area of image which contains the objects using quad-tree policy,and dispatched the data to computing node by using the idea on dynamic load balance to perform this computing.Experiment shows that the strategy on task allocation can improve the overall computing performance effectively.
Proceedings of SPDP '96: 8th IEEE Symposium on Parallel and Distributed Processing

Qingrui Xu,Bin Guo,Jin Chen

DOI: https://doi.org/10.1109/iemc.1996.547912

1996-01-01

Abstract:The following topics were dealt with: applications; networks and routing; distributed systems; scheduling and data mapping; parallel architectures; graph theory and networks; wormhole routing; scheduling; sorting and selection; synchronisation; I/O; scheduling and load balancing; database issues; parallel algorithms; languages and compilers; interconnection networks; and networks and embedding
Heterogeneous Cluster Application Communication Optimization and Computer Big Data Management

Hongyan Wang

DOI: https://doi.org/10.1155/2022/1106003

2022-08-06

Wireless Communications and Mobile Computing

Abstract:In order to adapt to the constantly updated heterogeneous hardware and super-large-scale parallel computing environment and solve the problems of low programming level and difficult development, modification, and debugging of commonly used solutions, the author proposes a method for application communication optimization and computer big data management based on heterogeneous clusters. A new language mechanism is introduced to describe the multidimensional rule structure, arrangement, and communication mode of data and threads; and a software migration and optimization method between different types of heterogeneous systems based on the new language mechanism is proposed. And take direct method turbulence simulation as an example. Experimental results show that based on the Parray mechanism, it took only one week to complete the rapid migration of turbulence simulation applications on the Tianhe 1A system, and it was successfully run on a scale of 8192 cubic meters. Conclusion. The method realizes communication optimization and fast porting in different heterogeneous systems.

computer science, information systems,telecommunications,engineering, electrical & electronic
AN PARALLEL AND DISTRIBUTED PROGRAMMING SOLUTION BASED ON HETEROGENEOUS GPU CLUSTER

LiJiajia,HuXinming,WuBaifeng

DOI: https://doi.org/10.3969/j.issn.1000-386x.2014.09.005

2014-01-01

Abstract:Duetoitscharacteristicsofsuperpowerfulcomputingcapability,high-speedmemoryaccessbandwidthandsupportinglarge-scale data-level parallel programming,GPUs have become the mainstream accelerators for supercomputers and high performance computing field.GPU-enhanced clusters are showed to be heterogeneous in both node layer and intra-node as the evolvement of the processing elements and the expansion of the cluster nodes,which greatly increases the complexity of GPU cluster programming.Mainstream heterogeneous GPU clusters mostly adopt the way of simple combination of the heterogeneous computing programming model for GPU and the distributed memory-oriented message passing model,such approach makes the GPU cluster programming lack of determinate criteria and often be inefficient and error-prone.In order to improve the efficiency of programming GPU cluster and to reduce programming complexity,as well as to realise the platform independence,we present a set of parallel and distributed programming solution for heterogeneous GPU cluster.The scheme presents the programming framework DISPAR through the use of the extended language method,and realises the preprocessor system StreamCC. Experiment proves its feasibility.
LINUX CLUSTER BASED POWER SYSTEM PARALLEL SIMULATION SYSTEM

HE Ben-teng

2004-01-01

Abstract:In the research of power system protective relayings, a lot of transient simulations are needed under various system models, operating situations and fault conditions. Because of the huge amount of calculation, the simulation often consumes plenty of time if it is operated by personal computer (PC). Here, a Linux cluster based parallel simulation system is developed. This parallel simulation software is on the basis of MPI parallel programming model, and in its cluster hardware system the network resource and the existing hardware resources for PC are used, so a higher calculation speed is realized by a lower cost. The results of calculation examples show that the calculation of the developed simulation system is greatly speeded up and the calculation time is reduced.
Design and Implementation of a User-interactiveParallel Programming

EnvironmentTzung-Shi Chen,Kuei-Ping Shih,Jang-Ping Sheu

1996-01-01

Abstract:A state-of-the-art parallel programming environment called UPPER (User-interactive Parallel Programming EnviRonment) is presented in this paper. Parallel machines which execute programs concurrently on hundreds or thousands of processors provide far more computational power than does a uniprocessor. However, designing parallel programs on parallel machines manually is very di cult and error-prone. Due to these problems, many tools which help programmers translate sequential programs into parallelized programs or even help them design parallel programs have been developed. The proposed environment also has the same purpose. The major components of this environment include a parallelizing compiler system and simulators of the given target machines. The parallelizing compiler system introduces new and existing techniques for compiler-time analysis, and the simulator can simulate execution of the translated parallelized program on the target machine and show the simulated performance reports. This integrated environment attempts to provide convenience for users or programmers who can easily design or write their desirable parallel programs based on a variety of assertions and information generated by this environment. Using our environment, programmers can avoid the necessity of designing parallel programs and can obtain e cient parallelized programs from sequential programs easily.
Parallel and Distributed Simulation Based on Networks

郭彤城,慕春棣

DOI: https://doi.org/10.3969/j.issn.1004-731x.2002.05.018

2002-01-01

Abstract:With the emergence of high-performance networks and low-cost clusters, it is more possible to employ parallel and distributed simulation widely. First, the characters of various parallel computers are summarized; the concepts of parallel simulations and distributed simulations are identified. Then the strategies of parallel simulations for continuous systems and discrete event systems are generalized. The merits and defects of them are analyzed, the optimizations of them concerning clusters are proposed as well. At last, the various integrated infrastructures of distributed applications are compared in detail, a conclusion is drawn that CORBA is suitable for simulations in small or medium dimension systems.
Parallel Computing for Water Quality Equation Based on Jppf

Longfang Zhao,Dibo Hou,Pingjie Huang,Xiaoxuan Song,Lin Xu,Guangxin Zhang

DOI: https://doi.org/10.4028/www.scientific.net/amm.295-298.2061

2013-01-01

Applied Mechanics and Materials

Abstract:In order to meet the requirement to quickly solve the water quality equation for an unexpected water pollution incident, this dissertation, based on the paralleled algorithm under Java Parallel Processing Framework (JPPF), does research about the process to dynamically decomposes the iterative process into calculation tasks and distribute the tasks by the API of JPPF to the paralleled nodes for calculation. And the simulation result of one-dimension water quality equation shows that parallel computing method could reduce the time complexity from to , not only resulting in a significant improvement in calculation speed, but in a higher reliability and stability.
Communication performance analyze in large scale parallel program

Yan Zhai,Jidong Zhai,Wei Xue,Zhiyan Jin

DOI: https://doi.org/10.13245/j.hust.2011.s1.023

2011-01-01

Abstract:To better understand the programs' performance characters and help develop process, 4 programs from SPECMPI benchmark, as well as the weather reporting application, GRAPES, developed by China, were selected for analyzing at the layer of message passing interface (MPI). Performance data was gathered and analyzed on different platforms. Further, process mapping technique was also applied to optimize the communication. The result shows that profiling method is available for large scale parallel programs, which helps to locate and optimize their performance problem. On the other hand, process mapping works well on Ethernet of low performance, but works badly on Infiniband of high performance, which means that the platform characters are also important when optimize the parallel programs.
Evaluation and Analysis of Distributed Graph-Parallel Processing Frameworks

Yue Zhao,Kenji Yoshigoe,Mengjun Xie,Suijian Zhou,Remzi Seker,Jiang Bian

DOI: https://doi.org/10.13052/jcsm2245-1439.333

2014-01-01

Journal of Cyber Security and Mobility

Abstract:A number of graph-parallel processing frameworks have been proposed to address the needs of processing complex and large-scale graph structured datasets in recent years.Although significant performance improvement made by those frameworks were reported, comparative advantages of each of these frameworks over the others have not been fully studied, which impedes the best utilization of those frameworks for a specific graph computing task and setting.In this work, we conducted a comparison study on parallel processing systems for large-scale graph computations in a systematic manner, aiming to reveal the characteristics of those systems in performing common graph algorithms with real-world datasets on the same ground.We selected three popular graph-parallel processing frameworks (Giraph, GPS and GraphLab) for the study and also include a representative general data-parallel computing system-Spark-in the comparison in order to understand how well a general data-parallel system can run graph problems.We applied basic performance
Performance evaluation of view-oriented parallel programming on cluster of computers

Haifeng Shang,Jiaqi Zhang,Wenguang Chen,Weimin Zheng,Zhiyi Huang

DOI: https://doi.org/10.1007/978-3-540-75444-2_17

2007-01-01

Abstract:View-Oriented Parallel Programming(VOPP) is a novel programming style based on Distributed Shared Memory, which is friendly and easy for programmers to use. In this paper we compare VOPP with two other systems for parallel programming on clusters: LAM/MPI, a message passing system, and TreadMarks, a software distributed shared memory system. We present results for ten applications implemented and optimized using all the three systems. Experimental results demonstrate that VOPP is almost as efficient as Message Passing Interface when running on up to 32 processors, which means there is significant performance improvement compared with TreadMarks. The factors contributing to the performance of VOPP are discussed and analyzed. VOPP is still slower than MPI when the number of processes is large because of extra messages for separate synchronization and lack of bulk transfer mechanisms.
Jcluster: an Efficient Java Parallel Environment on a Large-Scale Heterogeneous Cluster.

Bao-Yin Zhang,Guang-Wen Yang,Wei-Min Zheng

DOI: https://doi.org/10.1002/cpe.986

2006-01-01

Abstract:In this paper, we present Jcluster, an efficient Java parallel environment that provides some critical services, in particular automatic load balancing and high-performance communication, for developing parallel applications in Java on a large-scale heterogeneous cluster. In the Jcluster environment, we implement a task scheduler based on a transitive random stealing (TRS) algorithm. Performance evaluations show that the scheduler based on TRS can make any idle node obtain a task from another node with much fewer stealing times than random stealing (RS), which is a well-known dynamic load-balancing algorithm, on a large-scale cluster. In the performance aspects of communication, with the method of asynchronously multithreaded transmission, we implement a high-performance PVM-like and MPI-like message-passing interface in pure Java. The evaluation of the communication performance is conducted among the Jcluster environment, LAM-MPI and mpiJava on LAM-MPI based on the Java Grande Forum's pingpong benchmark. Copyright © 2005 John Wiley & Sons, Ltd.
On Communication Patterns of Parallel Objects

YQ GAO,CK YUEN,DX WANG,WM ZHENG,MM SHEN

DOI: https://doi.org/10.1109/tencon.1993.320098

1993-01-01

Abstract:Object-oriented programming is proving to be quite useful in many areas which have not been served well by more conventional approaches. Object-oriented systems show great potential for exploiting concurrence/parallelism. But many object-oriented languages currently in use are sequential. How to implement object-oriented languages on parallel systems is still a promising research topic. A parallel object-oriented system is a single-user system which is implemented on multi-processors. Objects can be active concurrently in one processor or do things on different processors in parallel. There are two communication patterns: synchronous and asynchronous communication. We put emphasis on communication patterns of parallel objects. We also discuss several ways to achieve performance in object-oriented languages and how to implement communication patterns on transputer-based multicomputer systems.<>
Programming Framework for Node Heterogeneous GPU Cluster

Chongchong SHENG,Xinming HU,Jiajia LI,Baifeng WU

DOI: https://doi.org/10.3969/j.issn.1000-3428.2015.02.056

2015-01-01

Abstract:The mainly used programming method for heterogeneous GPU cluster is hybrid MPI/CUDA or its simple deformation. However,because of its transparency to underlying architecture when using hybrid MPI/CUDA to write code for heterogeneous GPU cluster,programmers tend to need detailed knowledge of the hardware resources,which makes the program more complicated and less portable. This paper presents Distributed Parallel Programming Framework ( DISPAR) , a new programming framework for node-level heterogeneous GPU cluster based on data flow model. DISPAR framework contains two sub-systems, StreamCC and StreamMAP. StreamCC is a code conversion tool which coverts DISPAR code into hybrid MPI/CUDA code. StreamMAP is a run-time system which can detect heterogeneous computing resources and map the tasks to appropriate computing units automatically. Experimental results show that the methods can make efficient use of the computing resources and simplify the programming on heterogeneous GPU cluster. Besides,it has better portability and scalability as the code does not rely on the execution platform.

Research on Environment of Parallel Programming

A parallel computing method for irregular work

Parallel Computing Technology for Wide Area Power System Modeling

Design, Implementation of the Parallel C Language Based on C/S Mode in Distributed Systems

Distributed Parallel Optimization Computation Environment Based on Matlab

A Parallel Programming Environment with Domain Components for Cluster Computing

A Two-Level Parallel Decomposition Approach for Transient Stability Constrained Optimal Power Flow

A Mechanism of Remote Sensing Image for Parallel Processing Base on Splitting Blocks

Proceedings of SPDP '96: 8th IEEE Symposium on Parallel and Distributed Processing

Heterogeneous Cluster Application Communication Optimization and Computer Big Data Management

AN PARALLEL AND DISTRIBUTED PROGRAMMING SOLUTION BASED ON HETEROGENEOUS GPU CLUSTER

LINUX CLUSTER BASED POWER SYSTEM PARALLEL SIMULATION SYSTEM

Design and Implementation of a User-interactiveParallel Programming

Parallel and Distributed Simulation Based on Networks

Parallel Computing for Water Quality Equation Based on Jppf

Communication performance analyze in large scale parallel program

Evaluation and Analysis of Distributed Graph-Parallel Processing Frameworks

Performance evaluation of view-oriented parallel programming on cluster of computers

Jcluster: an Efficient Java Parallel Environment on a Large-Scale Heterogeneous Cluster.

On Communication Patterns of Parallel Objects

Programming Framework for Node Heterogeneous GPU Cluster