Data and Codes of Characterizing Uncertainties of Earth System Modeling with Heterogeneous Many-core Architecture Computing

Yangyang Yu,Shaoqing Zhang,Haohuan Fu,Lei Wu,Dexun Chen,Yang Gao,Zhiqiang Wei,Dongning Jia,Xiaopei Lin

DOI: https://doi.org/10.5281/zenodo.6481867

2022-01-01

Abstract:These are the supporting information to verify the results in the paper, including input data, model outputs, the postprocessing scripts and the source codes.

What problem does this paper attempt to address?

Characterizing uncertainties of Earth system modeling with heterogeneous many-core architecture computing

Yangyang Yu,Shaoqing Zhang,Haohuan Fu,Lixin Wu,Dexun Chen,Yang Gao,Zhiqiang Wei,Dongning Jia,Xiaopei Lin

DOI: https://doi.org/10.5194/gmd-15-6695-2022

IF: 5.1

2022-09-06

Geoscientific Model Development

Abstract:The physical and heat limits of semiconductor technology require the adaptation of heterogeneous architectures in supercomputers, such as graphics processing units (GPUs) with many-core accelerators and many-core processors with management and computing cores, to maintain a continuous increase in computing performance. The transition from homogeneous multi-core architectures to heterogeneous many-core architectures can produce non-bit-for-bit reproducibility that leads to numerical perturbations and uncertainties in simulation results, which could blend with errors due to coding bugs. The development of a methodology to identify computational perturbations and secure model correctness is a critically important step in model development on computer systems with new architectures. Thus, we have developed a methodology to characterize the uncertainties in the heterogeneous many-core computing environment. This methodology contains a simple multi-column atmospheric model consisting of typical discontinuous physical parameterizations defined by the selection programming structure, an efficient ensemble-based test approach, and an application to the GPU-based high-performance computing (HPC) and Sunway systems. Statistical distributions from ensembles of the heterogeneous systems show quantitative analyses of computational perturbations and acceptable error tolerances. The methodology aims to enable one to fully distinguish between perturbations caused by platforms and discrepancies caused by software bugs, and it provides encouraging references for verifying the reliability of supercomputing platforms and discussing the sensibility of Earth system modeling to the adaptation of new heterogeneous many-core architectures.

geosciences, multidisciplinary
Toward Earth system modeling with resolved clouds and ocean submesoscales on heterogeneous many-core HPCs

Shaoqing Zhang,Shiming Xu,Haohuan Fu,Lixin Wu,Zhao Liu,Yang Gao,Chun Zhao,Wubing Wan,Lingfeng Wan,Haitian Lu,Chenling Li,Yanfei Liu,Xiaojing Lv,Jiayu Xie,Yangyang Yu,Jun Gu,Xuantong Wang,Yan Zhang,Chenhui Ning,Yunlong Fei,Xiuwen Guo,Zhaoying Wang,Xue Wang,Zhenming Wang,Binglin Qu,Mingkui Li,Haoran Zhao,Yingjing Jiang,Guang Yang,Lv Lu,Hong Wang,Hong An,Xin Zhang,Yu Zhang,Wentao Ma,Fujiang Yu,Jing Xu,Xiaopei Lin,Xueshun Shen

DOI: https://doi.org/10.1093/nsr/nwad069

IF: 20.6

2023-03-20

National Science Review

Abstract:ABSTRACT With the aid of the newly developed ‘Sunway’ heterogeneous-architecture supercomputer, which has world-leading HPC (high-performance computer) capability, a series of high-resolution coupled Earth system models (SW-HRESMs) with up to 5 km of atmosphere and 3 km of ocean have been developed. These models can meet the needs of multiscale interaction studies with different computational costs. Here we describe the progress of SW-HRESMs development, with an overview of the major advancements made by the international Earth science community in HR-ESMs. We also show the preliminary results of SW-HRESMs with regard to capturing major weather-climate extremes in the atmosphere and ocean, stressing the importance of permitted clouds and ocean submesoscale eddies in modeling tropical cyclones and eddy-mean flow interactions, and paving the way for further model development to resolve finer scales with even higher resolution and more realistic physics. Finally, in addition to increasing model resolution, the development procedure for a non-hydrostatic cloud and ocean submesoscale resolved ESM is discussed, laying out the major scientific directions of such a huge modeling advancement.

multidisciplinary sciences
Kilometer-Level Coupled Modeling Using 40 Million Cores: An Eight-Year Journey of Model Development

Xiaohui Duan,Yuxuan Li,Zhao Liu,Bin Yang,Juepeng Zheng,Haohuan Fu,Shaoqing Zhang,Shiming Xu,Yang Gao,Wei Xue,Di Wei,Xiaojing Lv,Lifeng Yan,Haopeng Huang,Haitian Lu,Lingfeng Wan,Haoran Lin,Qixin Chang,Chenlin Li,Quanjie He,Zeyu Song,Xuantong Wang,Yangyang Yu,Xilong Fan,Zhaopeng Qu,Yankun Xu,Xiuwen Guo,Yunlong Fei,Zhaoying Wang,Mingkui Li,Yingjing Jiang,Lv Lu,Liang Su,Jiayu Fu,Peinan Yu,Weiguo Liu,Lixin Wu,Lanning Wang,Xin Liu,Dexun Chen,Guangwen Yang

2024-04-16

Abstract:With current and future leading systems adopting heterogeneous architectures, adapting existing models for heterogeneous supercomputers is of urgent need for improving model resolution and reducing modeling uncertainty. This paper presents our three-week effort on porting a complex earth system model, CESM 2.2, to a 40-million-core Sunway supercomputer. Taking a non-intrusive approach that tries to minimizes manual code modifications, our project tries to achieve both improvement of performance and consistency of the model code. By using a hierarchical grid system and an OpenMP-based offloading toolkit, our porting and parallelization effort covers over 80% of the code, and achieves a simulation speed of 340 SDPD (simulated days per day) for 5-km atmosphere, 265 SDPD for 3-km ocean, and 222 SDPD for a coupled model, thus making multi-year or even multi-decadal experiments at such high resolution possible.

Distributed, Parallel, and Cluster Computing
Optimizing high-resolution Community Earth System Model on a heterogeneous many-core supercomputing platform

Shaoqing Zhang,Haohuan Fu,Lixin Wu,Yuxuan Li,Hong Wang,Yunhui Zeng,Xiaohui Duan,Wubing Wan,Li Wang,Yuan Zhuang,Hongsong Meng,Kai Xu,Ping Xu,Lin Gan,Zhao Liu,Sihai Wu,Yuhu Chen,Haining Yu,Shupeng Shi,Lanning Wang,Shiming Xu,Wei Xue,Weiguo Liu,Qiang Guo,Jie Zhang,Guanghui Zhu,Yang Tu,Jim Edwards,Allison Baker,Jianlin Yong,Man Yuan,Yangyang Yu,Qiuying Zhang,Zedong Liu,Mingkui Li,Dongning Jia,Guangwen Yang,Zhiqiang Wei,Jingshan Pan,Ping Chang,Gokhan Danabasoglu,Stephen Yeager,Nan Rosenbloom,Ying Guo

DOI: https://doi.org/10.5194/gmd-13-4809-2020

IF: 5.1

2020-10-08

Geoscientific Model Development

Abstract:Abstract. With semiconductor technology gradually approaching its physical and thermal limits, recent supercomputers have adopted major architectural changes to continue increasing the performance through more power-efficient heterogeneous many-core systems. Examples include Sunway TaihuLight that has four management processing elements (MPEs) and 256 computing processing elements (CPEs) inside one processor and Summit that has two central processing units (CPUs) and six graphics processing units (GPUs) inside one node. Meanwhile, current high-resolution Earth system models that desperately require more computing power generally consist of millions of lines of legacy code developed for traditional homogeneous multicore processors and cannot automatically benefit from the advancement of supercomputer hardware. As a result, refactoring and optimizing the legacy models for new architectures become key challenges along the road of taking advantage of greener and faster supercomputers, providing better support for the global climate research community and contributing to the long-lasting societal task of addressing long-term climate change. This article reports the efforts of a large group in the International Laboratory for High-Resolution Earth System Prediction (iHESP) that was established by the cooperation of Qingdao Pilot National Laboratory for Marine Science and Technology (QNLM), Texas A&M University (TAMU), and the National Center for Atmospheric Research (NCAR), with the goal of enabling highly efficient simulations of the high-resolution (25 km atmosphere and 10 km ocean) Community Earth System Model (CESM-HR) on Sunway TaihuLight. The refactoring and optimizing efforts have improved the simulation speed of CESM-HR from 1 SYPD (simulation years per day) to 3.4 SYPD (with output disabled) and supported several hundred years of pre-industrial control simulations. With further strategies on deeper refactoring and optimizing for remaining computing hotspots, as well as redesigning architecture-oriented algorithms, we expect an equivalent or even better efficiency to be gained on the new platform than traditional homogeneous CPU platforms. The refactoring and optimizing processes detailed in this paper on the Sunway system should have implications for similar efforts on other heterogeneous many-core systems such as GPU-based high-performance computing (HPC) systems.

geosciences, multidisciplinary
A Deep Learning-Based Consistency Test Approach for Earth System Models on Heterogeneous Many-Core Systems

Yangyang Yu,Shaoqing Zhang,Haohuan Fu,Dexun Chen,Yang Gao,Xiaopei Lin,Zhao Liu,Xiaojing Lv

DOI: https://doi.org/10.5194/gmd-2024-10

2024-01-01

Abstract:Abstract. Physical and heat limits of the semiconductor technology require the adaptation of heterogeneous architectures in supercomputers to maintain a continuous increase of computing performance. The coexistence of general-purpose cores and accelerator cores, which usually employ different hardware architectures, can lead to bit-level differences, especially when we try to maximize the performance on both kinds of cores. Such differences further lead to unavoidable computational perturbations through temporal integration, which can blend with software or human errors. Software correctness verification in the form of quality assurance is a critically important step in the development and optimization of Earth system models (ESMs) on heterogeneous many-core systems with mixed perturbations of software changes and hardware updates. We have developed a deep learning-based consistency test approach for Earth System Models referred to as ESM-DCT. The ESM-DCT is based on the unsupervised bidirectional gate recurrent unit-autoencoder (BGRU-AE) model, which can still detect the existence of software or human errors when taking hardware-related perturbations into account. We use the Community Earth System Model (CESM) on the new Sunway system as an example of large-scale ESMs to evaluate the ESM-DCT. The results show that facing with the mixed perturbations caused by hardware designs and software changes in heterogeneous computing, the ESM-DCT can detect software or human errors when determining whether or not the model simulation is consistent with the original results in homogeneous computing. Our ESM-DCT tool provides an efficient and objective approach for verifying the reliability of the development and optimization of scientific computing models on the heterogeneous many-core systems.
A Numerical Model Oriented Large-scale Parallel I/O Optimization Method.

Lei Zhang,Tao Wu,Zheng Zhou,Dong Wang,Xi Chen

DOI: https://doi.org/10.1109/DSDE58527.2023.00015

2023-01-01

Abstract:Numerical models usually contain a large number of data reading and writing, which generally takes a long time. At present, massively parallel technology has accelerated the speed of computing in model, but due to the limitation of computer I/O ability, the acceleration effect is limited, and there is a serious load imbalance during the model operation process, resulting in a waste of computing resources. To deal with that, this paper proposes a new I/O scheme, which can dynamically optimize task allocation during program operation, make full use of computing resources, and increase the mutual coverage of computing and I/O processes, so as to effectively shorten the model running time. Finally, the test in the earth simulator shows that the new I/O scheme improves the operation speed of the regional high-precision air pollution model by 25.45%.
69.7-Pflops Extreme Scale Earthquake Simulation with Crossing Multi-faults and Topography on Sunway

Wubing Wan,Lin Gan,Wenqiang Wang,Zekun Yin,Haodong Tian,Zhenguo Zhang,Yinuo Wang,Mengyuan Hua,Xiaohui Liu,Shengye Xiang,Zhongqiu He,Zijia Wang,Ping Gao,Xiaohui Duan,Weiguo Liu,Wei Xue,Haohuan Fu,Guangwen Yang,Xiaofei Chen,Zeyu Song,Yaojian Chen,Xin Liu,Wei Zhang

DOI: https://doi.org/10.1145/3581784.3613209

2023-01-01

Abstract:A high-scalable and fully optimized earthquake model is presented based on the latest Sunway supercomputer. Contributions include: 1) the curvilinear grid finite-difference method (CGFDM) and flexible model applying perfectly matched layer (PML) and enabling more accurate and realistic terrain descriptions; 2) a hybrid and non-uniform domain decomposition scheme that efficiently maps the model across different levels of the computing system; and 3) sophisticated optimizations that largely alleviate or even eliminate bottlenecks in memory, communication, etc. , obtaining a speedup of over 140×. Combining all innovations, the design fully exploits the hardware potential of all aspects and enables us to perform the largest CGFDM-based earthquake simulation ever reported (69.7 PFlops using over 39 million cores). Based on our design, the Turkey earthquakes (February 6, 2023), and the Ridgecrest earthquake (July 4, 2019), are successfully simulated with a maximum resolution of 12-m. Precise hazard evaluations for the hazardous reduction of earthquake-stricken areas are also conducted.
Dataset for the Paper Entitled "implications of Uncertainty in Technology Cost Projections for Least-Cost Decarbonized Electricity Systems"

Lei Duan,Caldeira

DOI: https://doi.org/10.5281/zenodo.10116066

2023-01-01

Abstract:This dataset contains model codes, post-process scripts, and model output data used to support findings in the paper entitled "Implications of Uncertainty in Technology Cost Projections for Least-Cost Decarbonized Electricity Systems". Please contact Lei Duan (leiduan@carnegiescience.edu) for any questions.
Performance Modeling, Optimization, and Characterization on Heterogeneous Architectures

Lokendra S. Panwar

2014-10-21

Abstract:(ABSTRACT) Today, heterogeneous computing has truly reshaped the way scientists think and approach high-performance computing (HPC). Hardware accelerators such as general-purpose graphics processing units (GPUs) and Intel Many Integrated Core (MIC) architecture continue to make inroads in accelerating large-scale scientific applications. These advancements, however, introduce new sets of challenges to the scientific community such as: selection of best processor for an application, effective performance optimization strategies, maintaining performance portability across architectures etc. In this thesis, we present our techniques and approach to address some of these significant issues. Firstly, we present a fully automated approach to project the relative performance of an OpenCL program over different GPUs. Performance projections can be made within a small amount of time, and the projection overhead stays relatively constant with the input data size. As a result, the technique can help runtime tools make dynamic decisions about which GPU would run faster for a given kernel. Usage cases of this technique include scheduling or migrating GPU workloads over a heterogeneous cluster with different types of GPUs. We then present our approach to accelerate a seismology modeling application that is based on the finite difference method (FDM), using MPI and CUDA over a hybrid CPU+GPU cluster. We describe the generic computational complexities involved in porting such applications to the GPUs and present our strategy of efficient performance optimization and characterization. We also show how performance modeling can be used to reason and drive the hardware-specific optimizations on the GPU. The performance evaluation of our approach delivers a maximum speedup of 23-fold with a single GPU and 33-fold with dual GPUs per node over the serial version of the application, which in turn results in a many-fold speedup when coupled with the MPI distribution of the computation across the cluster. We also study the efficacy of GPU-integrated MPI, with MPI-ACC as an example implementation, on a seismology modeling application and discuss the lessons learned. Dedication I dedicate this thesis to my mom, dad, and sister. iii Acknowledgments I would like to express my heartfelt gratitude to my advisor Dr. Wu-chun Feng, foremost, for his invaluable guidance and support throughout my M.S. studies. His belief in his students and encouragement to think independently to develop solutions to the research problems made the overall research experience greatly rewarding. His diligent work-ethic and dynamic personality had been a wonderful source of inspiration to me. It has been a pleasure …

Computer Science,Engineering
Solving global shallow water equations on heterogeneous supercomputers

Haohuan Fu,Lin Gan,Chao Yang,Wei Xue,Lanning Wang,Xinliang Wang,Xiaomeng Huang,Guangwen Yang

DOI: https://doi.org/10.1371/journal.pone.0172583

IF: 3.7

2017-03-10

PLoS ONE

Abstract:The scientific demand for more accurate modeling of the climate system calls for more computing power to support higher resolutions, inclusion of more component models, more complicated physics schemes, and larger ensembles. As the recent improvements in computing power mostly come from the increasing number of nodes in a system and the integration of heterogeneous accelerators, how to scale the computing problems onto more nodes and various kinds of accelerators has become a challenge for the model development. This paper describes our efforts on developing a highly scalable framework for performing global atmospheric modeling on heterogeneous supercomputers equipped with various accelerators, such as GPU (Graphic Processing Unit), MIC (Many Integrated Core), and FPGA (Field Programmable Gate Arrays) cards. We propose a generalized partition scheme of the problem domain, so as to keep a balanced utilization of both CPU resources and accelerator resources. With optimizations on both computing and memory access patterns, we manage to achieve around 8 to 20 times speedup when comparing one hybrid GPU or MIC node with one CPU node with 12 cores. Using a customized FPGA-based data-flow engines, we see the potential to gain another 5 to 8 times improvement on performance. On heterogeneous supercomputers, such as Tianhe-1A and Tianhe-2, our framework is capable of achieving ideally linear scaling efficiency, and sustained double-precision performances of 581 Tflops on Tianhe-1A (using 3750 nodes) and 3.74 Pflops on Tianhe-2 (using 8644 nodes). Our study also provides an evaluation on the programming paradigm of various accelerator architectures (GPU, MIC, FPGA) for performing global atmospheric simulation, to form a picture about both the potential performance benefits and the programming efforts involved.
Characterising geotechnical model uncertainty by hybrid Markov Chain Monte Carlo simulation

J. Zhang,Wilson H. Tang,L.M. Zhang,H.W. Huang

DOI: https://doi.org/10.1016/j.compgeo.2012.02.002

IF: 5.218

2012-01-01

Computers and Geotechnics

Abstract:Geotechnical models are usually associated with considerable amounts of model uncertainty. In this study, the model uncertainty of a geotechnical model is characterised through a systematic comparison between model predictions and past performance data. During such a comparison, model input parameters (such as soil properties) may also be uncertain, and the observed performance may be subjected to measurement errors. To consider these uncertainties, the model uncertainty parameters, uncertain model input parameters and actual performance variables are modelled as random variables, and their distributions are updated simultaneously using Bayes’ theorem. When the number of variables to update is large, solving the Bayesian updating problem is computationally challenging. A hybrid Markov Chain Monte Carlo simulation is employed in this paper to decompose the high-dimensional Bayesian updating problem into a series of updating problems in lower dimensions. To increase the efficiency of the Markov chain, the model uncertainty is first characterised with a first order second moment method approximately, and the knowledge learned from the approximate solution is then used to design key parameters in the Markov chain. Two examples are used to illustrate the proposed methodology for model uncertainty characterisation, with insights, discussions, and comparison with previous methods.
Scientific data organization and management in numerical simulations

Chen Hong,Xia Fang,Song Lei,Zheng Weimin

DOI: https://doi.org/10.3321/j.issn:1671-4512.2005.z1.007

2005-01-01

Journal of Huazhong University of Science and Technology

Abstract:It is a crucial bottleneck of scientific computing performance to organize and manage the large scale scientific data in numerical simulations.Considering the complicated data characters such as multi-dimension,multivariable and time-space correlative,in this paper,a hierarchical data model for numerical computation is presented for scientific data organization so as to share and exchange data better between applications and platforms.By adding the data semantic information,flexible high-level application programming interfaces of accessing data are provided to facilitate ease of use for applications,like numerical computing,visualization and data analysis.The validity of the hierarchical data model for numerical computation is verified by some typical programs applying.Meanwhile,a scientific data management prototype system is designed,in which metadata technique is used for balancing efficiency and easyto-use through integrating high-performance file system and database.
Performance Modeling and Tuning for DFT Calculations on Heterogeneous Architectures

Hadia Ahmed,David B. Williams-Young,Khaled Z. Ibrahim,Chao Yang

DOI: https://doi.org/10.1109/ipdpsw52791.2021.00108

2021-01-01

Abstract:Tuning scientific code for heterogeneous computing architecture is a growing challenge. Not only do we need to tune the code to multiple architectures, but also we need to select or schedule computations to the most efficient compute variant. In this paper, we explore the tuning and performance modeling question of one of the most time computing kernels in density functional theory calculations on systems with a multicore host CPU accelerated with GPUs. We show the problem configuration dictates the choice of the most efficient compute engine. Such choice could alternate between the host and the accelerator, especially while scaling. As such, a performance model to predict the execution time on the host CPU and GPU is essential to select the compute environment and to achieve optimal performance. We present a simple model that empirically carry out such tasks and could accurately steer the scheduling of computation.
Mixed-precision arithmetic in the ENDGame dynamical core of the Unified Model, a numerical weather prediction and climate model code

C.M. Maynard,D.N. Walters

DOI: https://doi.org/10.1016/j.cpc.2019.07.002

IF: 4.717

2019-11-01

Computer Physics Communications

Abstract:<p>The Met Office's weather and climate simulation code the Unified Model is used for both operational Numerical Weather Prediction and Climate modelling. The computational performance of the model running on parallel supercomputers is a key consideration. A Krylov sub-space solver is employed to solve the equations of the dynamical core of the model, known as ENDGame. These describe the evolution of the Earth's atmosphere. Typically, 64-bit precision is used throughout weather and climate applications. This work presents a mixed-precision implementation of the solver, the beneficial effect on run-time and the impact on solver convergence. The complex interplay of errors arising from accumulated round-off in floating-point arithmetic and other numerical effects is discussed. A careful analysis is required. The mixed-precision solver is now employed in the operational forecast to satisfy run-time constraints without compromising the accuracy of the solution.</p>

physics, mathematical,computer science, interdisciplinary applications
Efficient Uncertainty Modeling for System Design via Mixed Integer Programming

Zichang He,Weilong Cui,Chunfeng Cui,Timothy Sherwood,Zheng Zhang

DOI: https://doi.org/10.1109/iccad45719.2019.8942139

2019-11-01

Abstract:The post-Moore era casts a shadow of uncertainty on many aspects of computer system design. Managing that uncertainty requires new algorithmic tools to make quantitative assessments. While prior uncertainty quantification methods, such as generalized polynomial chaos (gPC), show how to work precisely under the uncertainty inherent to physical devices, these approaches focus solely on variables from a continuous domain. However, as one moves up the system stack to the architecture level many parameters are constrained to a discrete (integer) domain. This paper proposes an efficient and accurate uncertainty modeling technique, named mixed generalized polynomial chaos (M-gPC), for architectural uncertainty analysis. The M-gPC technique extends the generalized polynomial chaos (gPC) theory originally developed in the uncertainty quantification community, such that it can efficiently handle the mixed-type (i.e., both continuous and discrete) uncertainties in computer architecture design. Specifically, we employ some stochastic basis functions to capture the architecture-level impact caused by uncertain parameters in a simulator. We also develop a novel mixed-integer programming method to select a small number of uncertain parameter samples for detailed simulations. With a few highly informative simulation samples, an accurate surrogate model is constructed in place of cycle-level simulators for various architectural uncertainty analysis. In the chip-multiprocessor (CMP) model, we are able to estimate the propagated uncertainties with only 95 samples whereas Monte Carlo requires 5×104 samples to achieve the similar accuracy. We also demonstrate the efficiency and effectiveness of our method on a detailed DRAM subsystem.
Challenges Towards Deploying Data Intensive Scientific Applications on Extreme Heterogeneity Supercomputers

Hang Liu,Yufei Ding,Da Zheng,Seung Woo Son,Da Yan

DOI: https://doi.org/10.48550/arXiv.1804.09738

2018-04-26

Abstract:Shrinking transistors, which powered the advancement of computing in the past half century, has stalled due to power wall; now extreme heterogeneity is promised to be the next driving force to feed the needs of ever-increasingly diverse scientific domains. To unlock the potentials of such supercomputers, we identify eight potential challenges in three categories: First, one needs fast data movement since extreme heterogeneity will inevitably complicate the communication circuits -- thus hampering the data movement. Second, we need to intelligently schedule suitable hardware for corresponding applications/stages. Third, we have to lower the programming complexity in order to encourage the adoption of heterogeneous computing.

Distributed, Parallel, and Cluster Computing
Research on General Data Format and I/O Interface for High Power Microwave Numerical Simulations

Chen Hong,Xia Fang,Shen Weichao,Song Lei

2011-01-01

Journal of Computer Research and Development

Abstract:Exchanging data among different numerical simulations and coupling multi-physical processes are fatal bottleneck problems in high power microwave simulation system.In allusion to typical data characteristics of multi-dimension and multi-variables numerical simulation programs,the relativity between time and space,and practical problems of data exchange and sharing,this paper brings forward a hierarchical data model for high power microwave simulation system to organize mesh data.We have developed JADLib,a unified I/O interface based on HDF5 for high-level data access,supporting scientific computing,visualization and other data analysis tools to store mesh data with a unified method.We apply them in implementation of typical programs.Performance results obtained from the actual program executions verified the validity of our data model,format and JADLib.
Understanding Data Movement in Tightly Coupled Heterogeneous Systems: A Case Study with the Grace Hopper Superchip

Luigi Fusco,Mikhail Khalilov,Marcin Chrapek,Giridhar Chukkapalli,Thomas Schulthess,Torsten Hoefler

2024-08-26

Abstract:Heterogeneous supercomputers have become the standard in HPC. GPUs in particular have dominated the accelerator landscape, offering unprecedented performance in parallel workloads and unlocking new possibilities in fields like AI and climate modeling. With many workloads becoming memory-bound, improving the communication latency and bandwidth within the system has become a main driver in the development of new architectures. The Grace Hopper Superchip (GH200) is a significant step in the direction of tightly coupled heterogeneous systems, in which all CPUs and GPUs share a unified address space and support transparent fine grained access to all main memory on the system. We characterize both intra- and inter-node memory operations on the Quad GH200 nodes of the new Swiss National Supercomputing Centre Alps supercomputer, and show the importance of careful memory placement on example workloads, highlighting tradeoffs and opportunities.

Distributed, Parallel, and Cluster Computing
Coupling Design and Validation Analysis of an Integrated Framework of Uncertainty Quantification

Bo Pang,Yuhang Su,Jie Wang,Chengcheng Deng,Qingyu Huang,Shuang Zhang,Bin Wu,Yuanfeng Lin

DOI: https://doi.org/10.3390/en16114435

IF: 3.2

2023-05-31

Energies

Abstract:The uncertainty quantification is an indispensable part for the validation of the nuclear safety best-estimate codes. However, the uncertainty quantification usually requires the combination of statistical analysis software and nuclear reactor professional codes, and it consumes huge computing resources. In this paper, a design method of coupling interface between DAKOTA Version 6.16 statistical software and nuclear reactor professional simulation codes is proposed, and the integrated computing workflow including interface pre-processing, code batching operations, and interface post-processing can be realized. On this basis, an integrated framework of uncertainty quantification is developed, which is characterized by visualization, convenience, and efficient computing. Meanwhile, a typical example of small-break LOCA analysis of the LOBI test facility was used to validate the reliability of the developed integrated framework of uncertainty quantification. This research work can provide valuable guidance for developing an autonomous uncertainty analysis platform in China.

energy & fuels
Multi-node Power/Performance Modeling for HPC System

Taeyang Jeong,Sangwoo Han,Eui-Young Chung

DOI: https://doi.org/10.1109/ITC-CSCC.2019.8793388

2019-06-01

Abstract:High Performance Computing (HPC) System refers to using a cluster of hundreds or more processing nodes for application which requires a lot of computation. The need for HPC systems has increased in recent years as more applications require a lot of computations such as Deep learning and AI. Various tools and techniques are being developed and researched to efficiently operate HPC systems in line with this need. In this paper, we develop multi-node power/performance modeling. This will help HPC system users to predict power and performance before they configure the system so that they can implement the optimal HPC system for programmers. Power and performance prediction modeling achieves 90% accuracy and takes less than an hour to predict.

Computer Science,Engineering

Data and Codes of Characterizing Uncertainties of Earth System Modeling with Heterogeneous Many-core Architecture Computing

Characterizing uncertainties of Earth system modeling with heterogeneous many-core architecture computing

Toward Earth system modeling with resolved clouds and ocean submesoscales on heterogeneous many-core HPCs

Kilometer-Level Coupled Modeling Using 40 Million Cores: An Eight-Year Journey of Model Development

Optimizing high-resolution Community Earth System Model on a heterogeneous many-core supercomputing platform

A Deep Learning-Based Consistency Test Approach for Earth System Models on Heterogeneous Many-Core Systems

A Numerical Model Oriented Large-scale Parallel I/O Optimization Method.

69.7-Pflops Extreme Scale Earthquake Simulation with Crossing Multi-faults and Topography on Sunway

Dataset for the Paper Entitled "implications of Uncertainty in Technology Cost Projections for Least-Cost Decarbonized Electricity Systems"

Performance Modeling, Optimization, and Characterization on Heterogeneous Architectures

Solving global shallow water equations on heterogeneous supercomputers

Characterising geotechnical model uncertainty by hybrid Markov Chain Monte Carlo simulation

Scientific data organization and management in numerical simulations

Performance Modeling and Tuning for DFT Calculations on Heterogeneous Architectures

Mixed-precision arithmetic in the ENDGame dynamical core of the Unified Model, a numerical weather prediction and climate model code

Efficient Uncertainty Modeling for System Design via Mixed Integer Programming

Challenges Towards Deploying Data Intensive Scientific Applications on Extreme Heterogeneity Supercomputers

Research on General Data Format and I/O Interface for High Power Microwave Numerical Simulations

Understanding Data Movement in Tightly Coupled Heterogeneous Systems: A Case Study with the Grace Hopper Superchip

Coupling Design and Validation Analysis of an Integrated Framework of Uncertainty Quantification

Multi-node Power/Performance Modeling for HPC System