Abstract:Numerical weather forecast is a most efficient means to reduce the effects of unexpected weather events. With the increasing prediction precision and the time-critical requirement, technologies of high performance computing have been improved much. However, I/O has become a significant performance bottleneck when scaling up to thousands of processes. In this paper we analyze the I/O access patterns of GRAPES (Global/Regional Assimilation and Prediction System) for numerical weather prediction system as a case of regular multi-dimensional data access. And we implement two parallel I/O strategies based on MPI-IO and ADIOS (Adaptive I/O System), making full use of efficient synchronous I/O schemes. For ADIOS, the "MPLAMR" method is employed to improve the parallel output bandwidth, which uses aggregator processes to execute I/O operations and write to one subfile on one OST for each aggregators, reducing I/O conflicts. Experiments show that the two optimizations outperform the original sequential I/O access, achieving very impressive improvements on Tianhe-1A system and Subway Bluelight system in China. The I/O cost based on ADIOS only accounts for no more than 9% scaling up to 2K processes on Tianhe-1A system, while the sequential I/O costs more than 50% of total time when scaling to 1K or more processes. It is also found that the aggregate output based on ADIOS achieves better output performance improvements, whose peak reaches 3.84 GB/s with one time-step output on Tianhe-1A system. On the contrary, MPI-IO has obtained good input performance improvements, whose peak reaches 4.55 GB/s.We use the GRAPES's I/O component as a benchmark to make a further study on I/O performance using ADIOS. From the rules found, we can design an efficient scheme of using "MPLAMR" for ADIOS on Tianhe-1A system. We take 15-km horizontal resolution for instance. Since the maximum number of OSTs available for our test on Tianhe-1A system is no more than 80,32 or 64 OSTs are chosen to facilitate parallel I/O. Then the number of aggregators should be set as 64 or 128. The optimal data size of 114 MB on one OST on Tianhe-1A system can be tested by simple cases. If we use 32 OSTs with 1024 processes, then 4 time-step aggregation can be calculated out, which obtains optimal I/O performance under such number of OSTs. It is true of the situation of 64 OSTs used. Hence, time-step aggregation is useful for output optimization based on "MPLAMR", whose peak reaches 7.69 GB/s on 2K processes with 64 OSTs and 128 aggregators if 8 time-step aggregation is used.We also examine the performance effects of data layout in the Lustre file system based on MPI-IO, which implies that data distribution on more OSTs outperforms a limited number of OSTs used, while the I/O performance is more likely to be disturbed with data distributed on most of all the OSTs. This influence is more apparent based on MPI-IO compared with ADIOS. (C) 2014 Elsevier B.V. All rights reserved.

accelerating wrf i/o performance with adios2 and network-based streaming

High Performance Parallel I/O and In-Situ Analysis in the WRF Model with ADIOS2

Streaming Data in HPC Workflows Using ADIOS

A Case Study of Large-Scale Parallel I/O Analysis and Optimization for Numerical Weather Prediction System.

Parallel I/O Optimization for High Resolution Ocean Model LICOM2

Swmpas-A: Scaling MPAS-A to 39 Million Heterogeneous Cores on the New Generation Sunway Supercomputer

Optimizing the Weather Research and Forecasting Model with OpenMP Offload and Codee

S4: an O2r/R2o Infrastructure for Optimizing Satellite Data Utilization in Noaa Numerical Modeling Systems A Step Toward Bridging the Gap Between Research and Operations

AutoWM: a Novel Domain-Specific Tool for Universal Multi-/Many-core Accelerations of the WRF Cloud Microphysics

WRF-PDAF v1.0: implementation and application of an online localized ensemble data assimilation framework

CFIO: A Fast I/O Library for Climate Models

A Data Optimizer for Region-Aware Self-describing Files in Scientific Computing

Understanding the Impact of Synchronous, Asynchronous, and Hybrid In-Situ Techniques in Computational Fluid Dynamics Applications

A Fast Input/Output Library for High-Resolution Climate Models

DAOS as HPC Storage, a view from Numerical Weather Prediction

Improving the Scalability of a Hurricane Forecast System in Mixed-Parallel Environments

HDF5 in the exascale era: Delivering efficient and scalable parallel I/O for exascale applications

AMRIC: A Novel In Situ Lossy Compression Framework for Efficient I/O in Adaptive Mesh Refinement Applications

NO2: Speeding Up Parallel Processing of Massive Compute-Intensive Tasks

Towards In-transit Analysis on Supercomputing Environments

Insights for exascale IO APIs from building a petascale IO API