Abstract:Supercomputing technology has been supporting the solution of cutting-edge scientific and complex engineering problems since its inception—serving as a comprehensive representation of the most advanced computer hardware and software technologies over a period of time. Over the course of nearly 80 years of development, supercomputing has progressed from being oriented towards computationally intensive tasks, to being oriented towards a hybrid of computationally and data-intensive tasks. Driven by the continuous development of high performance data analytics (HPDA) applications—such as big data, deep learning, and other intelligent tasks—supercomputing storage systems are facing challenges such as a sudden increase in data volume for computational processing tasks, increased and diversified computing power of supercomputing systems, and higher reliability and availability requirements. Based on this, data-intensive supercomputing, which is deeply integrated with data centers and smart computing centers, aims to solve the problems of complex data type optimization, mixed-load optimization, multi-protocol support, and interoperability on the storage system—thereby becoming the main protagonist of research and development today and for some time in the future. This paper first introduces key concepts in HPDA and data-intensive computing, and then illustrates the extent to which existing platforms support data-intensive applications by analyzing the most representative supercomputing platforms today (Fugaku, Summit, Sunway TaihuLight, and Tianhe 2A). This is followed by an illustration of the actual demand for data-intensive applications in today’s mainstream scientific and industrial communities from the perspectives of both scientific and commercial applications. Next, we provide an outlook on future trends and potential challenges data-intensive supercomputing is facing. In a word, this paper provides researchers and practitioners with a quick overview of the key concepts and developments in supercomputing, and captures the current and future data-intensive supercomputing research hotspots and key issues that need to be addressed.

Application software beyond exascale: challenges and possible trends

Moving from Exascale to Zettascale Computing: Challenges and Techniques.

Analysis and MPI Implementation of LQCD Dslash on Sunway TaihuLight*

Key Issues in Exascale Computing

Challenges and Reflections on Exascale Computing

The Sunway TaihuLight supercomputer: system and applications

A Vision of Post-Exascale Programming.

Full Lifecycle Data Analysis on a Large-scale and Leadership Supercomputer: What Can We Learn from It?

Challenges Towards Deploying Data Intensive Scientific Applications on Extreme Heterogeneity Supercomputers

Emerging High-Performance Computing Systems and Technology

Status, Challenges and Trends of Data-Intensive Supercomputing

Opportunities and Challenges for Next Generation Computing

A Survey of Compute Nodes with 100 TFLOPS and Beyond for Supercomputers

Keynote 4: can parallel software catch up with parallel hardware? Trends in automatic parallelization

China’s HPC Development in the Next 5 Years

Conceptual and Technical Challenges for High Performance Computing

Reinventing High Performance Computing: Challenges and Opportunities

Exascale Quantum Mechanical Simulations: Navigating the Shifting Sands of Hardware and Software

Extreme-scale Earthquake Simulations on Sunway TaihuLight

A Dataflow-Based Runtime Support on a 100P Actual System