Abstract:High Performance Computing (HPC) aims at providing reasonably fast computing solutions to scientific and real life problems. The advent of multicore architectures is noticeable in the HPC history, because it has brought the underlying parallel programming concept into common considerations. At a larger scale, there is a keen interest in building or hosting frontline supercomputers; the Top500 ranking is a nice illustration of this (implicit) racing. Supercomputers, as well as ordinary computers, have fallen in price for years while gaining processing power. We clearly see that, what commonly springs up in mind when it comes to HPC is computer capability. However, when going deeper into the topic, especially on large-scale problems, it appears that the processing speed by itself is no longer sufficient. Indeed, the real concern of HPC users is the time-to-output. Thus, we need to study each important aspect in the critical path between inputs and outputs. The first step is clearly the method, which is a conjunction of modelling with specific considerations (hypothesis, simplifications, constraints, to name a few) and a corresponding algorithm, which could be numerical and/or non numerical. Then comes the topic of programming, which should yield a skillful mapping of the algorithm onto HPC machines. Based on multicore processors, probably enhanced with acceleration units, current generation of supercomputers is rated to deliver an increasing peak performance, the Exascale era being the current horizon. However, getting a high fraction of the available peak performance is more and more difficult. The Design of an efficient code that scales well on a supercomputer is a non-trivial task. The present note will discuss the aforementioned points, interleaved with commented contributions from the literature and our personal views.

Scalable Systems and Software Architectures for High-Performance Computing on cloud platforms

Challenges in High-Performance Computing

Reinventing High Performance Computing: Challenges and Opportunities

About the Suitability of Clouds in High-Performance Computing

HPC Cloud for Scientific and Business Applications: Taxonomy, Vision, and Research Challenges

Understanding the Determinants and Future Challenges of Cloud Computing Adoption for High Performance Computing

Designing Parallel Operation for High-Performance Cloud Computing Using Partition Algorithm

High-Performance Cloud Computing: A View of Scientific Applications

High Performance and Security in Cloud Computing

PerHPC: Design and Implement Personal High Performance Computing Platform Using Cloud Computing Technology

10 Years Later: Cloud Computing is Closing the Performance Gap

Providing Scalable Database Services On The Cloud

Exploring Cloud Computing for Large-Scale Scientific Applications

Edge, Fog, and Cloud Against Disease: The Potential of High-Performance Cloud Computing for Pharma Drug Discovery

Building Castles in the Cloud: Architecting Resilient and Scalable Infrastructure

Conceptual and Technical Challenges for High Performance Computing

High-performance computing: Transitioning from Instruction-Level Parallelism to heterogeneous hybrid architectures

Cloud Versus In-House Cluster

HPC Alongside User-space Kubernetes

Performance on HPC Platforms Is Possible Without C++

Emerging High-Performance Computing Systems and Technology