Abstract:Many important computational problems require utilization of high performance computing (HPC) systems that consist of multi-level structures combining higher and higher numbers of devices with various characteristics. Utilizing full power of such systems requires programming parallel applications that are hybrid in two meanings: they can utilize parallelism on multiple levels at the same time and combine together programming interfaces specific for various types of computing devices. The main goal of parallel processing is increasing the processing performance, and therefore decreasing the application execution time. The international HPC community is targeting development of "Exascale" supercomputers (able to sustain $10^{18}$ floating point operations per second) by the year 2020. One of the main obstacles to achieving this goal is power consumption of the computing systems that exceeds the energy supply limits. New programming models and algorithms that consider this criterion are one of the key areas where significant progress is necessary in order to achieve the goal. The goal of the dissertation is to extract a general model of hybrid parallel application execution in heterogeneous HPC systems that is a synthesis of existing specific approaches and developing an optimization methodology for such execution aiming for minimization of the contradicting objectives of application execution time and power consumption of the utilized computing hardware. Both meanings of the application hybridity result in multiplicity of execution parameters of nontrivial interdependences and influence on the considered optimization criteria. Mapping of the application processes on computing devices has also a significant impact on these criteria.

Impact of parallel code optimization on computer power consumption

Power Profiling for Low Power Optimization Using New Computing Model

Hybrid Performance Modeling And Analyzing Of Parallel Systems

A survey on software methods to improve the energy efficiency of parallel computing

A Study of Performance Programming of CPU, GPU accelerated Computers and SIMD Architecture

Using meta-heuristics and machine learning for software optimization of parallel computing systems: a systematic literature review

ON PARALLEL PROGRAMMING AND OPTIMISATION FOR MULTI-CORE

Optimization of hybrid parallel application execution in heterogeneous high performance computing systems considering execution time and power consumption

On the Parallelization Optimization Strategy for High Performance Computing Software

Practical Strategies for Power-Efficient Computing Technologies

Power Consumption Analysis of Parallel Algorithms on GPUs

Energy-Efficiency Evaluation of OpenMP Loop Transformations and Runtime Constructs

Performance and Energy Consumption of Parallel Machine Learning Algorithms

AI-Driven Approaches for Optimizing Power Consumption: A Comprehensive Survey

GreenPy: Evaluating Application-Level Energy Efficiency in Python for Green Computing

Power-aware Programming with GPU Accelerators

Integrated optimization scheme in parallelizing compilers

Adaptive Performance Optimization under Power Constraint in Multi-thread Applications with Diverse Scalability

Assessing the Effectiveness of (Parallel) Branch-and-bound Algorithms

Offline Data Dependence Analysis to Facilitate Runtime Parallelism Extraction

Energy Optimization of Memory Intensive Parallel workloads