Abstract:Manual parallelization of code remains a significant challenge due to the complexities of modern software systems and the widespread adoption of multi-core architectures. This paper introduces OMPar, an AI-driven tool designed to automate the parallelization of C/C++ code using OpenMP pragmas. OMPar integrates Large Language Models (LLMs) through two key components: OMPify, which assesses loop parallelization potential, and MonoCoder-OMP, a new fine-tuned model which generates precise OpenMP pragmas. The evaluation of OMPar follows the same rigorous process applied to traditional tools like source-to-source AutoPar and ICPC compilers: (1) ensuring the generated code compiles and runs correctly in serial form, (2) assessing performance with the gradual addition of threads and corresponding physical cores, and (3) verifying and validating the correctness of the code's output. Benchmarks from HeCBench and ParEval are used to evaluate accuracy and performance. Experimental results demonstrate that OMPar significantly outperforms traditional methods, achieving higher accuracy in identifying parallelizable loops and generating efficient pragmas. Beyond accuracy, OMPar offers advantages such as the ability to work on partial or incomplete codebases and the capacity to continuously learn from new code patterns, enhancing its parallelization capabilities over time. These results underscore the potential of LLMs in revolutionizing automatic parallelization techniques, paving the way for more efficient and scalable parallel computing systems.

OpenMP on Networks of Workstations for Software DSMs.

Parallel Computing of Shared Memory Multiprocessors Based on JOMP

Performance Analysis and Improvement of OpenMP on Software Distributed Shared Memory Systems?

OpenMP Compiler for Distributed Memory Architectures

A Parallel I/O System Based on NOW

Research and Implementation of a Parallel Circuit Simulation on "NOW"

Automatic translation of data parallel programs for heterogeneous parallelism through OpenMP offloading

Openuh: an Optimizing, Portable Openmp Compiler

An Extended Openmp Targeting On The Hybrid Architecture Of Smp-Cluster

Performance Improvement of a Network Management System Based on OpenMP

Automatic Asynchronous Execution of Synchronously Offloaded OpenMP Target Regions

Shared Variable Oriented Parallel Precompiler for SPMD Model.

OMP-Engineer: Bridging Syntax Analysis and In-Context Learning for Efficient Automated OpenMP Parallelization

Towards a Scalable and Efficient PGAS-based Distributed OpenMP

Research on MPI/OpenMP hybrid parallel computation of AREM model

Running real applications on software DSMs

A New Home-Based Software DSM Protocol for SMP Clusters

OMPar: Automatic Parallelization with AI-Driven Source-to-Source Compilation

Implementation and performance of software DSMs over virtual interface architecture

An Implementation Scheme of PVM Network Parallel Computing

A Parallel Implementation of Multiobjective Particle Swarm Optimization Algorithm Based on Decomposition.