Abstract:Pass selection and phase ordering are two critical compiler auto-tuning problems. Traditional heuristic methods cannot effectively address these NP-hard problems especially given the increasing number of compiler passes and diverse hardware architectures. Recent research efforts have attempted to address these problems through machine learning. However, the large search space of candidate pass sequences, the large numbers of redundant and irrelevant features, and the lack of training program instances make it difficult to learn models well. Several methods have tried to use expert knowledge to simplify the problems, such as using only the compiler passes or subsequences in the standard levels (e.g., -O1, -O2, and -O3) provided by compiler designers. However, these methods ignore other useful compiler passes that are not contained in the standard levels. Principal component analysis (PCA) and exploratory factor analysis (EFA) have been utilized to reduce the redundancy of feature data. However, these unsupervised methods retain all the information irrelevant to the performance of compilation optimization, which may mislead the subsequent model learning. To solve these problems, we propose a compiler pass selection and phase ordering approach, called Iterative Compilation based on Metric learning and Collaborative filtering (ICMC). First, we propose a data-driven method to construct pass subsequences according to the observed collaborative interactions and dependency among passes on a given program set. Therefore, we can make use of all available compiler passes and prune the search space. Then, a supervised metric learning method is utilized to retain useful feature information for compilation optimization while removing both the irrelevant and the redundant information. Based on the learned similarity metric, a neighborhood-based collaborative filtering method is employed to iteratively recommend a few superior compiler passes for each target program. Last, an iterative data enhancement method is designed to alleviate the problem of lacking training program instances and to enhance the performance of iterative pass recommendations. The experimental results using the LLVM compiler on all 32 cBench programs show the following: (1) ICMC significantly outperforms several state-of-the-art compiler phase ordering methods, (2) it performs the same or better than the standard level -O3 on all the test programs, and (3) it can reach an average performance speedup of 1.20 (up to 1.46) compared with the standard level -O3.

High-Reliability Compilation Optimization Sequence Generation Framework Based ANN

Compilation approach for dynamically reconfigurable architecture based on grouped tasks

Compilation Optimization Pass Selection Using Gate Graph Attention Neural Network for Reliability Improvement

Enabling Reliability-Driven Optimization Selection with Gate Graph Attention Neural Network

GA Based Inlining Optimization in Front-End Synthesis of Embedded Software

Towards Compile-Time-Reducing Compiler Optimization Selection via Machine Learning

Optimizing Assembly Sequence Planning Using Precedence Graph-Based Assembly Subsets Prediction Method

Feature Mining for Machine Learning Based Compilation Optimization

Solder Joint Reliability Risk Estimation by AI-Assisted Simulation Framework with Genetic Algorithm to Optimize the Initial Parameters for AI Models

Iterative Compilation Optimization Based on Metric Learning and Collaborative Filtering.

ConAIR:Consistency-Augmented Iterative Interaction Framework to Enhance the Reliability of Code Generation

Learning Compiler Pass Orders using Coreset and Normalized Value Prediction

Structural reliability analysis based on genetic simulated annealing algorithm

Compilation Forking: A Fast and Flexible Way of Generating Data for Compiler-Internal Machine Learning Tasks

Reliability Optimization for Multi-State Series-Parallel System Design Using Ant Colony Algorithm

Facilitating the search for compositions of program transformations

A General Pattern-Based Dynamic Compilation Framework for Coarse-Grained Reconfigurable Architectures.

StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback

ARCO:Adaptive Multi-Agent Reinforcement Learning-Based Hardware/Software Co-Optimization Compiler for Improved Performance in DNN Accelerator Design

RTLRewriter: Methodologies for Large Models aided RTL Code Optimization

RRGcode: Deep hierarchical search-based code generation