Abstract:The prosperous trend of deploying deep neural network (DNN) models to diverse hardware platforms has boosted the development of deep learning (DL) compilers. DL compilers take the high-level DNN model specifications as input and generate optimized DNN executables for diverse hardware architectures like CPUs, GPUs, and various hardware accelerators. Compiling DNN models into high-efficiency executables is not easy: the compilation procedure often involves converting high-level model specifications into several different intermediate representations (IR), e.g., graph IR and operator IR, and performing rule-based or learning-based optimizations from both platform-independent and platform-dependent perspectives. Despite the prosperous adoption of DL compilers in real-world scenarios, principled and systematic understanding toward the correctness of DL compilers does not yet exist. To fill this critical gap, this paper introduces MT-DLComp, a metamorphic testing framework specifically designed for DL compilers to effectively uncover erroneous compilations. Our approach leverages deliberately-designed metamorphic relations (MRs) to launch semantics-preserving mutations toward DNN models to generate their variants. This way, DL compilers can be automatically examined for compilation correctness utilizing DNN models and their variants without requiring manual intervention. We also develop a set of practical techniques to realize an effective workflow and localize identified error-revealing inputs. Real-world DL compilers exhibit a high level of engineering quality. Nevertheless, we detected over 435 inputs that can result in erroneous compilations in four popular DL compilers, all of which are industry-strength products maintained by Amazon, Facebook, Microsoft, and Google. While the discovered error-triggering inputs do not cause the DL compilers to crash directly, they can lead to the generation of incorrect DNN executables. With substantial manual effort and help from the DL compiler developers, we uncovered four bugs in these DL compilers by debugging them using the error-triggering inputs. Our proposed testing frameworks and findings can be used to guide developers in their efforts to improve DL compilers.

HIMALIA: Recovering Compiler Optimization Levels from Binaries by Deep Learning

Learning to Find Usages of Library Functions in Optimized Binaries

Understand Code Style: Efficient CNN-based Compiler Optimization Recognition System

Boosting Neural Networks to Decompile Optimized Binaries

DIComP: Lightweight Data-Driven Inference of Binary Compiler Provenance with High Accuracy

Fuzzing Deep Learning Compilers with HirGen

LLM4Decompile: Decompiling Binary Code with Large Language Models

Metamorphic Testing of Deep Learning Compilers

An Optimization Toolchain Design Of Deep Learning Deployment Based On Heterogeneous Computing Platform

Revisiting Deep Learning for Variable Type Recovery

The Deep Learning Compiler: A Comprehensive Survey

HexT5: Unified Pre-Training for Stripped Binary Code Information Inference.

Enhancing Reverse Engineering: Investigating and Benchmarking Large Language Models for Vulnerability Analysis in Decompiled Binaries

Function-Level Compilation Provenance Identification with Multi-Faceted Neural Feature Distillation and Fusion

AI Powered Compiler Techniques for DL Code Optimization

ViC: Virtual Compiler Is All You Need For Assembly Code Search

CMLCompiler: A Unified Compiler for Classical Machine Learning

Investigating Neural-based Function Name Reassignment from the Perspective of Binary Code Representation

Beyond the C: Retargetable Decompilation using Neural Machine Translation

HDCC: A Hyperdimensional Computing compiler for classification on embedded systems and high-performance computing

Semantics-Recovering Decompilation through Neural Machine Translation