Abstract:Compiled software is delivered as executable binary code. Developers write source code to express the software semantics, but the compiler converts it to a binary format that the CPU can directly execute. Therefore, binary code analysis is critical to applications in reverse engineering and computer security tasks where source code is not available. However, unlike source code and natural language that contain rich semantic information, binary code is typically difficult for human engineers to understand and analyze. While existing work uses AI models to assist source code analysis, few studies have considered binary code. In this paper, we propose a COntrastive learning Model for Binary cOde Analysis, or COMBO, that incorporates source code and comment information into binary code during representation learning. Specifically, we present three components in COMBO: (1) a primary contrastive learning method for cold-start pre-training, (2) a simplex interpolation method to incorporate source code, comments, and binary code, and (3) an intermediate representation learning algorithm to provide binary code embeddings. Finally, we evaluate the effectiveness of the pre-trained representations produced by COMBO using three indicative downstream tasks relating to binary code: algorithmic functionality classification, binary code similarity, and vulnerability detection. Our experimental results show that COMBO facilitates representation learning of binary code visualized by distribution analysis, and improves the performance on all three downstream tasks by 5.45% on average compared to state-of-the-art large-scale language representation models. To the best of our knowledge, COMBO is the first language representation model that incorporates source code, binary code, and comments into contrastive code representation learning and unifies multiple tasks for binary code analysis.

HexT5: Unified Pre-Training for Stripped Binary Code Information Inference.

A Neural-based Program Decompiler

CP-BCS: Binary Code Summarization Guided by Control Flow Graph and Pseudo Code

A refined decompiler to generate C code with high readability

A Novel Lightweight Virtual Machine Based Decompiler to Generate C / C + + Code with High Readability

Pre-Training Representations of Binary Code Using Contrastive Learning

Source Code Foundation Models are Transferable Binary Analysis Knowledge Bases

Improving Binary Code Similarity Transformer Models by Semantics-Driven Instruction Deemphasis.

Improving type information inferred by decompilers with supervised machine learning

LLM4Decompile: Decompiling Binary Code with Large Language Models

A Progressive Transformer for Unifying Binary Code Embedding and Knowledge Transfer

SoK: All You Ever Wanted to Know About x86/x64 Binary Disassembly But Were Afraid to Ask

Revisiting Deep Learning for Variable Type Recovery

STRIDE: Simple Type Recognition In Decompiled Executables

TransCoder: Towards Unified Transferable Code Representation Learning Inspired by Human Skills.

Beyond the C: Retargetable Decompilation using Neural Machine Translation

kTrans: Knowledge-Aware Transformer for Binary Code Embedding

Demystifying and Assessing Code Understandability in Java Decompilation

Unsupervised Binary Code Translation with Application to Code Similarity Detection and Vulnerability Discovery

A Program Understanding Approach for Stripped Binary Code

Boosting Neural Networks to Decompile Optimized Binaries