Abstract:Static and dynamic binary analysis techniques are actively used to reverse engineer software's behavior and to detect its vulnerabilities, even when only the binary code is available for analysis. To avoid analysis errors due to misreading op-codes for a wrong CPU architecture, these analysis tools must precisely identify the Instruction Set Architecture (ISA) of the object code under analysis. The variety of CPU architectures that modern security and reverse engineering tools must support is ever increasing due to massive proliferation of IoT devices and the diversity of firmware and malware targeting those devices. Recent studies concluded that falsely identifying the binary code's ISA caused alone about 10\% of failures of IoT firmware analysis. The state of the art approaches to detect ISA for arbitrary object code look promising - their results demonstrate effectiveness and high-performance. However, they lack the support of publicly available datasets and toolsets, which makes the evaluation, comparison, and improvement of those techniques, datasets, and machine learning models quite challenging (if not impossible). This paper bridges multiple gaps in the field of automated and precise identification of architecture and endianness of binary files and object code. We develop from scratch the toolset and datasets that are lacking in this research space. As such, we contribute a comprehensive collection of open data, open source, and open API web-services. We also attempt experiment reconstruction and cross-validation of effectiveness, efficiency, and results of the state of the art methods. When training and testing classifiers using solely code-sections from executable binary files, all our classifiers performed equally well achieving over 98\% accuracy. The results are consistent and comparable with the current state of the art, hence supports the general validity of the algorithms

Framework for Machine Instruction Usage Analysis

Towards usable automated detection of CPU architecture and endianness for arbitrary binary files and object code sequences

uops.info: Characterizing Latency, Throughput, and Port Usage of Instructions on Intel Microarchitectures

A Case Study of LLVM-Based Analysis for Optimizing SIMD Code Generation

An Analysis Framework for Hardware and Software Implementations with Applications from Cryptography

Automated Instruction Stream Throughput Prediction for Intel and AMD Microarchitectures

A Performance Analysis Framework for Exploiting GPU Microarchitectural Capability.

A Source-Level Instrumentation Framework for the Dynamic Analysis of Memory Safety

A Theoretical Research on Program Instruction Level Parallelism to Guide Microprocessor Design

Machine Learning Framwork for Performance Anomaly in OpenMP Multi-Threaded Systems

Discovery of Endianness and Instruction Size Characteristics in Binary Programs from Unknown Instruction Set Architectures

Toward a Common Framework for Statistical Analysis and Development

Call graph discovery in binary programs from unknown instruction set architectures

MCompiler: A Synergistic Compilation Framework

Using Data Dependence Analysis and Loop Transformations to Teach Vectorization

The ELAPS Framework: Experimental Linear Algebra Performance Studies

Learning to Find Usages of Library Functions in Optimized Binaries

Hot spots profiling and dataflow analysis in custom dataflow computing SoftProcessors

A Framework For Performance Evaluation Of ASIPS In Network-Based IDS

Improving Memory Dependence Prediction with Static Analysis

Orc-Openmp: An Openmp Compiler Based On Orc