Abstract:The motivation of the current study was to design an algorithm that can speed up the processing of a query. The important feature is generating code dynamically for a specific query. We present the technique of code generation that is applied to query processing on a raw file. The idea was to customize a query program with a given query and generate a machine- and query-specific source code. The generated code is compiled by GCC, Clang or any other C/C++ compiler, and the compiled file is dynamically linked to the main program for further processing. Code generation reduces the cost of generalizing query processing. It also avoids the overhead of the conventional interpretation during achieve high performance. Database Management Systems (DBMSs) perform excellent jobs in many aspects of big data, such as storage, indexing, and analysis. DBMSs typically format entire data and load them into their storage layer. They increase data-to-query time, which is the cost time it takes to convert data into a specific schema and persist them in a disk. Ideally, DBMSs should adapt to the input data and extract one/some of columns, not the entire data, that is/are associated with a given query. Therefore, the query engine on a raw file can reduce the cost of conventional general operators and avoid some unnecessary procedures, such as fully scanning, tokenizing and paring the whole data. In the current study, we introduce our code-generation approach for in-situ processing of raw files, which is based on the template approach and the hype approach. The approach minimizes the data-to-query time and achieves a high performance for query processing. There are some benefits from our work: reducing branches and instructions, unrolling loops, eliminating unnecessary data type checks and optimizing the binary code with a compiler on a local machine.

Code Generation for Abstract Data Types Based on Program Analysis

Automatic Compiler-Based Data Structure Generation

Finding Optimum Abstractions in Parametric Dataflow Analysis

Automatic Modular Abstractions for Template Numerical Constraints

Code Generation Techniques for Raw Data Processing

Unboxing Virgil ADTs for Fun and Profit

Abstracting Abstract Machines: A Systematic Approach to Higher-Order Program Analysis

Optimized Automatic Code Generation for Geometric Algebra Based Algorithms with Ray Tracing Application

Description and Optimization of Abstract Machines in a Dialect of Prolog

A Compile/Run-time Environment for the Automatic Transformation of Linked List Data Structures

Generating Finite Element Codes combining Adaptive Octrees with Complex Geometries

The ART of Sharing Points-to Analysis (Extended Abstract)

A simple abstraction of arrays and maps by program translation

An abstract intermediate representation in compilation systems

Automatic Generation of Efficient Linear Algebra Programs

Improving Dynamic Code Analysis by Code Abstraction

Extended abstract: Type oriented programming for task based parallelism

Code Generation for a Variety of Accelerators for a Graph DSL

Automatic abstraction for C program

Automatically generating features for learning program analysis heuristics

Exploiting array manipulation habits to optimize garbage collection and type flow analysis