Abstract:Database queries can contain multiple predicates. The optimization of conjunctive predicates is still vital to the overall performance of analytic data processing tasks. Prior work proposes several memory-efficient storage layouts, e.g., BitWeaving and ByteSlice, to significantly accelerate predicate evaluation, as circuit-level intra-cycle parallelism available in modern CPUs can be exploited such that the total number of instructions can be dramatically reduced. However, the performance potential of conjunctive predicates has not been harvested yet under such storage layouts as there is no accurate cost model to provide necessary insights that guide the optimization process. In this paper, we propose a hybrid empirical/analytical cost model (Understanding) to unveil the performance characteristics of such storage layouts when applying to predicate evaluation. Our cost model takes into account effect of non-linear factors, e.g., cache miss and branch misprediction, and easily applies to different CPUs. The main finding from our cost model is to distinguish high-cost instruction (which suffers from cache miss and/or branch misprediction) from low-cost instruction (which enjoys cache hit and correct branch prediction) in the context of predicate evaluation under these storage layouts. Guided by such a finding, we propose a simple execution scheme Hebe (Optimizing), which is order-oblivious while maintaining high performance. Hebe is attractive to the query optimizer (QO), as the QO does not need to go through a sampling process to decide the optimal evaluation order in advance. The intuition behind Hebe is to significantly reduce the number of high-cost instructions while keeping low-cost instructions unchanged. Our finding from Hebe sheds light on the importance of accurate cost model that guide us to derive an efficient execution scheme for query processing on modern CPUs.

Hybrid Dynamic Pruning for Efficient and Effective Query Processing

Class-Aware Pruning for Efficient Neural Networks

Diversification Based Static Index Pruning - Application to Temporal Collections

Hybrid Dynamic Pruning: A Pathway to Efficient Transformer Inference

A Static Pruning Study on Sparse Neural Retrievers

Processing Long Queries Against Short Text

Multi-Dimensional Pruning: Joint Channel, Layer and Block Pruning with Latency Constraint

Optimizing XML querying using type-based document projection

Optimization for Collecting and Scoring Documents for Complex Boolean Query

Magpie: Efficient Big Data Query System Parameter Optimization Based on Pre-selection and Search Pruning Approach.

Faster Learned Sparse Retrieval with Block-Max Pruning

An Analysis on Matching Mechanisms and Token Pruning for Late-interaction Models

Dynamic Probabilistic Pruning: A General Framework for Hardware-Constrained Pruning at Different Granularities

Separate, Dynamic and Differentiable (SMART) Pruner for Block/Output Channel Pruning on Computer Vision Tasks

Decay Pruning Method: Smooth Pruning With a Self-Rectifying Procedure

Effectiveness and Efficiency Trade-off in Selective Query Processing

Fast Hybrid Search for Automatic Model Compression

Understanding and Optimizing Conjunctive Predicates Under Memory-Efficient Storage Layouts

Not All Data Matters: An End-to-End Adaptive Dataset Pruning Framework for Enhancing Model Performance and Efficiency

Pruner: A Speculative Exploration Mechanism to Accelerate Tensor Program Tuning