Abstract:Graph analysis database such as MapD employs the emerging manycore architecture GPU and Phi processors to support high performance analytical processing,where the join operation is still the performance bottleneck when facing complex data schemas.In recent years,as heterogeneous processors come to be main-stream high performance computing platforms,the researches of in-memory join performance extend the focuses from multicore to the emerging manycore platforms.However those efforts have not uncover the inner relationships among join algorithm performance,join dataset size and hardware architectures,and cannot provide sufficient join selection strategies for databases under the future heterogeneous processor platforms.This paper targets in-memory join optimization techniques on multicore,Xeon Phi and GPU processor platforms.By optimizing hash table design,this work uses vector mapping instead of hash mapping to eliminate the hashing overhead effects for performance,so that the in-memory join performance characteristics influenced can be measured by hardware factors such as multicore cache size,Xeon Phi cache size,Xeon Phi simultaneous multi-threading mechanism,and GPU SIMT (single instruction multiple threads) mechanism.The experimental results show that caching and simultaneous massive-threading mechanism are key factors to improve in-memory join algorithm performance.Caching mechanism performs well for cache fit join operations,the simultaneous massive-threading mechanism of GPU does well for big table joins,and Xeon Phi achieves the highest performance for L2 cache fit joins.The experimental results also exploit the relationship between in-memory join performance and heterogeneous processor hardware features,and provide optimization policy for in-memory database query optimizer on future heterogeneous processor platforms.

Parallel Two-Way Enumeration Join Based on Multi-cores Environment

Optimization Strategy of Bidirectional Join Enumeration in Multi-Core CPUS

Optimization Strategy of Top-Down Join Enumeration on Modern Multi-Core CPUs.

Optimization Factor Analysis Of Large-Scale Join Queries On Different Platforms

Database Query Optimization Based On Parallel Ant Colony Algorithm

Optimization Strategy of Parallel Query Processing Based on Multi-core Architecture.

Parallel Join Based on Distributed System OceanBase

Parallel Structural Join Algorithm on Shared-Memory Multi-Core Systems

Graceful Degradation for Top-Down Join Enumeration via similar sub-queries measure on Chip Multi-Processor

Parallel Query Optimization Techniques for Multi-Join Expressions Based on Genetic Algorithm

Optimizing the parallel adaptive indexing algorithm on mul ti-co re CPUs

Degradation of Complexity for Join Enumeration via Weight Measure on CMP

Research on the Semi-Join-Based Parallel Query Processing Algorithm

Adaptive Multi-join Query Processing in PDBMS

Efficient Parallel Partition-Based Algorithms for Similarity Search and Join with Edit Distance Constraints

An optimization algorithm for data stream joins on multiprocessor

Thorough Data Pruning for Join Query in Database System

Query Optimization of Distributed Database Based on Parallel Genetic Algorithm and Max-Min Ant System

An Effective High-Performance Multiway Spatial Join Algorithm with Spark

Vector Referencing Oriented Platform-Oblivious In-Memory Join Optimization Technique

Optimizing Large Query by Simulated Annealing Algorithm Based on Graph-Based Approach.