Abstract:More and more real-time applications need to handle dynamic continuous queries over streaming data of high density. Conventional data and query indexing approaches generally do not apply for excessive costs in either maintenance or space. Aiming at these problems, this study first proposes a new indexing structure by fusing an adaptive cell and KDB-tree, namely CKDB-tree. A cell-tree indexing approach has been developed on the basis of the CKDB-tree that supports dynamic continuous queries. The approach significantly reduces the space costs and scales well with the increasing data size. Towards providing a scalable solution to filtering massive steaming data, this study has explored the feasibility to utilize the contemporary general-purpose computing on the graphics processing unit (GPGPU). The CKDB-tree-based approach has been extended to operate on both the CPU (host) and the GPU (device). The GPGPU-aided approach performs query indexing on the host while perform streaming data filtering on the device in a massively parallel manner. The two heterogeneous tasks execute in parallel and the latency of streaming data transfer between the host and the device is hidden. The experimental results indicate that (1) CKDB-tree can reduce the space cost comparing to the cell-based indexing structure by 60 percent on average, (2) the approach upon the CKDB-tree outperforms the traditional counterparts upon the KDB-tree by 66, 75 and 79 percent in average for uniform, skewed and hyper-skewed data in terms of update costs, and (3) the GPGPU-aided approach greatly improves the approach upon the CKDB-tree with the support of only a single Kepler GPU, and it provides real-time filtering of streaming data with 2.5M data tuples per second. The massively parallel computing technology exhibits great potentials in streaming data monitoring.

Parallelization Optimization of KD-Tree Building Algorithm

MSKD: multi-split KD-tree design on GPU

Pkd-tree: Parallel $k$d-tree with Batch Updates

Path compression kd-trees with multi-layer parallel construction a case study on ray tracing.

Fully parallel kd-tree construction for real-time ray tracing.

OpenCL-Based Real-Time KD-Tree and Raytracing for Dynamic Scene

Build Kd-Tree for Virtual Scenes in a Fast and Optimal Way

Real-time KD-tree Construction on Graphics Hardware.

SAH KD-Tree Construction on GPU.

Optimizing Kd-Trees for Scalable Visual Descriptor Indexing

Implementation of a Parallel Tree Method on a GPU

Parallel Volume Rendering Based on LOD Method

X-TED: Massive Parallelization of Tree Edit Distance

Data parallelization of Kd-tree ray tracing on the cell broadband engine

Efficient Kd-Tree Construction for Ray Tracing Using Ray Distribution Sampling

Realtime Ray Tracing on a Hibrid Parallel Architecture

Parallel Processing of Dynamic Continuous Queries over Streaming Data Flows

A Multi-Core Parallel Fusion Algorithm for Remote-Sensing Image

FastTree: a Hardware KD-tree Construction Acceleration Engine for Real-Time Ray Tracing

Contorting High Dimensional Data for Efficient Main Memory KNN Processing

A Hybrid Index Structure Based on Multi-Core Cluster