Abstract:Along with the popularization of big data applications, real-time data analysis is playing an increasingly important role in data analytic applications. The distributed parallel processing framework is a good choice for real-time big data processing, since it provides an effective solution which facilitates processing of massive data stream with low latency. Furthermore, among the real-time applications, location based service is recognized as the most challenging one, especially under expectation on fast response to distribution change and minimal resource consumption. We find that the fundamental reason for this is that the index performance is a stumbling block. Specifically, the original intention of index design is to speed up retrieval speed; in other words, the index is more useful for operations that have more queries than updates. However, in the distributed parallel processing framework, each incoming tuple is both a query request and an update request. In this paper, we propose a new tree index, quad balanced space tree called QBS-tree, to solve this problem, with practical algorithms to support dynamic index items assignment for distributed parallel processing framework. Specifically, make tree index's tolerability to the index items' unbalanced distribution in space be more resilient through a configurable balance factor. In addition, through the lazy update mechanism, let some updates offset each other and the upper node's update covers the underlying node's. Experiments show that QBS-tree responds to a new tuple 1300 times faster than the traditional tree index.

Distributed AH-Tree Based Index Technology for Multi-channel Wireless Data Broadcast.

Performance evaluation of air indexing schemes for multi-attribute data broadcast

An Error-Resilient and Tunable Distributed Indexing Scheme for Wireless Data Broadcast

A Distributed P2P Ordering System Accepting Mass Real-Time Broadcasting

A Fast Trie Tree Index Construction Algorithm Using Frequency Characteristic

A novel tree-based broadcast algorithm for wireless ad hoc networks

Two-Tier Air Indexing for On-Demand XML Data Broadcast

A Novel Air Index Scheme for Twig Queries in On-Demand XML Data Broadcast

QBS-Tree: A Spatial Index with High Update Efficiency for Real-Time Processing System

A Novel 3d Ray-Tracing Acceleration Technique Based On Kd-Tree Algorithm For Radio Propagation Predictionin Complex Indoor Environment

Hierarchical Key Distribution Scheme for Conditional Access System in DTV Broadcasting

An Affinity Path Based Wireless Broadcast Scheduling Approach for Multi-item Queries

A Hypergraph Approach to Distributed Broadcast

An Encoding-Based Dual Distance Tree High-Dimensional Index

A Deadlock-Free High-Throughput Tree Algorithm For Random Access Over Fading Channels

The HV-tree

k -Resilient Algorithm of Mobile Ad Hoc Network Broadcasting

Bitmap Index Distributed with Broadcast Disks for Data on Air

BulkTree: An overlay network architecture for live media streaming

A Fast Channel Allocation Algorithm for Wireless Data Broadcast over Digital TV Terrestrial Broadcast System

On the Mathematical Nature of Wireless Broadcast Trees