Abstract:Given a set of multidimensional data points, skyline queries retrieve those points that are not dominated by any other points in the set. Due to the ubiquitous use of skyline queries, such as in preference-based query answering and decision making, and the large amount of data that these queries have to deal with, enabling their scalable processing is of critical importance. However, there are several outstanding challenges that have not been well addressed. More specifically, in this paper, we are tackling the data straggler and data skew challenges introduced by distributed skyline query processing, as well as the ensuing high computation cost of merging skyline candidates. We thus introduce a new efficient three-phase approach for large scale processing of skyline queries. In the first preprocessing phase, the data is partitioned along the Z-order curve. We utilize a novel data partitioning approach that formulates data partitioning as an optimization problem to minimize the size of intermediate data. In the second phase, each compute node partitions the input data points into disjoint subsets, and then performs the skyline computation on each subset to produce skyline candidates in parallel. In the final phase, we build an index and employ an efficient algorithm to merge the generated skyline candidates. Extensive experiments demonstrate that the proposed skyline algorithm achieves more than one order of magnitude enhancement in performance compared to existing state-of-the-art approaches.

On processing reverse k-skyband and ranked reverse skyline queries

Reverse k-skyband query based on reuse technology

On efficient reverse k-skyband query processing

On efficient reverse skyline query processing

Fast Algorithms for Pareto Optimal Group-based Skyline

Group-Based Skyline for Pareto Optimal Groups

Skyline Diagram: Efficient Space Partitioning for Skyline Queries

Efficient Group-by Reverse Skyline Computation

Efficient reverse skyline querie algorithm in subspaces

Processing K-Skyband, Constrained Skyline, and Group-by Skyline Queries on Incomplete Data

On Efficient k-Skyband Query Processing over Incomplete Data.

Efficient Processing of Top K Group Skyline Queries.

An I/O Optimal and Scalable Skyline Query Algorithm

Efficient Computation of Reverse Skyline on Data Stream.

Constrained Skyline Query Processing Against Distributed Data Sites.

Ranking the Big Sky: Efficient Top-K Skyline Computation on Massive Data.

Efficient processing of k-quasi skyline query

Parallel Distributed Processing of Constrained Skyline Queries by Filtering

Efficient Approaches to K Representative G-Skyline Queries

Parallelizing progressive computation for skyline queries in multi-disk environment

Efficient Parallel Skyline Query Processing for High-Dimensional Data