Abstract:There has been increased interest in data search as a means to find relevant datasets or data points in data lakes and repositories. Although approaches have been proposed to support spatial dataset search and data point search, they consider the two types of searches independently. To enable search operations ranging from the coarse-grained dataset level to the fine-grained data point level, we provide an integrated one that supports diverse query types and distance metrics. In this paper, we focus on designing a multi-granularity spatial data search system, called Spadas, that supports both dataset and data point search operations. To address the challenges of the high cost of indexing and susceptibility to outliers, we propose a unified index that can drastically improve query efficiency in various scenarios by organizing data reasonably and removing outliers in datasets. Moreover, to accelerate all data search operations, we propose a set of pruning mechanisms based on the unified index, including fast bound estimation, approximation technique with error bound, and pruning in batch techniques, to effectively filter out non-relevant datasets and points. Finally, we report the results of a detailed experimental evaluation using six spatial data repositories, achieving orders of magnitude faster than the state-of-the-art algorithms and demonstrating the effectiveness by case study. An online spatial data search system of Spadas is also implemented and made accessible to users.

Pay-as-you-go Mapping Selection in Dataspaces

DSToolkit: an architecture for flexible dataspace management

Practicability of Dataspace Systems

Flexible Dataspace Management Through Model Management

Mesa: A Map Service To Support Fuzzy Type-Ahead Search Over Geo-Textual Data

Inferring Information about Correspondences Between Data Sources for Dataspaces

A Survey On Accessing Dataspaces

Materialization and Decomposition of Dataspaces for Efficient Search

XDTM: the XML Data Type and Mapping for Specifying Datasets

Datascape: exploring heterogeneous dataspace

A Data Transformation Method Based on Schema Mapping.

Standards for Data Space Building Blocks

A Unified Approach for Multi-granularity Search over Spatial Datasets

Answering queries on schema mappings

Demonstration of a Multiresolution Schema Mapping System

Mutual Enhancement of Schema Mapping and Data Mapping

A Virtual Dataspaces Model for Large-Scale Materials Scientific Data Access

Dynamic High Dimensional Data Mapping for Efficient Similarity Query Processing

Design space construction: a framework to support collaborative, parametric decision making

Sparcle: Boosting the Accuracy of Data Cleaning Systems through Spatial Awareness

SearchWebDB: Data Web Search on a Pay-As-You-Go Integration Infrastructure