Abstract:Recent development in image content analysis has shown that the dimensionality of an image feature can reach thousands or more for satisfactory results in some applications such as face recognition. Although high-dimensional indexing has been extensively studied in database literature, most existing methods are tested for feature spaces with less than hundreds of dimensions and their performance degrades quickly as dimensionality increases. Given the huge popularity of histogram features in representing image content, in this papers we propose a novel indexing structure for efficient histogram based similarity search in ultra-high dimensional space which is also sparse. Observing that all possible histogram values in a domain form a finite set of discrete states, we leverage the time and space efficiency of inverted file. Our new structure, named two-tier inverted file, indexes the data space in two levels, where the first level represents the list of occurring states for each individual dimension, and the second level represents the list of occurring images for each state. In the query process, candidates can be quickly identified with a simple weighted state-voting scheme before their actual distances to the query are computed. To further enrich the discriminative power of inverted file, an effective state expansion method is also introduced by taking neighbor dimensions' information into consideration. Our extensive experimental results on real-life face datasets with 15,488 dimensional histogram features demonstrate the high accuracy and the great performance improvement of our proposal over existing methods.

Similarity Measurement of Data in High-dimensional Spaces

Research on Similarity Measurement in Multimedia Data Mining

A similarity computing algorithm for volumetric data sets

Research on High Dimensional Clustering Algorithm Based on Similarity Measure

Similarity Measurement for Graph Data

Similarity Search in high Dimension Time Series

A Subspace Clustering Algorithm for High Dimensional Data Based on Similar Dimension

Efficient Histogram-Based Similarity Search In Ultra-High Dimensional Space

A hyperplane based indexing technique for high-dimensional data

Indexing Sub-Vector Distance for High-Dimensional Feature Matching.

Efficient Approximate Algorithms for the Closest Pair Problem in High Dimensional Spaces.

Similarity Measurement for Graph Data: an Improved Centrality and Geometric Perspective-Based Approach

International Symposium on Spatial Analysis, Spatial-Temporal Data Modeling, and Data Mining

Similarity Searches in Heterogeneous Feature Spaces

Isomorphism Distance in Multidimensional Time Series and Similarity Search

A Kind of Outlier Detection Algorithm Based on Similarity Measurement

Survey on similarity measurement of time series data mining

Learning Similarity Measures in Non-Orthogonal Space.

DIMS: Distributed Index for Similarity Search in Metric Spaces

Distributed Online Similarity Search in High Dimensional Space

An Approach for a Spatial Data Attribute Similarity Measure Based on Granular Computing Closeness