Abstract:Recent advances have shown the methods based on local structure preserving projections can effectively learn discriminative features. The two attractive approaches for characterizing such data structure are: the classical nearest neighbor strategy for neighborhood structure and the sparse coding algorithm for sparsity structure. Motivated by the intuitive analysis of the relationship between the two structures, in this paper, we take both of them into account and propose two integrated approaches for dimensionality reduction. Concretely, we for achieving improvement directly integrate two available objectives, utilizing neighborhood structure and based on sparsity structure, to construct the combined method, briefly called CSNP. However, such rough strategy often results in its degradation in practice. Instead of the superficial combination, we exploit a hybrid structure by intergrading the two structures and then propose the Sparsity and Neighborhood Preserving Projections, dubbed SNPP, by preserving the hybrid structure into reduced subspace. The resulting optimization problems can be also interpreted as an instance of the general graph embedding framework and can reduce to the generalized eigenvalue decomposition problem. Finally, we conduct extensive experiments on publicly available data sets to verify the efficacy of our algorithms. From the experimental results, we roughly draw the conclusion that neighborhood structure is more important for low-dimensional data while sparsity structure is more useful for high-dimensional data.

Near-Optimal Partial Linear Scan for Nearest Neighbor Search in High-Dimensional Space.

Accelerating Exact Nearest Neighbor Search in High Dimensional Euclidean Space Via Block Vectors

Speed Up Linear Scan in High-Dimensions by Sorting One-Dimensional Projections

Preserving-Ignoring Transformation Based Index for Approximate k Nearest Neighbor Search

Approximate Nearest Neighbor Search on High Dimensional Data — Experiments, Analyses, and Improvement

A High Dimensional Index Based on Relative Distance Hashing Method

Efficient Approximate Algorithms for the Closest Pair Problem in High Dimensional Spaces.

SRS: solving c-approximate nearest neighbor queries in high dimensional euclidean space with a tiny index

HDIdx: High-dimensional indexing for efficient approximate nearest neighbor search

Random Projection with Filtering for Nearly Duplicate Search

Efficient Nearest Neighbor Search in High Dimensional Hamming Space

Lazylsh: Approximate Nearest Neighbor Search For Multiple Distance Functions With A Single Index

Bi-Level Locality Sensitive Hashing Index Based on Clustering

Random Angular Projection for Fast Nearest Subspace Search

Composite Distance Transformation for Indexing and K -Nearest-neighbor Searching in High-Dimensional Spaces

Diagonal Ordering: A New Approach to High-Dimensional KNN Processing.

Harmonious Hashing

Exploring Bit-Difference for Approximate KNN Search in High-Dimensional Databases

Effective and General Distance Computation for Approximate Nearest Neighbor Search

Fast High-dimensional Approximate Nearest Neighbor Search with Efficient Index Time and Space

Linear Dimensionality Reduction Based on Hybrid Structure Preserving Projections