Abstract: The ability to preserve local geometry of highly nonlinear manifolds in high dimensional spaces and properly unfold them into lower dimensional hyperplanes is the key to the success of manifold computing, nonlinear dimensionality reduction (NLDR) and visualization. This paper proposes a novel method, called elastic locally isometric smoothness (ELIS), to empower deep neural networks with such an ability. ELIS requires that a desired metric between points should be preserved across layers in order to preserve local geometry; such a smoothness constraint effectively regularizes vector-based transformations to become well-behaved local metric-preserving homeomorphisms. Moreover, ELIS requires that the smoothness should be imposed in a way to render sufficient flexibility for tackling complicated nonlinearity and non-Euclideanity; this is achieved layer-wisely via nonlinearity in both the similarity and activation functions. The ELIS method incorporates a class of suitable nonlinear similarity functions into a two-way divergence loss and uses hyperparameter continuation in finding optimal solutions. Extensive experiments, comparisons, and ablation study demonstrate that ELIS can deliver results not only superior to UMAP and t-SNE for and visualization but also better than other leading counterparts of manifold and autoencoder learning for NLDR and manifold data generation.

Interactive Indexing for Facial Image Retrieval in Manifold Spaces

Learning an Image Manifold for Retrieval

Image retrieval based on incremental subspace learning

Laplacian Eigenmap for Image Retrieval

Image retrieval using dimensionality reduction

Image-based 3D Model Retrieval Using Manifold Learning

Image distance measurement based on manifold learning and manifold high-order approximation

Image Retrieval Algorithms Based on Manifold Learning

Deep Manifold Computing and Visualization

Efficient Manifold Ranking for Image Retrieval

Deep Manifold Computing and Visualization Using Elastic Locally Isometric Smoothness

Convex Experimental Design Using Manifold Structure for Image Retrieval.

Manifold information through neighbor embedding projection for image retrieval

Retrieving Video Shots In Semantic Brain Imaging Space Using Manifold-Ranking

Image retrieval using nonlinear manifold embedding

Using High Dimensional Indexes to Support Relevance Feedback Based Interactive Images Retrieval

Regularized Regression on Image Manifold for Retrieval

Manifold-ranking based retrieval using k-regular nearest neighbor graph

Hierarchical Indexing Scheme for Fast Search in Large-Scale Image Database

Hierarchical indexing scheme for fast search in a large-scale image database

Manifold Embedding for Zero-Shot Recognition