Abstract:We propose a unified manifold learning framework for semi-supervised and unsupervised dimension reduction by employing a simple but effective linear regression function to map the new data points. For semi-supervised dimension reduction, we aim to find the optimal prediction labels F for all the training samples X, the linear regression function h(X) and the regression residue F(0) = F - h(X) simultaneously. Our new objective function integrates two terms related to label fitness and manifold smoothness as well as a flexible penalty term defined on the residue F(0). Our Semi-Supervised learning framework, referred to as flexible manifold embedding (FME), can effectively utilize label information from labeled data as well as a manifold structure from both labeled and unlabeled data. By modeling the mismatch between h(X) and F, we show that FME relaxes the hard linear constraint F = h(X) in manifold regularization (MR), making it better cope with the data sampled from a nonlinear manifold. In addition, we propose a simplified version (referred to as FME/U) for unsupervised dimension reduction. We also show that our proposed framework provides a unified view to explain and understand many semi-supervised, supervised and unsupervised dimension reduction techniques. Comprehensive experiments on several benchmark databases demonstrate the significant improvement over existing dimension reduction algorithms.

A Unified Framework for Semi-Supervised Dimensionality Reduction

Computational and Theoretical Analysis of Supervised Dimensionality Reduction

A unified semi-supervised dimensionality reduction framework for manifold learning

Stable Local Dimensionality Reduction Approaches

Large-margin Weakly Supervised Dimensionality Reduction.

Dimension Reduction with Semi-supervised Pairwise Covariance-Preserving Projection

Transferred Dimensionality Reduction

A Perception-Driven Approach to Supervised Dimensionality Reduction for Visualization

Supervised Dimensionality Reduction Via Sequential Semidefinite Programming

Semi-supervised Dimensionality Reduction for Image Retrieval

Dimensionality Reduction for Semi-supervised Face Recognition

Nonparametric Discriminant Multi-Manifold Learning for Dimensionality Reduction

Deep Dimension Reduction for Supervised Representation Learning

Local Feature Discriminant Projection

Multiple View Semi-Supervised Dimensionality Reduction

Semi-supervised Hierarchical Clustering Analysis for High Dimensional Data

Sparse Unsupervised Dimensionality Reduction Algorithms

Supervised Dimensionality Reduction Technology of Generalized Discriminant Component Analysis and Its Kernelization Forms

Real-valued Multivariate Dimension Reduction: A Survey

A Unifying Framework For Spectral Analysis Based Dimensionality Reduction

Flexible manifold embedding: a framework for semi-supervised and unsupervised dimension reduction.