Abstract:Linear Discriminant Analysis (LDA) has been a popular method for extracting features that preserves class separability. The projection functions of LDA are commonly obtained by maximizing the between-class covariance and simultaneously minimizing the within-class covariance. It has been widely used in many fields of information processing, such as machine learning, data mining, information retrieval, and pattern recognition. However, the computation of LDA involves dense matrices eigendecomposition, which can be computationally expensive in both time and memory. Specifically, LDA has O(mnt + t(3) )time complexity and requires O(mn + mt + nt) memory, where m is the number of samples, n is the number of features, and t = min(m,n). When both m and n are large, it is infeasible to apply LDA. In this paper, we propose a novel algorithm for discriminant analysis, called Spectral Regression Discriminant Analysis (SRDA). By using spectral graph analysis, SRDA casts discriminant analysis into a regression framework that facilitates both efficient computation and the use of regularization techniques. Specifically, SRDA only needs to solve a set of regularized least squares problems, and there is no eigenvector computation involved, which is a huge save of both time and memory. Our theoretical analysis shows that SRDA can be computed with O(ms) time and O(ms) memory, where s(<= n) n is the average number of nonzero features in each sample. Extensive experimental results on four real-world data sets demonstrate the effectiveness and efficiency of our algorithm.

Semi-Supervised Discriminant Analysis Via Spectral Transduction.

Semi-Supervised Nonparametric Discriminant Analysis

Locality sensitive discriminant transductive learning

Classification by Semi-Supervised Discriminative Regularization

Laplacian adaptive weighted discriminant analysis for semi-supervised multi-class classification

By Normalizing To Improve Generalized Foley-Sammon Transform In High-Dimensional Spaces-----With Application To Face Recognition

Optimal Dimensionality Discriminant Analysis and Its Application to Image Recognition

Semi-supervised Discriminant Analysis Based on Sparse-Coding Theory

Semi-supervised Discriminant Analysis Based on Dependence Estimation

Disambiguation Enabled Linear Discriminant Analysis for Partial Label Dimensionality Reduction

Spectral Methods for Semi-Supervised Manifold Learning.

Cost-Sensitive Semi-Supervised Discriminant Analysis for Face Recognition.

Local Feature Discriminant Projection

Dimensionality Reduction for Semi-supervised Face Recognition

Semi-supervised clustering based on spectral clustering

SRDA: an Efficient Algorithm for Large-Scale Discriminant Analysis

On Discriminative Semi-Supervised Classification.

Semi-supervised Orthogonal Discriminant Analysis Via Label Propagation

Latent Fisher Discriminant Analysis

Linear Sequence Discriminant Analysis: A Model-Based Dimensionality Reduction Method for Vector Sequences

Adaptive Local Linear Discriminant Analysis