Abstract:Linear Discriminant Analysis (LDA) is one of the most successful supervised dimensionality reduction methods and has been widely used in many real-world applications. However, l(2)-norm is employed as the distance metric in the objective of LDA, which is sensitive to outliers. Many previous works improve the robustness of LDA by using l(1)-norm distance. However, the robustness against outliers is limited and the solver of l(1)-norm is mostly based on the greedy search strategy, which is time-consuming and easy to get stuck in a local optimum. In this paper, we propose a novel robust LDA measured by l(2,1)-norm to learn robust discriminative projections. The proposed model is challenging to solve since it needs to minimize and maximize (minmax) l(2,1)-norm terms simultaneously. As a result, we first systematically derive an efficient iterative optimization algorithm to solve a general ratio minimization problem, and then rigorously prove its convergence. More importantly, an alternately non-greedy iterative re-weighted optimization algorithm is developed based on the preceding approach for solving proposed l(2,1)-norm minmax problem. Besides, an optimal weighted mean mechanism is driven according to the designed objective and solver, which can be applied to other approaches for robustness improvement. Experimental results on several real-world datasets show the effectiveness of proposed method.

L1-Norm Kernel Discriminant Analysis Via Bayes Error Bound Optimization for Robust Feature Extraction

An Improved Linear Discriminant Analysis with L1-Norm for Robust Feature Extraction

Robust L1-norm two-dimensional linear discriminant analysis.

Robust Linear Discriminant Analysis Using Ratio Minimization of L1,2-Norms

Robust Bhattacharyya bound linear discriminant analysis through adaptive algorithm

L1-norm discriminant analysis via Bhattacharyya errorbounds under Laplace distributions

Adaptive quasiconformal kernel discriminant analysis

Robust and Efficient Linear Discriminant Analysis With L2, 1-Norm for Feature Selection

Towards Robust Discriminative Projections Learning via Non-Greedy <i>l</i><sub>2,1</sub>-Norm MinMax

L1-Norm Distance Linear Discriminant Analysis Based on an Effective Iterative Algorithm.

A New Formulation of Linear Discriminant Analysis for Robust Dimensionality Reduction

Adaptive Quasiconformal Kernel Fisher Discriminant Analysis Via Weighted Maximum Margin Criterion

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Robust and Efficient Linear Discriminant Analysis With <italic>L</italic><sub>2,1</sub>-Norm for Feature Selection

Fisher Discriminant Analysis with L1-Norm

Robust kernel discriminant analysis and its application to feature extraction and recognition

Probabilistic Linear Discriminant Analysis Based on L 1 -Norm and Its Bayesian Variational Inference

Robust Bilateral Lp-norm Two-Dimensional Linear Discriminant Analysis

Nonpeaked Discriminant Analysis for Data Representation.

L2,1-Norm Regularized Robust and Sparse Linear Discriminant Analysis via an Alternating Direction Method of Multipliers

Robust discriminant feature selection via joint L2,1-norm distance minimization and maximization