Abstract:As one of the most popular supervised dimensionality reduction methods, linear discriminant analysis (LDA) has been widely studied in machine learning community and applied to many scientific applications. Traditional LDA minimizes the ratio of squared l2 norms, which is vulnerable to the adversarial examples. In recent studies, many l1 -norm-based robust dimensionality reduction methods are proposed to improve the robustness of model. However, due to the difficulty of l1 -norm ratio optimization and weakness on defending a large number of adversarial examples, so far, scarce works have been proposed to utilize sparsity-inducing norms for LDA objective. In this article, we propose a novel robust discriminative projections learning (rDPL) method based on the l1,2 -norm trace-ratio minimization optimization algorithm. Minimizing the l1,2 -norm ratio problem directly is a much more challenging problem than the traditional methods, and there is no existing optimization algorithm to solve such nonsmooth terms ratio problem. We derive a new efficient algorithm to solve this challenging problem and provide a theoretical analysis on the convergence of our algorithm. The proposed algorithm is easy to implement and converges fast in practice. Extensive experiments on both synthetic data and several real benchmark datasets show the effectiveness of the proposed method on defending the adversarial patch attack by comparison with many state-of-the-art robust dimensionality reduction methods.

Robust L1-norm two-dimensional linear discriminant analysis.

Robust Linear Discriminant Analysis Using Ratio Minimization of L1,2-Norms

L2,1-Norm Regularized Robust and Sparse Linear Discriminant Analysis via an Alternating Direction Method of Multipliers

L1-Norm Kernel Discriminant Analysis Via Bayes Error Bound Optimization for Robust Feature Extraction

Generalized two-dimensional linear discriminant analysis with regularization

L1-Norm Distance Linear Discriminant Analysis Based on an Effective Iterative Algorithm.

Robust Bhattacharyya bound linear discriminant analysis through adaptive algorithm

F ‐norm two‐dimensional linear discriminant analysis and its application on face recognition

Efficient and Robust Sparse Linear Discriminant Analysis for Data Classification

Robust sparse manifold discriminant analysis

Linear Discriminant Analysis Using Rotational Invariant L1 Norm

Two-Stage Regularized Linear Discriminant Analysis for 2-D Data.

Generalized robust linear discriminant analysis for jointly sparse learning

Toward Robust Discriminative Projections Learning Against Adversarial Patch Attacks

Robust DLPP With Nongreedy ℓ1-Norm Minimization and Maximization.

A Note on Two-Dimensional Linear Discriminant Analysis.

Robust L1-Norm Matrixed Locality Preserving Projection For Discriminative Subspace Learning

Separable Two-Dimensional Linear Discriminant Analysis

Regularized Deep Linear Discriminant Analysis

Linear Discriminant Regularized Regression

Constrained Linear Discrimination Analysis and Face Recognition