Abstract:Sparse linear discriminant analysis (LDA) is a popular machine learning method that improves the accuracy of data classification by introducing sparsity. However, its performance often degrades seriously when encountering noise. To address this issue, this paper proposes a new method called efficient and robust sparse linear discriminant analysis (ERSLDA). The core idea is to characterize the local pixel corruptions by integrating $L_{p}$ -norm $(0< p< 1)$ , and to describe the global structured sparsity by enforcing $L_{2,p}$ -norm $(0< p< 1)$ , thereby improving the ability of feature selection. Compared with existing $L_{1}$ -norm and $L_{2,1}$ -norm, the involved $L_{p}$ -norm and $L_{2,p}$ -norm can bring higher robustness and better accuracy. Moreover, an additional matrix with Frobenius norm is embedded to represent Gaussian noise, which further enhances the robustness in different scenarios. In algorithms, an iterative optimization scheme is developed based on the alternating direction method of multipliers (ADMM) to solve the proposed ERSLDA, and the resulting subproblems can be calculated efficiently. Extensive numerical comparisons are performed with nine state-of-the-art LDA-based methods on seven benchmark image datasets. The experimental results validate that the proposed method is efficient for data classification and robust to noise.

Feature selection based on LDA for semantic image classification

CLDA: Feature Selection for Text Categorization Based on Constrained LDA

Optimal Feature Selection for Sparse Linear Discriminant Analysis and Its Applications in Gene Expression Data

Face Recognition Using Novel LDA-Based Algorithms.

Salient Feature Selection for Visual Concept Learning

By Normalizing To Improve Generalized Foley-Sammon Transform In High-Dimensional Spaces-----With Application To Face Recognition

Boosting Image Classification with LDA-based Feature Combination for Digital Photograph Management

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Feature selection for image categorization

An Efficient Semantic Image Classification Method

Feature Extraction and Selection Hybrid Algorithm for Hyperspectral Imagery Classification

Optimal Dimensionality Discriminant Analysis and Its Application to Image Recognition

Feature Extraction By Locality-Based Linear Discriminant Analysis

Constrained Linear Discrimination Analysis and Face Recognition

Efficient Feature Extraction For Image Classification

Discriminant Local Feature Analysis of Facial Images

A Joint Learning Framework for Optimal Feature Extraction and Multi-class SVM

A NEW ALGORITHM FOR COMPUTING OPTIMAL DISCRIMINANT VECTORS IN CONDITION OF HIGH-DIMENSIONAL DATA

Efficient and Robust Sparse Linear Discriminant Analysis for Data Classification

Fast Human Detection Using LDA via L1-Norm

Sparse Trace Ratio LDA for Supervised Feature Selection