Abstract:Discriminant analysis (DA) is a well-known dimensionality reduction tool in pattern classification. With enough efficient labeled samples, the optimal projections could be found by maximizing the between-class scatter variance meanwhile minimizing the within-class scatter variance. However, the acquisition of label information is difficult in practice. So, semi-supervised discriminant analysis has attracted much attention in recent years, where both few labeled samples and many unlabeled samples are utilized during learning process. Sparse graph learned by sparse representation contains local structure information about data and is widely employed in dimensionality reduction. In this paper, semi-supervised double sparse graphs (sDSG) based dimensionality reduction is proposed, which considers both the positive and negative structure relationship of data points by using double sparse graphs. Aiming to explore the discriminant information among unlabeled samples, joint k nearest neighbor selection strategy is proposed to select pseudo-labeled samples which contain some precise discriminant information. In the following procedures, the data subset consisting of labeled samples and pseudo-labeled samples are used instead of the original data. Based on two different criterions, two sDSG based discriminant analysis methods are designed and denoted by sDSG-dDA (distance-based DA) and sDSG-rDA (reconstruction-based DA), which also use different strategies to reduce the effect of pseudo-labels’ inaccuracy. Finally, the experimental results both on UCI datasets and hyperspectral images validate the effectiveness and advantage of the proposed methods compared with some classical dimensionality reduction methods.

A Semi-Supervised Sparsity Discriminant Analysis Algorithm for Feature Extraction

Semi-supervised double sparse graphs based discriminant analysis for dimensionality reduction

Beyond the Graphs: Semi-Parametric Semi-Supervised Discriminant Analysis

Graph-Based Semi-supervised Feature Selection with Application to Automatic Spam Image Identification

A New Graph Constructor for Semi-supervised Discriminant Analysis Via Group Sparsity.

A Semi-supervised Method for Feature Selection

Optimal Feature Selection for Sparse Linear Discriminant Analysis and Its Applications in Gene Expression Data

Semi-supervised Discriminant Analysis Based on Sparse-Coding Theory

Structured Optimal Graph Based Sparse Feature Extraction for Semi-Supervised Learning

Learning Semi-Riemannian Metrics for Semisupervised Feature Extraction

Unsupervised feature extraction by low-rank and sparsity preserving embedding

A Novel Semi-Supervised Feature Extraction Algorithm

Adaptive Discriminant Analysis for Semi-Supervised Feature Selection.

Sparse Two-Dimensional Local Discriminant Projections for Feature Extraction

Local Adaptive Learning for Semi-Supervised Feature Selection with Group Sparsity

Graph-Oriented Learning via Automatic Group Sparsity for Data Analysis

Local Sparse Discriminative Feature Selection

Discriminative sparse embedding based on adaptive graph for dimension reduction

A Novel Graph Constructor for Semisupervised Discriminant Analysis

Semi-supervised Discriminant Analysis Using Adaptive Neighbor Selection and Low-rank Representation

Joint Adaptive Graph Learning and Discriminative Analysis for Unsupervised Feature Selection