Abstract:Background: Microarray technology is widely used in cancer diagnosis. Successfully identifying gene biomarkers will significantly help to classify different cancer types and improve the prediction accuracy. The regularization approach is one of the effective methods for gene selection in microarray data, which generally contain a large number of genes and have a small number of samples. In recent years, various approaches have been developed for gene selection of microarray data. Generally, they are divided into three categories: filter, wrapper and embedded methods. Regularization methods are an important embedded technique and perform both continuous shrinkage and automatic gene selection simultaneously. Recently, there is growing interest in applying the regularization techniques in gene selection. The popular regularization technique is Lasso (L-1), and many L-1 type regularization terms have been proposed in the recent years. Theoretically, the Lq type regularization with the lower value of q would lead to better solutions with more sparsity. Moreover, the L-1/2 regularization can be taken as a representative of Lq (0 < q < 1) regularizations and has been demonstrated many attractive properties.Results: In this work, we investigate a sparse logistic regression with the L-1/2 penalty for gene selection in cancer classification problems, and propose a coordinate descent algorithm with a new univariate half thresholding operator to solve the L-1/2 penalized logistic regression. Experimental results on artificial and microarray data demonstrate the effectiveness of our proposed approach compared with other regularization methods. Especially, for 4 publicly available gene expression datasets, the L-1/2 regularization method achieved its success using only about 2 to 14 predictors (genes), compared to about 6 to 38 genes for ordinary L-1 and elastic net regularization approaches.Conclusions: From our evaluations, it is clear that the sparse logistic regression with the L-1/2 penalty achieves higher classification accuracy than those of ordinary L-1 and elastic net regularization approaches, while fewer but informative genes are selected. This is an important consideration for screening and diagnostic applications, where the goal is often to develop an accurate test using as few features as possible in order to control cost. Therefore, the sparse logistic regression with the L-1/2 penalty is effective technique for gene selection in real classification problems.

Optimal Feature Selection for Sparse Linear Discriminant Analysis and Its Applications in Gene Expression Data

CLDA: Feature Selection for Text Categorization Based on Constrained LDA

Understanding and Evaluating Sparse Linear Discriminant Analysis

Sparse linear discriminant analysis by thresholding for high dimensional data

Effective Discriminative Feature Selection with Nontrivial Solution

Robust and Efficient Linear Discriminant Analysis With L2, 1-Norm for Feature Selection

Sparse L1-norm-based linear discriminant analysis

Sparse Trace Ratio LDA for Supervised Feature Selection

Optimal Feature Selection in High-Dimensional Discriminant Analysis

Local Sparse Discriminative Feature Selection

Robust and Efficient Linear Discriminant Analysis With <italic>L</italic><sub>2,1</sub>-Norm for Feature Selection

Feature Selection Based on Sparse Fisher Discrimimant Analysis

Sparse maximum margin discriminant analysis for feature extraction and gene selection on gene expression data

Linear discriminant analysis based on genetic algorithm

Efficient Feature Selection via $\ell _{2, 0}$ℓ2, 0-norm Constrained Sparse Regression.

Sparse tensor discriminant analysis

Discriminative Feature Selection Via A Structured Sparse Subspace Learning Module

Sparse Logistic Regression with a L 1/2 Penalty for Gene Selection in Cancer Classification

A Direct Estimation Approach to Sparse Linear Discriminant Analysis

On the Relevance of Linear Discriminative Features