Abstract:Background: Microarray technology is widely used in cancer diagnosis. Successfully identifying gene biomarkers will significantly help to classify different cancer types and improve the prediction accuracy. The regularization approach is one of the effective methods for gene selection in microarray data, which generally contain a large number of genes and have a small number of samples. In recent years, various approaches have been developed for gene selection of microarray data. Generally, they are divided into three categories: filter, wrapper and embedded methods. Regularization methods are an important embedded technique and perform both continuous shrinkage and automatic gene selection simultaneously. Recently, there is growing interest in applying the regularization techniques in gene selection. The popular regularization technique is Lasso (L-1), and many L-1 type regularization terms have been proposed in the recent years. Theoretically, the Lq type regularization with the lower value of q would lead to better solutions with more sparsity. Moreover, the L-1/2 regularization can be taken as a representative of Lq (0 < q < 1) regularizations and has been demonstrated many attractive properties.Results: In this work, we investigate a sparse logistic regression with the L-1/2 penalty for gene selection in cancer classification problems, and propose a coordinate descent algorithm with a new univariate half thresholding operator to solve the L-1/2 penalized logistic regression. Experimental results on artificial and microarray data demonstrate the effectiveness of our proposed approach compared with other regularization methods. Especially, for 4 publicly available gene expression datasets, the L-1/2 regularization method achieved its success using only about 2 to 14 predictors (genes), compared to about 6 to 38 genes for ordinary L-1 and elastic net regularization approaches.Conclusions: From our evaluations, it is clear that the sparse logistic regression with the L-1/2 penalty achieves higher classification accuracy than those of ordinary L-1 and elastic net regularization approaches, while fewer but informative genes are selected. This is an important consideration for screening and diagnostic applications, where the goal is often to develop an accurate test using as few features as possible in order to control cost. Therefore, the sparse logistic regression with the L-1/2 penalty is effective technique for gene selection in real classification problems.

Linearized Bregman for l 1-regularized Logistic Regression

Bregman Distance to L1 Regularized Logistic Regression

On Regularized Sparse Logistic Regression

Sparse Kernel Logistic Regression Based on L 1/2 Regularization

A Improve Direct Path Seeking Algorithm for L1/2 Regularization, with Application to Biological Feature Selection

Sparse Logistic Regression with a L 1/2 Penalty for Gene Selection in Cancer Classification

A Tutorial on Libra: R package for the Linearized Bregman Algorithm in High Dimensional Statistics

A Safe Screening Rule for Sparse Logistic Regression

An Extended Newton-type Algorithm for $\ell_2$-Regularized Sparse Logistic Regression and Its Efficiency for Classifying Large-scale Datasets

Nonconvex Sparse Logistic Regression Via Proximal Gradient Descent.

A multilevel framework for sparse optimization with application to inverse covariance estimation and logistic regression

A Naïve Bayes Regularized Logistic Regression Estimator for Low-dimensional Classification

Regularized Multinomial Regression Method for Hyperspectral Data Classification Via Pathwise Coordinate Optimization

Nonconvex Sparse Logistic Regression with Weakly Convex Regularization

A Variance Minimization Criterion to Feature Selection Using Laplacian Regularization

A cut-and-project perspective for linearized Bregman iterations

Density-based logistic regression

Linear Discriminant Regularized Regression

Robust adaptive LASSO in high-dimensional logistic regression

Regularized Linear Regression for Binary Classification