Abstract:Dimension reduction is an important topic in pattern analysis and machine learning, and it has wide applications in feature representation and pattern classification. In the past two decades, sliced inverse regression (SIR) has attracted much research efforts due to its effectiveness and efficacy in dimension reduction. However, two drawbacks limit further applications of SIR. First, the computation complexity of SIR is usually high in the situation of high-dimensional data. Second, sparsity of projection subspace is not well mined for improving the feature selection and model interpretation abilities. This paper proposes to compute the SIR projection vectors in the spectral space, then an approximated regression solution can be obtained with a faster speed. Moreover, the adaptive lasso is used to attain a sparse and globally optimal solution, which is important in variable selection. To complete the robust pattern classification task with corruptions, a correntropy-based and class-wise regression model is designed in this paper. It takes a smooth penalty instead of sparsity constraint in the regression coefficients, and it can be conducted in class-wise, thus it is more flexible in practice. Extensive experiments are conducted by using some real and benchmark data sets, e.g., high-dimensional facial images and gene microarray data, to evaluate the new algorithms. The new proposals attain competitive results and are compared with other state-of-the-art methods.

On Consistency and Sparsity for Sliced Inverse Regression in High Dimensions

On Sliced Inverse Regression with High-Dimensional Covariates

On the Structural Dimension of Sliced Inverse Regression

On the Optimality of Sliced Inverse Regression in High Dimensions

Sparse Sliced Inverse Regression Via Lasso

Slicing-free Inverse Regression in High-dimensional Sufficient Dimension Reduction

Sliced Inverse Regression with Adaptive Spectral Sparsity for Dimension Reduction.

Sparse sliced inverse regression for high dimensional data analysis

On Spline Approximation of Sliced Inverse Regression

On the Optimality of Functional Sliced Inverse Regression

High Dimensional Elliptical Sliced Inverse Regression in non-Gaussian Distributions

A Quasi-Residuals Method in Sliced Inverse Regression

Asymptotics for Kernel Estimate of Sliced Inverse Regression

Asymptotics of Sliced Inverse Regression

On cumulative slicing estimation for high dimensional data

A Note on Sliced Inverse Regression with Missing Predictors.

Sliced Coordinate Analysis for Effective Dimension Reduction and Nonlinear Extensions

Minimax Rates of Convergence for Sliced Inverse Regression with Differential Privacy

A convex formulation for high-dimensional sparse sliced inverse regression

A Simple Approach to Online Sparse Sliced Inverse Regression

SPARSE SIR: OPTIMAL RATES AND ADAPTIVE ESTIMATION