Abstract:Dimension reduction is an important topic in pattern analysis and machine learning, and it has wide applications in feature representation and pattern classification. In the past two decades, sliced inverse regression (SIR) has attracted much research efforts due to its effectiveness and efficacy in dimension reduction. However, two drawbacks limit further applications of SIR. First, the computation complexity of SIR is usually high in the situation of high-dimensional data. Second, sparsity of projection subspace is not well mined for improving the feature selection and model interpretation abilities. This paper proposes to compute the SIR projection vectors in the spectral space, then an approximated regression solution can be obtained with a faster speed. Moreover, the adaptive lasso is used to attain a sparse and globally optimal solution, which is important in variable selection. To complete the robust pattern classification task with corruptions, a correntropy-based and class-wise regression model is designed in this paper. It takes a smooth penalty instead of sparsity constraint in the regression coefficients, and it can be conducted in class-wise, thus it is more flexible in practice. Extensive experiments are conducted by using some real and benchmark data sets, e.g., high-dimensional facial images and gene microarray data, to evaluate the new algorithms. The new proposals attain competitive results and are compared with other state-of-the-art methods.

On the Structural Dimension of Sliced Inverse Regression

On the Optimality of Sliced Inverse Regression in High Dimensions

On Sliced Inverse Regression with High-Dimensional Covariates

On Consistency and Sparsity for Sliced Inverse Regression in High Dimensions

Slicing-free Inverse Regression in High-dimensional Sufficient Dimension Reduction

On the Optimality of Functional Sliced Inverse Regression

On Spline Approximation of Sliced Inverse Regression

A Note on Sliced Inverse Regression with Missing Predictors.

Sliced Inverse Regression with Adaptive Spectral Sparsity for Dimension Reduction.

Sparse Sliced Inverse Regression Via Lasso

Minimax Rates of Convergence for Sliced Inverse Regression with Differential Privacy

High Dimensional Elliptical Sliced Inverse Regression in non-Gaussian Distributions

Asymptotics for Kernel Estimate of Sliced Inverse Regression

Online Sufficient Dimension Reduction Through Sliced Inverse Regression.

A Quasi-Residuals Method in Sliced Inverse Regression

Asymptotics of Sliced Inverse Regression

Supplementary Material for “Slicing-free Inverse Regression in High-dimensional Sufficient Dimension Reduction”

Sparse sliced inverse regression for high dimensional data analysis

Sliced Coordinate Analysis for Effective Dimension Reduction and Nonlinear Extensions

On cumulative slicing estimation for high dimensional data

A convex formulation for high-dimensional sparse sliced inverse regression