Abstract:Dimension reduction is an important topic in pattern analysis and machine learning, and it has wide applications in feature representation and pattern classification. In the past two decades, sliced inverse regression (SIR) has attracted much research efforts due to its effectiveness and efficacy in dimension reduction. However, two drawbacks limit further applications of SIR. First, the computation complexity of SIR is usually high in the situation of high-dimensional data. Second, sparsity of projection subspace is not well mined for improving the feature selection and model interpretation abilities. This paper proposes to compute the SIR projection vectors in the spectral space, then an approximated regression solution can be obtained with a faster speed. Moreover, the adaptive lasso is used to attain a sparse and globally optimal solution, which is important in variable selection. To complete the robust pattern classification task with corruptions, a correntropy-based and class-wise regression model is designed in this paper. It takes a smooth penalty instead of sparsity constraint in the regression coefficients, and it can be conducted in class-wise, thus it is more flexible in practice. Extensive experiments are conducted by using some real and benchmark data sets, e.g., high-dimensional facial images and gene microarray data, to evaluate the new algorithms. The new proposals attain competitive results and are compared with other state-of-the-art methods.

Sliced Regression for Dimension Reduction

Flexible Dimension Reduction in Regression

Slicing-free Inverse Regression in High-dimensional Sufficient Dimension Reduction

Online Sufficient Dimension Reduction Through Sliced Inverse Regression.

On Sliced Inverse Regression with High-Dimensional Covariates

Sliced Coordinate Analysis for Effective Dimension Reduction and Nonlinear Extensions

DIMENSION REDUCTION VIA ADAPTIVE SLICING

Data-driven slicing for dimension reduction in regressions: A likelihood-ratio approach

A Linear Discriminant Analysis model based on Sliced Inverse Regression lifting

Dimension Reduction in Regressions Through Weighted Variance Estimation

Statistica Sinica Preprint No : SS-2016-0080 R 3 Title Flexible dimension reduction in regression

A Slicing‐Free Perspective to Sufficient Dimension Reduction: Selective Review and Recent Developments

Sliced Inverse Regression with Adaptive Spectral Sparsity for Dimension Reduction.

Online Kernel Sliced Inverse Regression

Dimension Reduction in Regressions Through Cumulative Slicing Estimation

On expectile-assisted inverse regression estimation for sufficient dimension reduction

Kernel dimension reduction in regression

Dimension Reduction for Functional Regression with a Binary Response

A convex formulation for high-dimensional sparse sliced inverse regression

On Spline Approximation of Sliced Inverse Regression

Supplementary Material for “Slicing-free Inverse Regression in High-dimensional Sufficient Dimension Reduction”