Abstract:Sliced inverse regression (SIR, Li 1991) is a pioneering work and the most recognized method in sufficient dimension reduction. While promising progress has been made in theory and methods of high-dimensional SIR, two remaining challenges are still nagging high-dimensional multivariate applications. First, choosing the number of slices in SIR is a difficult problem, and it depends on the sample size, the distribution of variables, and other practical considerations. Second, the extension of SIR from univariate response to multivariate is not trivial. Targeting at the same dimension reduction subspace as SIR, we propose a new slicing-free method that provides a unified solution to sufficient dimension reduction with high-dimensional covariates and univariate or multivariate response. We achieve this by adopting the recently developed martingale difference divergence matrix (MDDM, Lee & Shao 2018) and penalized eigen-decomposition algorithms. To establish the consistency of our method with a high-dimensional predictor and a multivariate response, we develop a new concentration inequality for sample MDDM around its population counterpart using theories for U-statistics, which may be of independent interest. Simulations and real data analysis demonstrate the favorable finite sample performance of the proposed method.

Dimension Reduction in Regressions Through Cumulative Slicing Estimation

Surrogate Dimension Reduction in Measurement Error Regressions

Sufficient Dimension Reduction in Regressions Through Cumulative Hessian Directions

On cumulative slicing estimation for high dimensional data

On Sliced Inverse Regression with High-Dimensional Covariates

Sufficient Dimension Reduction and Prediction Through Cumulative Slicing PFC

Sliced Regression for Dimension Reduction

Flexible Dimension Reduction in Regression

Dimension Reduction in Regressions Through Weighted Variance Estimation

Data-driven slicing for dimension reduction in regressions: A likelihood-ratio approach

Dimension reduction and predictor selection in semiparametric models

Online Sufficient Dimension Reduction Through Sliced Inverse Regression.

Slicing-free Inverse Regression in High-dimensional Sufficient Dimension Reduction

DIMENSION REDUCTION VIA ADAPTIVE SLICING

Dimension Reduction for Conditional Variance in Regressions

On expectile-assisted inverse regression estimation for sufficient dimension reduction

On Spline Approximation of Sliced Inverse Regression

A Slicing‐Free Perspective to Sufficient Dimension Reduction: Selective Review and Recent Developments

Estimating a Sparse Reduction for General Regression in High Dimensions

A New Estimator for Efficient Dimension Reduction in Regression.

An Estimating Equation Approach to Dimension Reduction for Longitudinal Data.