Abstract:Sliced inverse regression (SIR, Li 1991) is a pioneering work and the most recognized method in sufficient dimension reduction. While promising progress has been made in theory and methods of high-dimensional SIR, two remaining challenges are still nagging high-dimensional multivariate applications. First, choosing the number of slices in SIR is a difficult problem, and it depends on the sample size, the distribution of variables, and other practical considerations. Second, the extension of SIR from univariate response to multivariate is not trivial. Targeting at the same dimension reduction subspace as SIR, we propose a new slicing-free method that provides a unified solution to sufficient dimension reduction with high-dimensional covariates and univariate or multivariate response. We achieve this by adopting the recently developed martingale difference divergence matrix (MDDM, Lee & Shao 2018) and penalized eigen-decomposition algorithms. To establish the consistency of our method with a high-dimensional predictor and a multivariate response, we develop a new concentration inequality for sample MDDM around its population counterpart using theories for U-statistics, which may be of independent interest. Simulations and real data analysis demonstrate the favorable finite sample performance of the proposed method.

DIMENSION REDUCTION VIA ADAPTIVE SLICING

Data-driven slicing for dimension reduction in regressions: A likelihood-ratio approach

Sliced Regression for Dimension Reduction

Flexible Dimension Reduction in Regression

Slicing-free Inverse Regression in High-dimensional Sufficient Dimension Reduction

A Slicing‐Free Perspective to Sufficient Dimension Reduction: Selective Review and Recent Developments

Projective Resampling Functional Sliced Inverse Regression

Sliced Coordinate Analysis for Effective Dimension Reduction and Nonlinear Extensions

On Sliced Inverse Regression with High-Dimensional Covariates

SLICING DATA PROCESSING AND GLOBAL OPTIMIZATION OF FEATURE CURVE IN REVERSE ENGINEERING

On the Optimality of Functional Sliced Inverse Regression

Dimension Reduction for Functional Regression with a Binary Response

A Linear Discriminant Analysis model based on Sliced Inverse Regression lifting

On the Structural Dimension of Sliced Inverse Regression

On the Optimality of Sliced Inverse Regression in High Dimensions

Sparse sliced inverse regression for high dimensional data analysis

SPARSE SIR: OPTIMAL RATES AND ADAPTIVE ESTIMATION

On cumulative slicing estimation for high dimensional data

Dimension Reduction in Regressions Through Cumulative Slicing Estimation

Slice Weighted Average Regression

Online Kernel Sliced Inverse Regression