Abstract:Sliced inverse regression (SIR, Li 1991) is a pioneering work and the most recognized method in sufficient dimension reduction. While promising progress has been made in theory and methods of high-dimensional SIR, two remaining challenges are still nagging high-dimensional multivariate applications. First, choosing the number of slices in SIR is a difficult problem, and it depends on the sample size, the distribution of variables, and other practical considerations. Second, the extension of SIR from univariate response to multivariate is not trivial. Targeting at the same dimension reduction subspace as SIR, we propose a new slicing-free method that provides a unified solution to sufficient dimension reduction with high-dimensional covariates and univariate or multivariate response. We achieve this by adopting the recently developed martingale difference divergence matrix (MDDM, Lee & Shao 2018) and penalized eigen-decomposition algorithms. To establish the consistency of our method with a high-dimensional predictor and a multivariate response, we develop a new concentration inequality for sample MDDM around its population counterpart using theories for U-statistics, which may be of independent interest. Simulations and real data analysis demonstrate the favorable finite sample performance of the proposed method.

On Dimension Reduction in Regressions with Multivariate Responses

Dimension reduction in binary response regression: A joint modeling approach

A Principal Square Response Forward Regression Method for Dimension Reduction

On efficient dimension reduction with respect to the interaction between two response variables

A selective review of sufficient dimension reduction for multivariate response regression

Real-valued Multivariate Dimension Reduction: A Survey

On partial sufficient dimension reduction with applications to partially linear multi-index models

Flexible Dimension Reduction in Regression

Functional sufficient dimension reduction through distance covariance

Sliced Regression for Dimension Reduction

On Sliced Inverse Regression with High-Dimensional Covariates

A New Estimator for Efficient Dimension Reduction in Regression.

Semiparametric Efficient Dimension Reduction in multivariate regression with an Inner Envelope

Estimating a Sparse Reduction for General Regression in High Dimensions

Sufficient dimension reduction for regression with metric space-valued responses

Dimension Reduction for Functional Regression with a Binary Response

Slicing-free Inverse Regression in High-dimensional Sufficient Dimension Reduction

Sparse sufficient dimension reduction using optimal scoring.

Dimension reduction with missing response at random

Dimension reduction for covariates in network data

A high-dimensional single-index regression for interactions between treatment and covariates