Abstract:Sufficient dimension reduction (SDR) is a popular class of regression methods which aim to find a small number of linear combinations of covariates that capture all the information of the responses i.e., a central subspace. The majority of current methods for SDR focus on the setting of independent observations, while the few techniques that have been developed for clustered data assume the linear transformation is identical across clusters. In this article, we introduce random effects SDR, where cluster-specific random effect central subspaces are assumed to follow a distribution on the Grassmann manifold, and the random effects distribution is characterized by a covariance matrix that captures the heterogeneity between clusters in the SDR process itself. We incorporate random effect SDR within a model-based inverse regression framework. Specifically, we propose a random effects principal fitted components model, where a two-stage algorithm is used to estimate the overall fixed effect central subspace, and predict the cluster-specific random effect central subspaces. We demonstrate the consistency of the proposed estimators, while simulation studies demonstrate the superior performance of the proposed approach compared to global and cluster-specific SDR approaches. We also present extensions of the above model to handle mixed predictors, demonstrating how random effects SDR can be achieved in the case of mixed continuous and binary covariates. Applying the proposed methods to study the longitudinal association between the life expectancy of women and socioeconomic variables across 117 countries, we find log income per capita, infant mortality, and income inequality are the main drivers of a two-dimensional fixed effect central subspace, although there is considerable heterogeneity in how the country-specific central subspaces are driven by the predictors.

An Estimating Equation Approach to Dimension Reduction for Longitudinal Data.

Missing Data Analysis with Sufficient Dimension Reduction

Nonparametric Estimation of Mean and Covariance Structures for Longitudinal Data

A New Estimator for Efficient Dimension Reduction in Regression.

A New Nested Cholesky Decomposition and Estimation for the Covariance Matrix of Bivariate Longitudinal Data

Dimension Reduction Estimation for Central Mean Subspace with Missing Multivariate Response.

Decorrelated Empirical Likelihood for Generalized Linear Models with High-Dimensional Longitudinal Data

Functional sufficient dimension reduction through distance covariance

New Semiparametric Estimation Procedure for Functional Coefficient Longitudinal Data Models

Analysis of Longitudinal Data by Combining Multiple Dynamic Covariance Models

Efficient Dimension Reduction for Multivariate Response Data.

Semiparametric Mean–Covariance Regression Analysis for Longitudinal Data

Robust Approach for Variable Selection with High Dimensional Longitudinal Data Analysis

Random effects model-based sufficient dimension reduction for independent clustered data

Impact of Sufficient Dimension Reduction in Nonparametric Estimation of Causal Effect

A Semiparametric Approach to Dimension Reduction

On Estimating Regression-Based Causal Effects Using Sufficient Dimension Reduction

On partial sufficient dimension reduction with applications to partially linear multi-index models

Estimating a Sparse Reduction for General Regression in High Dimensions

Robust Estimating Equation-Based Sufficient Dimension Reduction.

A Constructive Approach to the Estimation of Dimension Reduction Directions