Abstract:This manuscript presents an approach to perform generalized linear regression with multiple high dimensional covariance matrices as the outcome. In many areas of study, such as resting-state functional magnetic resonance imaging (fMRI) studies, this type of regression can be utilized to characterize variation in the covariance matrices across units. Model parameters are estimated by maximizing a likelihood formulation of a generalized linear model, conditioning on a well-conditioned linear shrinkage estimator for multiple covariance matrices, where the shrinkage coefficients are proposed to be shared across matrices. Theoretical studies demonstrate that the proposed covariance matrix estimator is optimal achieving the uniformly minimum quadratic loss asymptotically among all linear combinations of the identity matrix and the sample covariance matrix. Under certain regularity conditions, the proposed estimator of the model parameters is consistent. The superior performance of the proposed approach over existing methods is illustrated through simulation studies. Implemented to a resting-state fMRI study acquired from the Alzheimer's Disease Neuroimaging Initiative, the proposed approach identified a brain network within which functional connectivity is significantly associated with Apolipoprotein E <i>ε</i>4, a strong genetic marker for Alzheimer's disease.

Regression based thresholds in principal loading analysis

A note on the variance in principal component regression

Principal Loading Analysis

Principal Components Analysis in Clinical Studies

Targeted principal components regression

On the number of variables to use in principal component regression

"Pre-conditioning" for feature selection and regression in high-dimensional problems

Principal Fitted Components for Dimension Reduction in Regression

Nonparametric Principal Subspace Regression

Principal regression for high dimensional covariance matrices

“Preconditioning” for feature selection and regression in high-dimensional problems

Dimension Reduction for Conditional Variance in Regressions

CANONICAL THRESHOLDING FOR NON-SPARSE HIGH-DIMENSIONAL LINEAR REGRESSION

Two-stage Variable Selection Method Based on Principal Basis Analysis

Testing a Single Regression Coefficient in High Dimensional Linear Models

Principal Components and Regularized Estimation of Factor Models

Prediction by supervised principal components

Testing a Single Regression Coefficient in High Dimensional Regression Model

Loading-Based Principal Component Selection for PCA Integrated with Support Vector Data Description

Multivariate Regression Shrinkage and Selection by Canonical Correlation Analysis

A Note on the Use of Principal Components in Regression