Abstract:In high-dimensional regression problems, often a relatively small subset of the features are relevant for predicting the outcome, and methods that impose sparsity on the solution are popular. When multiple correlated outcomes are available (multitask), reduced rank regression is an effective way to borrow strength and capture latent structures that underlie the data. Our proposal is motivated by the UK Biobank population-based cohort study, where we are faced with large-scale, ultrahigh-dimensional features, and have access to a large number of outcomes (phenotypes)-lifestyle measures, biomarkers, and disease outcomes. We are hence led to fit sparse reduced-rank regression models, using computational strategies that allow us to scale to problems of this size. We use a scheme that alternates between solving the sparse regression problem and solving the reduced rank decomposition. For the sparse regression component we propose a scalable iterative algorithm based on adaptive screening that leverages the sparsity assumption and enables us to focus on solving much smaller subproblems. The full solution is reconstructed and tested via an optimality condition to make sure it is a valid solution for the original problem. We further extend the method to cope with practical issues, such as the inclusion of confounding variables and imputation of missing values among the phenotypes. Experiments on both synthetic data and the UK Biobank data demonstrate the effectiveness of the method and the algorithm. We present multiSnpnet package, available at http://github.com/junyangq/multiSnpnet that works on top of PLINK2 files, which we anticipate to be a valuable tool for generating polygenic risk scores from human genetic studies.

[Introduction of Reduced Rank Regression and Development of a User-Written Stata Package].

RRR: Stata module to perform Reduced rank regression

Stability Approach to Regularization Selection for Reduced-Rank Regression

Dietary Patterns Derived from Reduced Rank Regression Are Associated with the 5-Year Occurrence of Metabolic Syndrome: Aichi Workers’ Cohort Study

Robust reduced-rank regression

Efficient and provable online reduced rank regression via online gradient descent

Robust Estimation of Multivariate Time Series Data Based on Reduced Rank Model

Reduced Rank Spatio-Temporal Models

Causal Interpretation of Regressions With Ranks

Implementing an Improved Test of Matrix Rank in Stata

Univariate Description and Bivariate Statistical Inference: the First Step Delving into Data

THE METHOD OF RANK-BASED ROBUST REGRESSION ANALYSIS

Low-rank kernel regression with preserved locality for multi-class analysis

Multivariate Spatiotemporal Models with Low Rank Coefficient Matrix

Leveraging Mixed and Incomplete Outcomes Via Reduced-Rank Modeling.

LARGE-SCALE MULTIVARIATE SPARSE REGRESSION WITH APPLICATIONS TO UK BIOBANK

Stable Reduced-Rank VAR Identification

Novel Robust Least-Squares Estimator for Linear Dynamic Data Reconciliation

Low-rank model with covariates for count data analysis

Reduced-Rank Spatio-Temporal Modeling of Air Pollution Concentrations in the Multi-Ethnic Study of Atherosclerosis and Air Pollution

Reduced-rank clustered coefficient regression for addressing multicollinearity in heterogeneous coefficient estimation