Abstract:Multivariate outcomes with multivariate features of possibly high dimension are routinely produced in various fields. In many real-world problems, the collected outcomes are of mixed types, including continuous measurements, binary indicators and counts, and a substantial proportion of values may also be missing. Regardless of their types, these mixed outcomes are often interrelated, representing diverse reflections or views of the same underlying data generation mechanism. As such, an integrative multivariate model can be beneficial. We develop a mixed-outcome reduced-rank regression, which effectively enables information sharing among different prediction tasks. Our approach integrates mixed and partially observed outcomes belonging to the exponential dispersion family, by assuming that all the outcomes are associated through a shared low-dimensional subspace spanned by the features. A general singular value regularized criterion is proposed, and we establish a non-asymptotic performance bound for the proposed estimators in the context of supervised learning with mixed outcomes from an exponential family and under a general sampling scheme of missing data. An iterative singular value thresholding algorithm is developed for optimization with convergence guarantee. The effectiveness of our approach is demonstrated by simulation studies and an application on predicting health-related outcomes in longitudinal studies of aging.

Reduced Rank Regression with Possibly Non-Smooth Criterion Functions: an Empirical Likelihood Approach.

Robust reduced-rank regression

Leveraging Mixed and Incomplete Outcomes Via Reduced-Rank Modeling.

Approximation of Rank Function and Its Application to the Nearest Low-Rank Correlation Matrix

Uncertainty Quantification in Bayesian Reduced-Rank Sparse Regressions

Reduced Rank Spatio-Temporal Models

Unified Low-Rank Matrix Estimate Via Penalized Matrix Least Squares Approximation

Robust reduced rank regression in a distributed setting

Adaptive estimation of the rank of the coefficient matrix in high dimensional multivariate response regression models

Empirical Likelihood Inference for Rank Regression with Doubly Truncated Data

Best Subset Selection in Reduced Rank Regression

A framework of regularized low-rank matrix models for regression and classification

Constrained Classification and Ranking via Quantiles

Sparse and Low-Rank Matrix Quantile Estimation with Application to Quadratic Regression

Smoothed Empirical Likelihood for Quantile Regression Models with Response Data Missing at Random

Multivariate Spatiotemporal Models with Low Rank Coefficient Matrix

Empirical likelihood-based weighted rank regression with missing covariates

Reduced Rank Multivariate Kernel Ridge Regression

Fast and Robust Low-Rank Learning over Networks: A Decentralized Matrix Quantile Regression Approach

A low-rank spectral method for learning Markov models

Smoothed quantile regression for partially functional linear models in high dimensions