Abstract:Although there is a rich literature on methods for allowing the variance in a univariate regression model to vary with predictors, time and other factors, relatively little has been done in the multivariate case. Our focus is on developing a class of nonparametric covariance regression models, which allow an unknown p x p covariance matrix to change flexibly with predictors. The proposed modeling framework induces a prior on a collection of covariance matrices indexed by predictors through priors for predictor-dependent loadings matrices in a factor model. In particular, the predictor-dependent loadings are characterized as a sparse combination of a collection of unknown dictionary functions (e.g, Gaussian process random functions). The induced covariance is then a regularized quadratic function of these dictionary elements. Our proposed framework leads to a highly-flexible, but computationally tractable formulation with simple conjugate posterior updates that can readily handle missing data. Theoretical properties are discussed and the methods are illustrated through simulations studies and an application to the Google Flu Trends data.

Bayesian estimation of variance factor in the nonlinear model

Generalized nonlinear models and variance function estimation

Varying Coefficient Partially Nonlinear Models with Nonstationary Regressors

Estimation of Variance and Covariance Components in the Nonlinear Model

Nonlinear Variational Bayesian Factor Regression for Inferential Sensor Modeling

Nonlinear Recursive Minimum Model Error Estimation

Stochastic Variational Bayesian Inference for a Nonlinear Forward Model

Bayesian Instrumental Variable Estimation in Linear Measurement Error Models

Bias-corrected Estimations in Varying-Coefficient Partially Nonlinear Models with Measurement Error in the Nonparametric Part

Proving Nonsingularity of Coefficient Matrix in Least Squares Normal Equation of Non-Linear Semiparametric Model

Exploiting Spike-and-Slab Prior for Variational Estimation of Nonlinear Systems

Estimation for the Linear Model with Uncertain Covariance Matrices

Estimation and Inference for Varying Coefficient Partially Nonlinear Errors-in-variables Models.

Sparse nonlinear regression: Parameter estimation and asymptotic inference

Estimating linear covariance models with numerical nonlinear algebra

Seemingly unrelated nonparametric models with positive correlation and constrained error variances

Joint estimation of mean-covariance model for longitudinal data with basis function approximations

Estimation and Inference for Varying Coefficient Partially Nonlinear Models

Bayes Estimates of Variance Components in Mixed Linear Model

A Best Linear Empirical Bayes Method for High-Dimensional Covariance Matrix Estimation

Bayesian Nonparametric Covariance Regression