Abstract:It contains the proofs of the main results in this paper and additional simulation results. In this work, we propose a scalable Bayesian procedure for learning the local dependence structure in a high-dimensional model where the variables possess a natural ordering. The ordering of variables can be indexed by time, the vicinities of spatial locations, and so on, with the natural assumption that variables far apart tend to have weak correlations. Applications of such models abound in a variety of fields such as finance, genome associations analysis and spatial modeling. We adopt a flexible framework under which each variable is dependent on its neighbors or predecessors, and the neighborhood size can vary for each variable. It is of great interest to reveal this local dependence structure by estimating the covariance or precision matrix while yielding a consistent estimate of the varying neighborhood size for each variable. The existing literature on banded covariance matrix estimation, which assumes a fixed bandwidth cannot be adapted for this general setup. We employ the modified Cholesky decomposition for the precision matrix and design a flexible prior for this model through appropriate priors on the neighborhood sizes and Cholesky factors. The posterior contraction rates of the Cholesky factor are derived which are nearly or exactly minimax optimal, and our procedure leads to consistent estimates of the neighborhood size for all the variables. Another appealing feature of our procedure is its scalability to models with large numbers of variables due to efficient posterior inference without resorting to MCMC algorithms. Numerical comparisons are carried out with competitive methods, and applications are considered for some real datasets.

Scalable Bayesian regression in high dimensions with multiple data sources

Scalable Bayesian variable selection for structured high‐dimensional data

Bayesian High-dimensional Linear Regression with Sparse Projection-posterior

High-dimensional Grouped-regression using Bayesian Sparse Projection-posterior

Bayesian estimation for longitudinal data in a joint model with HPCs

Bayesian Function-on-Scalars Regression for High-Dimensional Data

High-dimensional Bayesian optimization using low-dimensional feature spaces

Adaptive Bayesian Regression on Data with Low Intrinsic Dimensionality

High-dimensional single-index Bayesian modeling of brain atrophy

Scalable Bayesian High-dimensional Local Dependence Learning

Two-Step Mixed-Type Multivariate Bayesian Sparse Variable Selection with Shrinkage Priors

Covariance Regression with High-Dimensional Predictors

A Nonparametric Bayesian Technique for High-Dimensional Regression

A generalized Bayesian approach for high-dimensional robust regression with serially correlated errors and predictors

Bayesian sparse multiple regression for simultaneous rank reduction and variable selection

Efficient Bayesian High-Dimensional Classification via Random Projection with Application to Gene Expression Data

Large-Scale Sparse Regression for Multiple Responses with Applications to UK Biobank

Nonparametric Covariance Regression for Massive Neural Data on Restricted Covariates via Graph

Prior-preconditioned conjugate gradient method for accelerated Gibbs sampling in "large $n$ & large $p$" Bayesian sparse regression

Ultra high-dimensional semiparametric longitudinal data analysis

Learning from a lot: Empirical Bayes in high-dimensional prediction settings