Abstract:It contains the proofs of the main results in this paper and additional simulation results. In this work, we propose a scalable Bayesian procedure for learning the local dependence structure in a high-dimensional model where the variables possess a natural ordering. The ordering of variables can be indexed by time, the vicinities of spatial locations, and so on, with the natural assumption that variables far apart tend to have weak correlations. Applications of such models abound in a variety of fields such as finance, genome associations analysis and spatial modeling. We adopt a flexible framework under which each variable is dependent on its neighbors or predecessors, and the neighborhood size can vary for each variable. It is of great interest to reveal this local dependence structure by estimating the covariance or precision matrix while yielding a consistent estimate of the varying neighborhood size for each variable. The existing literature on banded covariance matrix estimation, which assumes a fixed bandwidth cannot be adapted for this general setup. We employ the modified Cholesky decomposition for the precision matrix and design a flexible prior for this model through appropriate priors on the neighborhood sizes and Cholesky factors. The posterior contraction rates of the Cholesky factor are derived which are nearly or exactly minimax optimal, and our procedure leads to consistent estimates of the neighborhood size for all the variables. Another appealing feature of our procedure is its scalability to models with large numbers of variables due to efficient posterior inference without resorting to MCMC algorithms. Numerical comparisons are carried out with competitive methods, and applications are considered for some real datasets.

Bayesian analysis of finite population sampling in multivariate co-exchangeable structures with separable covariance matric

Bayesian Analysis for Exponential Random Graph Models Using the Adaptive Exchange Sampler.

Bayesian variable selection in linear regression models with instrumental variables

Bayesian Uncertainty Estimation Under Complex Sampling

Separate Exchangeability as Modeling Principle in Bayesian Nonparametrics

Bayesian Grouping-Gibbs Sampling Estimation of High-dimensional Linear Model with Non-sparsity

Bayesian Nonparametric Weighted Sampling Inference

Bayesian Inference for Finite Populations Under Spatial Process Settings

Simultaneous Nonparametric Regression Analysis of Sparse Longitudinal Data

Scalable Bayes under Informative Sampling

Scalable Bayesian High-dimensional Local Dependence Learning

Bayesian estimation of cluster covariance matrices of unknown form

Sampling techniques for big data analysis in finite population inference

Bayesian inference on dependence in multivariate longitudinal data

Multinomial Models with Linear Inequality Constraints: Overview and Improvements of Computational Methods for Bayesian Inference

Bayesian Design with Sampling Windows for Complex Spatial Processes

On Separability of Covariance in Multiway Data Analysis

Simultaneous Inference for Multiple Proportions: A Multivariate Beta-Binomial Model

For high-dimensional hierarchical models, consider exchangeability of effects across covariates instead of across datasets

Bayesian analysis for finite mixture in non-recursive non-linear structural equation models.

On the principal components of sample covariance matrices