Abstract:It contains the proofs of the main results in this paper and additional simulation results. In this work, we propose a scalable Bayesian procedure for learning the local dependence structure in a high-dimensional model where the variables possess a natural ordering. The ordering of variables can be indexed by time, the vicinities of spatial locations, and so on, with the natural assumption that variables far apart tend to have weak correlations. Applications of such models abound in a variety of fields such as finance, genome associations analysis and spatial modeling. We adopt a flexible framework under which each variable is dependent on its neighbors or predecessors, and the neighborhood size can vary for each variable. It is of great interest to reveal this local dependence structure by estimating the covariance or precision matrix while yielding a consistent estimate of the varying neighborhood size for each variable. The existing literature on banded covariance matrix estimation, which assumes a fixed bandwidth cannot be adapted for this general setup. We employ the modified Cholesky decomposition for the precision matrix and design a flexible prior for this model through appropriate priors on the neighborhood sizes and Cholesky factors. The posterior contraction rates of the Cholesky factor are derived which are nearly or exactly minimax optimal, and our procedure leads to consistent estimates of the neighborhood size for all the variables. Another appealing feature of our procedure is its scalability to models with large numbers of variables due to efficient posterior inference without resorting to MCMC algorithms. Numerical comparisons are carried out with competitive methods, and applications are considered for some real datasets.

Learning A Flexible K-Dependence Bayesian Classifier from the Chain Rule of Joint Probability Distribution

Learning Cluster Causal Diagrams: an Information-Theoretic Approach

Efficient Heuristics for Structure Learning of k -Dependence Bayesian Classifier.

General and Local: Averaged K-Dependence Bayesian Classifiers

Exploiting the Implicit Independence Assumption for Learning Directed Graphical Models.

K-Dependence Bayesian Classifier Ensemble

Bagging K-Dependence Bayesian Network Classifiers

Semi-supervised Learning for K-Dependence Bayesian Classifiers

Discriminative Structure Learning of Bayesian Network Classifiers from Training Dataset and Testing Instance.

A Novel Approach to Fully Representing the Diversity in Conditional Dependencies for Learning Bayesian Network Classifier

Learning Based K-Dependence Bayesian Classifiers

A Double Layer Bayesian Classifier Using Conditional Mutual Information

Applying functional dependencies to improve the performance and robustness of hidden naive bayes

Scalable Bayesian High-dimensional Local Dependence Learning

Efficient heuristics for learning scalable Bayesian network classifier from labeled and unlabeled data

Learning High-Dependence Bayesian Network Classifier with Robust Topology

Enhancing multi-label classification by modeling dependencies among labels.

Learning Nt Bayesian Classifier Based On Canonical Cover Analysis Of Relational Database

A fast Multi-network K-dependence Bayesian classifier for continuous features

Structure Learning of Bayesian Network Based on Adaptive Thresholding

Hierarchical Independence Thresholding for Learning Bayesian Network Classifiers.