Abstract:Background Running multiple-chain Markov Chain Monte Carlo (MCMC) provides an efficient parallel computing method for complex Bayesian models, although the efficiency of the approach critically depends on the length of the non-parallelizable burn-in period, for which all simulated data are discarded. In practice, this burn-in period is set arbitrarily and often leads to the performance of far more iterations than required. In addition, the accuracy of genomic predictions does not improve after the MCMC reaches equilibrium. Results Automatic tuning of the burn-in length for running multiple-chain MCMC was proposed in the context of genomic predictions using BayesA and BayesCπ models. The performance of parallel computing versus sequential computing and tunable burn-in MCMC versus fixed burn-in MCMC was assessed using simulation data sets as well by applying these methods to genomic predictions of a Chinese Simmental beef cattle population. The results showed that tunable burn-in parallel MCMC had greater speedups than fixed burn-in parallel MCMC, and both had greater speedups relative to sequential (single-chain) MCMC. Nevertheless, genomic estimated breeding values (GEBVs) and genomic prediction accuracies were highly comparable between the various computing approaches. When applied to the genomic predictions of four quantitative traits in a Chinese Simmental population of 1217 beef cattle genotyped by an Illumina Bovine 770 K SNP BeadChip, tunable burn-in multiple-chain BayesCπ (TBM-BayesCπ) outperformed tunable burn-in multiple-chain BayesCπ (TBM-BayesA) and Genomic Best Linear Unbiased Prediction (GBLUP) in terms of the prediction accuracy, although the differences were not necessarily caused by computational factors and could have been intrinsic to the statistical models per se. Conclusions Automatically tunable burn-in multiple-chain MCMC provides an accurate and cost-effective tool for high-performance computing of Bayesian genomic prediction models, and this algorithm is generally applicable to high-performance computing of any complex Bayesian statistical model.

Bayesian cross-validation by parallel Markov chain Monte Carlo

Efficient, adaptive cross-validation for tuning and comparing models, with application to drug discovery

Efficient Selection Between Hierarchical Cognitive Models: Cross-validation With Variational Bayes

Bayesian nonparametric cross-study validation of prediction methods

Parallel cross-validation: A scalable fitting method for Gaussian process models

Bayesian cross-validation of geostatistical models

Is K-fold cross validation the best model selection method for Machine Learning?

Fast genomic prediction of breeding values using parallel Markov chain Monte Carlo with convergence diagnosis

Cross-validatory model selection for Bayesian autoregressions with exogenous regressors

Cross-validation coordinate analysis (CVCA): performing coordinate based meta-analysis using cross-validation

Is Cross-Validation the Gold Standard to Evaluate Model Performance?

Orthogonal parallel MCMC methods for sampling and optimization

Approximate Cross-validated Mean Estimates for Bayesian Hierarchical Regression Models

Cross-Validation for Nonlinear Mixed Effects Models

Parallelization of adaptive Bayesian cubature using multimodal optimization algorithms

Efficient leave-one-out cross-validation for Bayesian non-factorized normal and Student-t models

Bootstrap Cross-validation Improves Model Selection in Pharmacometrics

Bootstrapping the Out-of-sample Predictions for Efficient and Accurate Cross-Validation

Parallel and interacting Markov chains Monte Carlo method

Blocked Cross-Validation: A Precise and Efficient Method for Hyperparameter Tuning

Cross-validation in high-dimensional spaces: a lifeline for least-squares models and multi-class LDA