Abstract:Bayesian inference plays a pivotal role in optimizing reaction kinetics models, with Markov Chain Monte Carlo (MCMC) methods being a critical implementation. However, MCMC is constrained with low acceptance rates in high-dimensional scenarios. Conversely, Hamiltonian Monte Carlo (HMC) has high acceptance rates, albeit at the expense of computing first-order log-posterior gradients, thus limiting its application in model optimization. This study introduces an Artificial Neural Network-based HMC (ANNHMC) approach, wherein gradient computation is accelerated through automatic differentiation. Unlike previous models that depend on early HMC samples for training surrogate models to predict the Hamiltonian, our ANNHMC employs prediction samples for training an ANN. This ANN predicts targets used in the Hamiltonian computation, hence significantly streamlines the training process. The experimental data of ignition delay time and laminar flame velocity are utilized to optimize the methanol, ammonia and JetSurF1.0 models. The optimization results show that ANNHMC outperforms ANN-MCMC, enhancing the sampling efficiency by three to four orders of magnitude after neural network training. Additionally, we investigate the influence of active parameter selection on model optimization under uncertainty constraints. The global sensitivity analysis typically identifies fewer total parameters than the local sensitivity analysis, resulting in more stringent parameter constraints. This can amplify the sampling challenge for ANNHMC as some parameters approach boundary limits, thereby increasing the overall sampling time. In addition, more stringent parameter constraints may potentially limit the model performance on the optimization dataset. Appropriately increasing the number of active parameters can improve the model prediction accuracy, while maintaining prediction uncertainty within the limits of experimental uncertainty. The ANNHMC demonstrates its unique advantages in reaction kinetics model optimization.

Bayesian estimation of realized stochastic volatility model by Hybrid Monte Carlo algorithm

Estimation of risk contributions with MCMC

Complex-valued Bayesian parameter estimation via Markov chain Monte Carlo

Efficient History Matching Using the Markov-Chain Monte Carlo Method by Means of the Transformed Adaptive Stochastic Collocation Method

"Parallel-Tempering"-Assisted Hybrid Monte Carlo Algorithm For Bayesian Inference In Dynamical Systems

Markov Chain Monte Carlo Methods for Estimating Systemic Risk Allocations

Bayesian Estimation of Dynamic Asset Pricing Models with Informative Observations

Inferring Volatility Dynamics Using Stock Prices and Variance Swap Rates: an Efficient Bayesian Approach

Efficient Bayesian inference for stochastic volatility models with ensemble MCMC methods

Estimating the Constant Elasticity of Variance Model with Data-Driven Markov Chain Monte Carlo Methods

Robust Coordinate Ascent Variational Inference with Markov chain Monte Carlo simulations

Bayesian Model Updating Using Hybrid Monte Carlo Simulation with Application to Structural Dynamic Models with Many Uncertain Parameters

Gradient-based Simulated Maximum Likelihood Estimation for Stochastic Volatility Models Using Characteristic Functions

Calibration of a Hybrid Local-Stochastic Volatility Stochastic Rates Model with a Control Variate Particle Method

New Bayesian method for estimation of Value at Risk and Conditional Value at Risk

Stochastic Volatility in Mean: Efficient Analysis by a Generalized Mixture Sampler

Bayesian parameter inference for partially observed stochastic volterra equations

Sequential Monte Carlo pricing of American-style options under stochastic volatility models

Artificial Neural Network-Based Hamiltonian Monte Carlo for High-Dimensional Bayesian Inference of Reaction Kinetics Models

A Bayesian Semiparametric Realized Stochastic Volatility Model