SGD-based Optimization in Modeling Combustion Kinetics: Case Studies in Tuning Mechanistic and Hybrid Kinetic Models

Weiqi Ji,Xingyu Su,Bin Pang,Yujuan Li,Zhuyin Ren,Sili Deng
DOI: https://doi.org/10.1016/j.fuel.2022.124560
IF: 7.4
2022-01-01
Fuel
Abstract:Chemical kinetic modeling is an integral part of combustion simulation, and extensive efforts have been devoted to developing high-fidelity yet computationally affordable models. Despite these efforts, modeling combustion kinetics is still challenging due to the demand for expert knowledge and high dimensional optimization against experiments. Therefore, data-driven approaches that enable efficient discovery and calibration of kinetic models have received much attention in recent years, the core of which is the high-dimensional optimization based on big data. Evolutionary algorithms are usually adopted for optimizing chemical kinetic models, although they usually suffer from high computational costs and are limited to a small number of parameters. Meanwhile, gradient-based optimizations, especially the stochastic gradient descent (SGD) methods, have shown success in developing complex models by training large-scale deep learning models. Therefore, this work explores the applications of SGD-based optimizations in tuning mechanistic kinetic models and learning hybrid kinetic models. We first showed that SGD-based optimizations could substantially save computational cost compared to evolutionary algorithms when the number of kinetic parameters in mechanistic models reached about one hundred. We then demonstrated that the SGD-based optimization enabled us to use a neural network model to represent the pyrolysis of the Hybrid Chemistry and optimize the associated hundreds of weights in the neural network. These proof-of-concept studies showed that the SGD-based optimization is more efficient than evolutionary algorithms, is a promising approach for developing chemical kinetic models with high dimensional parameters, and is capable of developing hybrid mechanistic-machine learning kinetic models.
What problem does this paper attempt to address?