Physics-Informed Machine Learning Models for Predicting the Progress of Reactive-Mixing

M. K. Mudunuru,S. Karra
DOI: https://doi.org/10.48550/arXiv.1908.10929
2019-08-29
Abstract:This paper presents a physics-informed machine learning (ML) framework to construct reduced-order models (ROMs) for reactive-transport quantities of interest (QoIs) based on high-fidelity numerical simulations. QoIs include species decay, product yield, and degree of mixing. The ROMs for QoIs are applied to quantify and understand how the chemical species evolve over time. First, high-resolution datasets for constructing ROMs are generated by solving anisotropic reaction-diffusion equations using a non-negative finite element formulation for different input parameters. Non-negative finite element formulation ensures that the species concentration is non-negative (which is needed for computing QoIs) on coarse computational grids even under high anisotropy. The reactive-mixing model input parameters are a time-scale associated with flipping of velocity, a spatial-scale controlling small/large vortex structures of velocity, a perturbation parameter of the vortex-based velocity, anisotropic dispersion strength/contrast, and molecular diffusion. Second, random forests, F-test, and mutual information criterion are used to evaluate the importance of model inputs/features with respect to QoIs. Third, Support Vector Machines (SVM) and Support Vector Regression (SVR) are used to construct ROMs based on the model inputs. Then, SVR-ROMs are used to predict scaling of QoIs. Qualitatively, SVR-ROMs are able to describe the trends observed in the scaling law associated with QoIs. Fourth, the scaling law's exponent dependence on model inputs/features are evaluated using $k$-means clustering. Finally, in terms of the computational cost, the proposed SVM-ROMs and SVR-ROMs are $\mathcal{O}(10^7)$ times faster than running a high-fidelity numerical simulation for evaluating QoIs.
Computational Engineering, Finance, and Science,Machine Learning,Computational Physics
What problem does this paper attempt to address?
The main problem this paper attempts to address is the development of a Physics-Informed Machine Learning (PIML) framework for constructing Reduced-Order Models (ROMs) of Quantities of Interest (QoIs) in reactive transport processes. Specifically, the paper focuses on how to efficiently and accurately predict the decay of chemical species, product formation, and the degree of mixing during reactive mixing processes. ### Main Problems 1. **Quantifying the impact of input parameters on chemical species mixing, reactant decay, and product formation**: - The paper generates datasets through high-fidelity numerical simulations and uses methods such as Random Forest, F-test, and Mutual Information criteria to assess the importance of different input parameters on QoIs. - The results indicate that anisotropic dispersion intensity/contrast is the most important factor, while the time scale associated with velocity reversal is the least important factor. 2. **Efficient and accurate prediction of reactive mixing states at different time stages**: - ROMs are constructed using Support Vector Machines (SVM) and Support Vector Regression (SVR). - SVR-ROMs can qualitatively describe the scaling law trends of QoIs, and their R² scores are greater than 0.9 when predicting the scaling relationships of QoIs, indicating good quantitative predictive capability. - Through k-means clustering analysis, it is inferred that incomplete mixing occurs under high anisotropic contrast, while the system is fully mixed under low anisotropic contrast. 3. **Improving computational efficiency**: - The proposed SVM-ROMs and SVR-ROMs are approximately 10^7 times faster than running high-fidelity numerical simulations, making these models very attractive for real-time monitoring and reactive transport sensing applications. ### Contributions - **Physics-Informed Machine Learning Models**: Developed physics-informed machine learning models for predicting the state and progress of reactive mixing. - **High-Fidelity Numerical Simulations**: Model construction is based on high-fidelity numerical simulation data that respects the underlying physics. - **Computational Efficiency and Data Compression**: The computational efficiency of the models is significantly improved, with a data compression ratio of approximately 10^-4, and with a small amount of training data (e.g., 5%), the prediction accuracy for unseen data exceeds 90%. ### Application Prospects - **Uncertainty Quantification Studies**: Due to the improved computational efficiency and accurate predictive capability, this method is suitable for comprehensive uncertainty quantification studies that require thousands of forward model runs. - **Real-Time Monitoring and Sensing Applications**: The rapid computational capability of the models makes them practically valuable for real-time monitoring and reactive transport sensing applications. In summary, this paper aims to develop efficient reduced-order models by combining physical information and machine learning techniques to accurately predict key quantities in reactive mixing processes, thereby improving computational efficiency and predictive accuracy.