Machine-learning-assisted modeling

E. Weinan,Jiequn Han,Linfeng Zhang

DOI: https://doi.org/10.1063/PT.3.4793

IF: 3.5

2021-07-01

Physics Today

Abstract:By integrating artificial intelligence algorithms and physics-based simulations, researchers are developing new models that are both reliable and interpretable.

Computer Science,Physics

What problem does this paper attempt to address?

Integrating Machine Learning with Physics-Based Modeling

Weinan E,Jiequn Han,Linfeng Zhang

DOI: https://doi.org/10.48550/arXiv.2006.02619

2020-06-04

Computational Physics

Abstract:Machine learning is poised as a very powerful tool that can drastically improve our ability to carry out scientific research. However, many issues need to be addressed before this becomes a reality. This article focuses on one particular issue of broad interest: How can we integrate machine learning with physics-based modeling to develop new interpretable and truly reliable physical models? After introducing the general guidelines, we discuss the two most important issues for developing machine learning-based physical models: Imposing physical constraints and obtaining optimal datasets. We also provide a simple and intuitive explanation for the fundamental reasons behind the success of modern machine learning, as well as an introduction to the concurrent machine learning framework needed for integrating machine learning with physics-based modeling. Molecular dynamics and moment closure of kinetic equations are used as examples to illustrate the main issues discussed. We end with a general discussion on where this integration will lead us to, and where the new frontier will be after machine learning is successfully integrated into scientific modeling.
Scientific Machine Learning Enables Multiphysics Digital Twins of Large-Scale Electronic Chips

Xiao Li,Qiwei Zhan,Bozhao Sun,Haoqiang Feng,Yonghu Zeng,Huabing Wang,Xiaofan Yang,Wen-Yan Yin

DOI: https://doi.org/10.1109/tmtt.2022.3208917

IF: 4.3

2022-01-01

IEEE Transactions on Microwave Theory and Techniques

Abstract:We propose a scientific machine learning (SciML) algorithm toward 3-D dynamic digital twins, which represent multiphysics coupling effects in large-scale electronic chips. The SciML is a burgeoning topic, and here we refer to an organic fusion of scientific computing, model order reduction, and machine learning (ML) method. The proposed model order reduction compresses multiphysics information by a data-driven non-intrusive technique, thus getting rid of the access to backend source code; the proposed ML intrinsically infers the partial differential equation operators encoding the physical process. Numerical experiments showcase that the proposed digital twins have superior properties in real-time intelligent computing and generalization capability in predictive modeling. Nevertheless, it should be mentioned that the presented work is still in an early stage of intelligent digital twins.
Machine Learning and Physics: A Survey of Integrated Models

Azra Seyyedi,Mahdi Bohlouli,SeyedEhsan Nedaaee Oskoee

DOI: https://doi.org/10.1145/3611383

IF: 16.6

2023-08-03

ACM Computing Surveys

Abstract:Predictive modeling of various systems around the world is extremely essential from the physics and engineering perspectives. The recognition of different systems and the capacity to predict their future behavior can lead to numerous significant applications. For the most part, physics is frequently used to model different systems. Using physical modeling can also very well help the resolution of complexity and achieve superior performance with the emerging field of novel artificial intelligence and the challenges associated with it. Physical modeling provides data and knowledge that offer meaningful and complementary understanding about the system. So, by using enriched data and training phases, the overall general integrated model achieves enhanced accuracy. The effectiveness of hybrid physics-guided or machine learning-guided models has been validated by experimental results of diverse use cases. Increased accuracy, interpretability, and transparency are the results of such hybrid models. In this paper, we provide a detailed overview of how machine learning and physics can be integrated into an interactive approach. Regarding this, we propose a classification of possible interactions between physical modeling and machine learning techniques. Our classification includes three types of approaches: (1) physics-guided machine learning (2) machine learning-guided physics, and (3) mutually-guided physics and ML. We studied the models and specifications for each of these three approaches in-depth for this survey.

computer science, theory & methods
Machine learning-assisted multi-scale modeling

Weinan E,Huan Lei,Pinchen Xie,Linfeng Zhang

DOI: https://doi.org/10.1063/5.0149861

IF: 1.469

2023-07-01

Journal of Mathematical Physics

Abstract:Neural network-based machine learning is capable of approximating functions in very high dimension with unprecedented efficiency and accuracy. This has opened up many exciting new possibilities, one of which is to use machine learning algorithms to assist multi-scale modeling. In this review, we use three examples to illustrate the process involved in using machine learning in multi-scale modeling: ab initio molecular dynamics, ab initio meso-scale models, such as Landau models and generalized Langevin equation, and hydrodynamic models for non-Newtonian flows.

physics, mathematical
Machine learning active-nematic hydrodynamics

Jonathan Colen,Ming Han,Rui Zhang,Link Morgan,Raymond Adkins,Zev Bryant,Zvonimir Dogic,Vincenzo Vitelli,Steven A. Redford,Linnea M. Lemma,Paul V. Ruijgrok,Margaret L. Gardel,Juan J. de Pablo

DOI: https://doi.org/10.1073/pnas.2016708118

IF: 11.1

2021-03-02

Proceedings of the National Academy of Sciences

Abstract:Significance Artificial intelligence holds considerable promise for transforming quantitative modeling in materials science. We illustrate this potential by developing machine-learning models of a paradigmatic class of biomaterials called active nematics. These hybrid materials can be viewed as artificial muscles composed of biological fibers and molecular motors. Here, the macroscopic coefficients characterizing energy injection by motors and material elasticity are not constant. They are unknown functions of space and time that we extract directly from experiments using neural networks. Our physics-inspired machine-learning algorithms can also forecast the evolution of these complex materials simply using image sequences from their past, without any knowledge of the governing dynamics.

multidisciplinary sciences
What can machine learning help with microstructure-informed materials modeling and design?

Xiang-Long Peng,Mozhdeh Fathidoost,Binbin Lin,Yangyiwei Yang,Bai-Xiang Xu

2024-05-29

Abstract:Machine learning techniques have been widely employed as effective tools in addressing various engineering challenges in recent years, particularly for the challenging task of microstructure-informed materials modeling. This work provides a comprehensive review of the current machine learning-assisted and data-driven advancements in this field, including microstructure characterization and reconstruction, multiscale simulation, correlations among process, microstructure, and properties, as well as microstructure optimization and inverse design. It outlines the achievements of existing research through best practices and suggests potential avenues for future investigations. Moreover, it prepares the readers with educative instructions of basic knowledge and an overview on machine learning, microstructure descriptors and machine learning-assisted material modeling, lowering the interdisciplinary hurdles. It should help to stimulate and attract more research attention to the rapidly growing field of machine learning-based modeling and design of microstructured materials.

Materials Science,Computational Physics
Physics-guided machine learning from simulated data with different physical parameters

Chen, Shengyu,Kalanat, Nasrin,Xie, Yiqun,Li, Sheng,Zwart, Jacob A.,Sadler, Jeffrey M.,Appling, Alison P.,Oliver, Samantha K.,Read, Jordan S.,Jia, Xiaowei

DOI: https://doi.org/10.1007/s10115-023-01864-z

IF: 2.7

2023-04-01

Knowledge and Information Systems

Abstract:Physics-based models are widely used to study dynamical systems in a variety of scientific and engineering problems. However, these models are necessarily approximations of reality due to incomplete knowledge or excessive complexity in modeling underlying processes. As a result, they often produce biased simulations due to inaccurate parameterizations or approximations used to represent the true physics. In this paper, we aim to build a new physics-guided machine learning framework to monitor dynamical systems. The idea is to use advanced machine learning model to extract complex spatio-temporal data patterns while also incorporating general scientific knowledge embodied in simulated data generated by the physics-based model. To handle the bias in simulated data caused by imperfect parameterization, we propose to extract general physical relations jointly from multiple sets of simulations generated by a physics-based model under different physical parameters. In particular, we develop a spatio-temporal network architecture that uses its gating variables to capture the variation of physical parameters. We initialize this model using a pre-training strategy that helps discover common physical patterns shared by different sets of simulated data. Then, we fine-tune it combining limited observations and adequate simulations. By leveraging the complementary strength of machine learning and domain knowledge, our method has been shown to produce accurate predictions, use less training samples and generalize to out-of-sample scenarios. We further show that the method can provide insights about the variation of physical parameters over space and time in two domain applications: predicting temperature in streams and predicting temperature in lakes.

computer science, information systems, artificial intelligence
Hybrid physics-based and data-driven models for smart manufacturing: Modelling, simulation, and explainability

Jinjiang Wang,Yilin Li,Robert X. Gao,Fengli Zhang

DOI: https://doi.org/10.1016/j.jmsy.2022.04.004

IF: 12.1

2022-04-01

Journal of Manufacturing Systems

Abstract:To overcome the limitations associated with purely physics-based and data-driven modeling methods, hybrid, physics-based data-driven models have been developed, with improved model transparency, interpretability, and analytic capabilities at reduced computational cost. This paper reviews the state-of-the-art of hybrid physics-based data-driven models towards realizing a higher degree of autonomous and error-free operation in smart manufacturing. Recognizing the complementary strengths of pure physics-based and data-driven models, hybrid physics-based data-driven models are categorized as consisting of three types: (1) physics-informed machine learning, (2) machine learning-assisted simulation, and (3) explainable artificial intelligence. The principles and characteristics of these three types of hybrid physics-based data-driven models are summarized to address three aspects of smart manufacturing: product design, operation and maintenance, and intelligent decision making. Finally, the prospective directions and challenges of hybrid physics-based data-driven models are discussed from the perspective of data, scientific insights, interpretability of hyperparameters, and trading off between accuracy and explainability.

engineering, manufacturing, industrial,operations research & management science
Machine Learning for Cardiovascular Biomechanics Modeling: Challenges and Beyond

Amirhossein Arzani,Jian-Xun Wang,Michael S. Sacks,Shawn C. Shadden

DOI: https://doi.org/10.1007/s10439-022-02967-4

IF: 3.8

2022-01-01

Annals of Biomedical Engineering

Abstract:Recent progress in machine learning (ML), together with advanced computational power, have provided new research opportunities in cardiovascular modeling. While classifying patient outcomes and medical image segmentation with ML have already shown significant promising results, ML for the prediction of biomechanics such as blood flow or tissue dynamics is in its infancy. This perspective article discusses some of the challenges in using ML for replacing well-established physics-based models in cardiovascular biomechanics. Specifically, we discuss the large landscape of input features in 3D patient-specific modeling as well as the high-dimensional output space of field variables that vary in space and time. We argue that the end purpose of such ML models needs to be clearly defined and the tradeoff between the loss in accuracy and the gained speedup carefully interpreted in the context of translational modeling. We also discuss several exciting venues where ML could be strategically used to augment traditional physics-based modeling in cardiovascular biomechanics. In these applications, ML is not replacing physics-based modeling, but providing opportunities to solve ill-defined problems, improve measurement data quality, enable a solution to computationally expensive problems, and interpret complex spatiotemporal data by extracting hidden patterns. In summary, we suggest a strategic integration of ML in cardiovascular biomechanics modeling where the ML model is not the end goal but rather a tool to facilitate enhanced modeling.
Hybrid modeling: towards the next level of scientific computing in engineering

Stefan Kurz,Herbert De Gersem,Armin Galetzka,Andreas Klaedtke,Melvin Liebsch,Dimitrios Loukrezis,Stephan Russenschuck,Manuel Schmidt

DOI: https://doi.org/10.1186/s13362-022-00123-0

2022-03-03

Journal of Mathematics in Industry

Abstract:Abstract The integration of machine learning (Keplerian paradigm) and more general artificial intelligence technologies with physical modeling based on first principles (Newtonian paradigm) will impact scientific computing in engineering in fundamental ways. Such hybrid models combine first principle-based models with data-based models into a joint architecture. This paper will give some background, explain trends and showcase recent achievements from an applied mathematics and industrial perspective. Examples include characterization of superconducting accelerator magnets by blending data with physics, data-driven magnetostatic field simulation without an explicit model of the constitutive law, and Bayesian free-shape optimization of a trace pair with bend on a printed circuit board.
Multiscale Modeling Meets Machine Learning: What Can We Learn?

Grace C. Y. Peng,Mark Alber,Adrian Buganza Tepole,William R. Cannon,Suvranu De,Savador Dura-Bernal,Krishna Garikipati,George Karniadakis,William W. Lytton,Paris Perdikaris,Linda Petzold,Ellen Kuhl

DOI: https://doi.org/10.1007/s11831-020-09405-5

IF: 9.7

2020-02-17

Archives of Computational Methods in Engineering

Abstract:Machine learning is increasingly recognized as a promising technology in the biological, biomedical, and behavioral sciences.There can be no argument that this technique is incredibly successful in image recognition with immediate applications in diagnostics including electrophysiology, radiology, or pathology, where we have access to massive amounts of annotated data. However, machine learning often performs poorly in prognosis, especially when dealing with sparse data.This is a field where classical physics-based simulation seems to remain irreplaceable. In this review, we identify areas in the biomedical sciences where machine learning and multiscale modeling can mutually benefit from one another: Machine learning can integrate physics-based knowledge in the form of governing equations, boundary conditions, or constraints to manage ill-posted problems and robustly handle sparse and noisy data; multiscale modeling can integrate machine learning to create surrogate models, identify system dynamics and parameters, analyze sensitivities, and quantify uncertainty to bridge the scales and understand the emergence of function. With a view towards applications in the life sciences, we discuss the state of the art of combining machine learning and multiscale modeling, identify applications and opportunities, raise open questions, and address potential challenges and limitations. We anticipate that it will stimulate discussion within the community of computational mechanics and reach out to other disciplines including mathematics, statistics, computer science, artificial intelligence, biomedicine, systems biology, and precision medicine to join forces towards creating robust and efficient models for biological systems.

computer science, interdisciplinary applications,engineering, multidisciplinary,mathematics
Machine Learning is Accelerating Materials Research

ZHANG Qi,ZHENG Yujie,SUN Kuan

DOI: https://doi.org/10.11896/j.issn.1005-023x.2020.09.h01

2020-01-01

Abstract:The development of artificial intelligence is reshaping our human society. As a branch of artificial intelligence, machine learning can learn from existing data and establish correlations between in-put data and the output. The performance of the model can be im-proved through training, helping us to discover hidden laws in the database. Progress has been made in applying machine learning to the field of materials science[1] . For example, machine lear-ning is employed to establish the structure-property relationship in various material systems[2-3] , quickly screen new materials[4-5] , discover novel structures[6] and optimize experimental parame-ters[7] , etc. It seems machine learning is revolutionizing the way of materials research by providing new approaches to materials design, synthesis, characterization, and application[8] .
High-resolution fluid–particle interactions: a machine learning approach

Tsimur Davydzenka,Pejman Tahmasebi

DOI: https://doi.org/10.1017/jfm.2022.174

IF: 3.7

2022-03-15

Journal of Fluid Mechanics

Abstract:Modelling of fluid–particle interactions is a major area of research in many fields of science and engineering. There are several techniques that allow modelling of such interactions, among which the coupling of computational fluid dynamics (CFD) and the discrete element method (DEM) is one of the most convenient solutions due to the balance between accuracy and computational costs. However, the accuracy of this method is largely dependent upon mesh size, where obtaining realistic results always comes with the necessity of using a small mesh and thereby increasing computational intensity. To compensate for the inaccuracies of using a large mesh in such modelling, and still take advantage of rapid computations, we extended the classical modelling by combining it with a machine learning model. We have conducted seven simulations where the first one is a numerical model with a fine mesh (i.e. ground truth) with a very high computational time and accuracy, the next three models are constructed on coarse meshes with considerably less accuracy and computational burden and the last three models are assisted by machine learning, where we can obtain large improvements in terms of observing fine-scale features yet based on a coarse mesh. The results of this study show that there is a great opportunity in machine learning towards improving classical fluid–particle modelling approaches by producing highly accurate models for large-scale systems in a reasonable time.

mechanics,physics, fluids & plasmas
Physics-Informed and Hybrid Machine Learning in Additive Manufacturing: Application to Fused Filament Fabrication

Berkcan Kapusuzoglu,Sankaran Mahadevan

DOI: https://doi.org/10.1007/s11837-020-04438-4

2020-10-26

JOM

Abstract:This article investigates several physics-informed and hybrid machine learning strategies that incorporate physics knowledge in experimental data-driven deep-learning models for predicting the bond quality and porosity of fused filament fabrication (FFF) parts. Three types of strategies are explored to incorporate physics constraints and multi-physics FFF simulation results into a deep neural network (DNN), thus ensuring consistency with physical laws: (1) incorporate physics constraints within the loss function of the DNN, (2) use physics model outputs as additional inputs to the DNN model, and (3) pre-train a DNN model with physics model input-output and then update it with experimental data. These strategies help to enforce a physically consistent relationship between bond quality and tensile strength, thus making porosity predictions physically meaningful. Eight different combinations of the above strategies are investigated. The results show how the combination of multiple strategies produces accurate machine learning models even with limited experimental data.

materials science, multidisciplinary,metallurgy & metallurgical engineering,mining & mineral processing,mineralogy
A State-of-the-Art Review on Machine Learning-Based Multiscale Modeling, Simulation, Homogenization and Design of Materials

Dana Bishara,Yuxi Xie,Wing Kam Liu,Shaofan Li

DOI: https://doi.org/10.1007/s11831-022-09795-8

IF: 9.7

2022-08-07

Archives of Computational Methods in Engineering

Abstract:Multiscale simulation and homogenization of materials have become the major computational technology as well as engineering tools in material modeling and material design. However, the concurrent multiscale simulations require extensive computational resources, in which the CPU time increases exponentially as the spatial and temporal scale increase. In fact, with only a few exceptions, both hierarchical and concurrent multiscale modeling techniques have not been adopted in the industrial sector, primarily because of their computational cost. Recently, the rapid developments in artificial intelligence technology as well as the fast growth in computational resources and data have stimulated a widespread adoption of machine learning-based methodologies to enhance the computational efficiency and accuracy in multiscale simulations and their applications. Even though there is a great expectation of a revolution propelled by the artificial intelligence and machine learning technology in computational materials and computational mechanics, the machine learning-based multiscale modeling and simulation is still at its infant stage. In this paper, we aim at a state-of-the-art review on the machine learning-based multiscale modeling and simulation of materials, and its applications in composite homogenization, defect mechanics modeling, and material design, to provide an overview as well as perspectives on these innovative techniques, which may soon replace the conventional multiscale modeling methods.

computer science, interdisciplinary applications,engineering, multidisciplinary,mathematics
Hybrid Modelling by Machine Learning Corrections of Analytical Model Predictions towards High-Fidelity Simulation Solutions

Frederic E. Bock,Sören Keller,Norbert Huber,Benjamin Klusemann

DOI: https://doi.org/10.3390/ma14081883

IF: 3.4

2021-04-10

Materials

Abstract:Within the fields of materials mechanics, the consideration of physical laws in machine learning predictions besides the use of data can enable low prediction errors and robustness as opposed to predictions only based on data. On the one hand, exclusive utilization of fundamental physical relationships might show significant deviations in their predictions compared to reality, due to simplifications and assumptions. On the other hand, using only data and neglecting well-established physical laws can create the need for unreasonably large data sets that are required to exhibit low bias and are usually expensive to collect. However, fundamental but simplified physics in combination with a corrective model that compensates for possible deviations, e.g., to experimental data, can lead to physics-based predictions with low prediction errors, also despite scarce data. In this article, it is demonstrated that a hybrid model approach consisting of a physics-based model that is corrected via an artificial neural network represents an efficient prediction tool as opposed to a purely data-driven model. In particular, a semi-analytical model serves as an efficient low-fidelity model with noticeable prediction errors outside its calibration domain. An artificial neural network is used to correct the semi-analytical solution towards a desired reference solution provided by high-fidelity finite element simulations, while the efficiency of the semi-analytical model is maintained and the applicability range enhanced. We utilize residual stresses that are induced by laser shock peening as a use-case example. In addition, it is shown that non-unique relationships between model inputs and outputs lead to high prediction errors and the identification of salient input features via dimensionality analysis is highly beneficial to achieve low prediction errors. In a generalization task, predictions are also outside the process parameter space of the training region while remaining in the trained range of corrections. The corrective model predictions show substantially smaller errors than purely data-driven model predictions, which illustrates one of the benefits of the hybrid modelling approach. Ultimately, when the amount of samples in the data set is reduced, the generalization of the physics-related corrective model outperforms the purely data-driven model, which also demonstrates efficient applicability of the proposed hybrid modelling approach to problems where data is scarce.

materials science, multidisciplinary,chemistry, physical,physics, applied, condensed matter,metallurgy & metallurgical engineering
Artificial Intelligence in Materials Modeling and Design

J. S. Huang,J. X. Liew,A. S. Ademiloye,K. M. Liew

DOI: https://doi.org/10.1007/s11831-020-09506-1

IF: 9.7

2020-10-11

Archives of Computational Methods in Engineering

Abstract:In recent decades, the use of artificial intelligence (AI) techniques in the field of materials modeling has received significant attention owing to their excellent ability to analyze a vast amount of data and reveal correlations between several complex interrelated phenomena. In this review paper, we summarize recent advances in the applications of AI techniques for numerical modeling of different types of materials. AI techniques such as machine learning and deep learning show great advantages and potential for predicting important mechanical properties of materials and reveal how changes in certain principal parameters affect the overall behavior of engineering materials. Furthermore, in this review, we show that the application of AI techniques can significantly help to improve the design and optimize the properties of future advanced engineering materials. Finally, a perspective on the challenges and prospects of the applications of AI techniques for material modeling is presented.

computer science, interdisciplinary applications,engineering, multidisciplinary,mathematics

Machine-learning-assisted modeling

Integrating Machine Learning with Physics-Based Modeling

Scientific Machine Learning Enables Multiphysics Digital Twins of Large-Scale Electronic Chips

Machine Learning and Physics: A Survey of Integrated Models

Machine learning-assisted multi-scale modeling

Machine learning active-nematic hydrodynamics

What can machine learning help with microstructure-informed materials modeling and design?

Physics-guided machine learning from simulated data with different physical parameters

Hybrid physics-based and data-driven models for smart manufacturing: Modelling, simulation, and explainability

Machine Learning for Cardiovascular Biomechanics Modeling: Challenges and Beyond

Hybrid modeling: towards the next level of scientific computing in engineering

Multiscale Modeling Meets Machine Learning: What Can We Learn?

Machine Learning is Accelerating Materials Research

High-resolution fluid–particle interactions: a machine learning approach

Physics-Informed and Hybrid Machine Learning in Additive Manufacturing: Application to Fused Filament Fabrication

A State-of-the-Art Review on Machine Learning-Based Multiscale Modeling, Simulation, Homogenization and Design of Materials

Hybrid Modelling by Machine Learning Corrections of Analytical Model Predictions towards High-Fidelity Simulation Solutions

Artificial Intelligence in Materials Modeling and Design