Deep learning in computational mechanics: a review

Herrmann, Leon

DOI: https://doi.org/10.1007/s00466-023-02434-4

IF: 4.391

2024-01-14

Computational Mechanics

Abstract:The rapid growth of deep learning research, including within the field of computational mechanics, has resulted in an extensive and diverse body of literature. To help researchers identify key concepts and promising methodologies within this field, we provide an overview of deep learning in deterministic computational mechanics. Five main categories are identified and explored: simulation substitution, simulation enhancement, discretizations as neural networks, generative approaches, and deep reinforcement learning. This review focuses on deep learning methods rather than applications for computational mechanics, thereby enabling researchers to explore this field more effectively. As such, the review is not necessarily aimed at researchers with extensive knowledge of deep learning—instead, the primary audience is researchers on the verge of entering this field or those attempting to gain an overview of deep learning in computational mechanics. The discussed concepts are, therefore, explained as simple as possible.

mechanics,mathematics, interdisciplinary applications

What problem does this paper attempt to address?

This paper provides a review of the applications of deep learning in deterministic computational mechanics. With the rapid development of deep learning research, it has produced a large and diverse body of literature in the field of computational mechanics. In order to help researchers understand and explore this field, the authors categorize deep learning methods into five main categories:

1. **Simulation substitution**: Using deep neural networks as proxy models to completely replace traditional simulations, including data-driven modeling (such as space-time methods, time-stepping schemes, active learning, and transfer learning) and physics-based learning approaches.

2. **Simulation enhancement**: Only replacing certain components of the simulation chain while retaining classical methods to handle other parts, including pre-processing (such as data preparation, initialization, and grid generation), physical modeling, numerical methods, and post-processing.

3. **Discretization as neural networks**: Discretization by constructing neural network-based building blocks (linear transformations and non-linear activation functions) to leverage the advantages of deep learning frameworks in improving classical simulation techniques.

4. **Generation methods**: Creating new content that is statistically similar to the dataset for the purpose of diversifying the design space or augmenting the dataset to train the proxy model.

5. **Deep reinforcement learning**: Using intelligent agents with neural network models to learn how to interact with the environment to maximize rewards, applicable to optimization problems without gradient information.

The focus of the paper is on the deep learning methods rather than specific applications, aiming to provide guidance for researchers who are new to this field or interested in understanding the application of deep learning in computational mechanics. The paper also proposes a classification approach to help organize different methods and emphasizes the similarities between these methods and the current state of the field.