Abstract:Finite element methods (FEM) are popular approaches for simulation of soft tissues with elastic or viscoelastic behavior. However, their usage in real-time applications, such as in virtual reality surgical training, is limited by computational cost. In this application scenario, which typically involves transportable simulators, the computing hardware severely constrains the size or the level of details of the simulated scene. To address this limitation, data-driven approaches have been suggested to simulate mechanical deformations by learning the mapping rules from FEM generated datasets. Prior data-driven approaches have ignored the physical laws of the underlying engineering problem and have consequently been restricted to simulation cases of simple hyperelastic materials where the temporal variations were effectively ignored. However, most surgical training scenarios require more complex hyperelastic models to deal with the viscoelastic properties of tissues. This type of material exhibits both viscous and elastic behaviors when subjected to external force, requiring the implementation of time-dependant state variables. Herein, we propose a deep learning method for predicting displacement fields of soft tissues with viscoelastic properties. The main contribution of this work is the use of a physics-guided loss function for the optimization of the deep learning model parameters. The proposed deep learning model is based on convolutional (CNN) and recurrent layers (LSTM) to predict spatiotemporal variations. It is augmented with a mass conservation law in the lost function to prevent the generation of physically inconsistent results. The deep learning model is trained on a set of FEM datasets that are generated from a commercially available state-of-the-art numerical neurosurgery simulator. The use of the physics-guided loss function in a deep learning model has led to a better generalization in the prediction of deformations in unseen simulation cases. Moreover, the proposed method achieves a better accuracy over the conventional CNN models, where improvements were observed in unseen tissue from 8% to 30% depending on the magnitude of external forces. It is hoped that the present investigation will help in filling the gap in applying deep learning in virtual reality simulators, hence improving their computational performance (compared to FEM simulations) and ultimately their usefulness.

Enabling large-scale viscoelastic calculations via neural network acceleration

A Coupled SPFEM/DEM Approach for Multiscale Modeling of Large‐deformation Geomechanical Problems

Real-time simulation of viscoelastic tissue behavior with physics-guided deep learning

Machine learning opportunities to conduct high-fidelity earthquake simulations in multi-scale heterogeneous geology

Deep learning-enhanced efficient seismic analysis of structures with multi-fidelity modeling strategies

Fast, accurate solutions for curvilinear earthquake faults and anelastic strain

Dynamic Analysis of Nonlinear Civil Engineering Structures using Artificial Neural Network with Adaptive Training

A physics-guided neural network framework for elastic plates: Comparison of governing equations-based and energy-based approaches

Accelerating high-strain continuum-scale brittle fracture simulations with machine learning

Rapid Seismic Waveform Modeling and Inversion with Neural Operators

Data-driven anisotropic finite viscoelasticity using neural ordinary differential equations

Deep Learning Based Upscaling of Geomechanical Constitutive Behavior for Lithological Heterogeneities

Inverse Modeling of Viscoelasticity Materials using Physics Constrained Learning

Towards a Real-Time Simulation of Elastoplastic Deformation Using Multi-Task Neural Networks

Deep Learning for Multiscale Damage Analysis via Physics-Informed Recurrent Neural Network

Physics-Based Self-Learning Spiking Neural Network enhanced time-integration scheme for computing viscoplastic structural finite element response

Modeling the Asymptotic Behavior of Higher-Order Aftershocks with Deep Learning

Periodic surface loading using GRACE data for a layered viscoelastic earth model based on a direct relationship between geoid and displacement

A new elasto-visco-plastic damage model and numerical simulation method used for time-dependent behavior prediction of deep tunnel

Attention network forecasts time-to-failure in laboratory shear experiments

Combination of physics‐based and data‐driven modeling for nonlinear structural seismic response prediction through deep residual learning