Abstract:Finite element methods (FEM) are popular approaches for simulation of soft tissues with elastic or viscoelastic behavior. However, their usage in real-time applications, such as in virtual reality surgical training, is limited by computational cost. In this application scenario, which typically involves transportable simulators, the computing hardware severely constrains the size or the level of details of the simulated scene. To address this limitation, data-driven approaches have been suggested to simulate mechanical deformations by learning the mapping rules from FEM generated datasets. Prior data-driven approaches have ignored the physical laws of the underlying engineering problem and have consequently been restricted to simulation cases of simple hyperelastic materials where the temporal variations were effectively ignored. However, most surgical training scenarios require more complex hyperelastic models to deal with the viscoelastic properties of tissues. This type of material exhibits both viscous and elastic behaviors when subjected to external force, requiring the implementation of time-dependant state variables. Herein, we propose a deep learning method for predicting displacement fields of soft tissues with viscoelastic properties. The main contribution of this work is the use of a physics-guided loss function for the optimization of the deep learning model parameters. The proposed deep learning model is based on convolutional (CNN) and recurrent layers (LSTM) to predict spatiotemporal variations. It is augmented with a mass conservation law in the lost function to prevent the generation of physically inconsistent results. The deep learning model is trained on a set of FEM datasets that are generated from a commercially available state-of-the-art numerical neurosurgery simulator. The use of the physics-guided loss function in a deep learning model has led to a better generalization in the prediction of deformations in unseen simulation cases. Moreover, the proposed method achieves a better accuracy over the conventional CNN models, where improvements were observed in unseen tissue from 8% to 30% depending on the magnitude of external forces. It is hoped that the present investigation will help in filling the gap in applying deep learning in virtual reality simulators, hence improving their computational performance (compared to FEM simulations) and ultimately their usefulness.

Machine-learning-based virtual fields method: Application to anisotropic hyperelasticity

An indirect training approach for implicit constitutive modelling using recurrent neural networks and the virtual fields method

FEniCS implementation of the Virtual Fields Method (VFM) for nonhomogeneous hyperelastic identification

Virtual fields method coupled with moiré interferometry: Special considerations and application

Development of the variation-of-elastic-energy-based virtual fields method for parameter identification of incompressible and compressible hyperelastic materials

Inversion and Decoupling of Thermo-Mechanical Deformation in Anisotropic Materials Using the Virtual Fields Method

Machine learning based inverse modeling of full-field strain distribution for mechanical characterization of a linear elastic and heterogeneous membrane

Characterization of Material Mechanical Properties Using Strain Correlation Method Combined with Virtual Fields Method

Calibrating constitutive models with full-field data via physics informed neural networks

Differentiable Neural-Integrated Meshfree Method for Forward and Inverse Modeling of Finite Strain Hyperelasticity

NN-EUCLID: Deep-learning hyperelasticity without stress data

Machine learning-based sampling of virtual experiments within the full stress state

Inferring Displacement Fields from Sparse Measurements Using the Statistical Finite Element Method

A VFM-based identification method for the dynamic anisotropic plasticity of sheet metals

Real-time simulation of viscoelastic tissue behavior with physics-guided deep learning

A mechanics-informed deep learning framework for data-driven nonlinear viscoelasticity

Viscoelasticty with physics-augmented neural networks: model formulation and training methods without prescribed internal variables

Inertia-based identification of elastic anisotropic properties for materials undergoing dynamic loadings using the virtual fields method and heterogeneous impact tests

Data-driven Modeling of the Mechanical Behavior of Anisotropic Soft Biological Tissue

A machine learning based plasticity model using proper orthogonal decomposition