Abstract:Finite element methods (FEM) are popular approaches for simulation of soft tissues with elastic or viscoelastic behavior. However, their usage in real-time applications, such as in virtual reality surgical training, is limited by computational cost. In this application scenario, which typically involves transportable simulators, the computing hardware severely constrains the size or the level of details of the simulated scene. To address this limitation, data-driven approaches have been suggested to simulate mechanical deformations by learning the mapping rules from FEM generated datasets. Prior data-driven approaches have ignored the physical laws of the underlying engineering problem and have consequently been restricted to simulation cases of simple hyperelastic materials where the temporal variations were effectively ignored. However, most surgical training scenarios require more complex hyperelastic models to deal with the viscoelastic properties of tissues. This type of material exhibits both viscous and elastic behaviors when subjected to external force, requiring the implementation of time-dependant state variables. Herein, we propose a deep learning method for predicting displacement fields of soft tissues with viscoelastic properties. The main contribution of this work is the use of a physics-guided loss function for the optimization of the deep learning model parameters. The proposed deep learning model is based on convolutional (CNN) and recurrent layers (LSTM) to predict spatiotemporal variations. It is augmented with a mass conservation law in the lost function to prevent the generation of physically inconsistent results. The deep learning model is trained on a set of FEM datasets that are generated from a commercially available state-of-the-art numerical neurosurgery simulator. The use of the physics-guided loss function in a deep learning model has led to a better generalization in the prediction of deformations in unseen simulation cases. Moreover, the proposed method achieves a better accuracy over the conventional CNN models, where improvements were observed in unseen tissue from 8% to 30% depending on the magnitude of external forces. It is hoped that the present investigation will help in filling the gap in applying deep learning in virtual reality simulators, hence improving their computational performance (compared to FEM simulations) and ultimately their usefulness.

A Non-Linear Viscoelastic Tensor-Mass Model for Surgery Simulation

A Nonlinear Viscoelastic Tensor-Mass Visual Model for Surgery Simulation

Model And Simulation Research Of Tissue Based Ct Images

Study of the Simulation of Soft Tissue Deformation in Virtual Surgery

A New Hybrid Viscoelastic Soft Tissue Model Based on Meshless Method for Haptic Surgical Simulation.

[Research Progress on Real-Time Deformable Models of Soft Tissues for Surgery Simulation].

Fast porous visco-hyperelastic soft tissue model for surgery simulation: application to liver surgery

Simulation of soft tissue using mass-spring model with simulated annealing optimization

Establishment and Stability Analysis of A Hybrid Viscoelastic Model Based on Mesh Less for Surgical Robot System

Three-Dimensional Modeling of Heart Soft Tissue Motion

Predicting Soft Tissue Deformation Based on an Improved Biomechanical Model

An efficient and accurate method for modeling nonlinear fractional viscoelastic biomaterials

Simulation of Active Cardiac Dynamics with Orthotropic Hyperelastic Material Model

Simulating Cranio-Maxillofacial Surgery Based on Mixed-Element Biomechanical Modelling

Modeling and Real-time Simulation Method of Biological Tissue Based PC

Real-time simulation of viscoelastic tissue behavior with physics-guided deep learning

Visco-hyperelastic material model fitting to experimental stress-strain curves using a genetic algorithm and its application to soft tissue simulants

Virtual Training System with Physical Viscoelastic Model and Blood Flow Simulation Based on A Range-Based Sph Method

Comparative Analysis of Nonlinear Viscoelastic Models Across Common Biomechanical Experiments

Logarithmic rate based elasto-viscoplastic cyclic constitutive model for soft biological tissues

Establishment of Emergency Teaching Model and Optimization of Discrete Dynamic Calculation in Complex Virtual Simulation Environment