Abstract:Finite element methods (FEM) are popular approaches for simulation of soft tissues with elastic or viscoelastic behavior. However, their usage in real-time applications, such as in virtual reality surgical training, is limited by computational cost. In this application scenario, which typically involves transportable simulators, the computing hardware severely constrains the size or the level of details of the simulated scene. To address this limitation, data-driven approaches have been suggested to simulate mechanical deformations by learning the mapping rules from FEM generated datasets. Prior data-driven approaches have ignored the physical laws of the underlying engineering problem and have consequently been restricted to simulation cases of simple hyperelastic materials where the temporal variations were effectively ignored. However, most surgical training scenarios require more complex hyperelastic models to deal with the viscoelastic properties of tissues. This type of material exhibits both viscous and elastic behaviors when subjected to external force, requiring the implementation of time-dependant state variables. Herein, we propose a deep learning method for predicting displacement fields of soft tissues with viscoelastic properties. The main contribution of this work is the use of a physics-guided loss function for the optimization of the deep learning model parameters. The proposed deep learning model is based on convolutional (CNN) and recurrent layers (LSTM) to predict spatiotemporal variations. It is augmented with a mass conservation law in the lost function to prevent the generation of physically inconsistent results. The deep learning model is trained on a set of FEM datasets that are generated from a commercially available state-of-the-art numerical neurosurgery simulator. The use of the physics-guided loss function in a deep learning model has led to a better generalization in the prediction of deformations in unseen simulation cases. Moreover, the proposed method achieves a better accuracy over the conventional CNN models, where improvements were observed in unseen tissue from 8% to 30% depending on the magnitude of external forces. It is hoped that the present investigation will help in filling the gap in applying deep learning in virtual reality simulators, hence improving their computational performance (compared to FEM simulations) and ultimately their usefulness.

Deep Learning for High Speed Optical Coherence Elastography

A Modified da Vinci Surgical Instrument for OCE based Elasticity Estimation with Deep Learning

Optical Coherence Elastography of 3D Bilayer Soft Solids Using Full-Field and Partial Displacement Measurements

Longitudinal shear waves for elastic characterization of tissues in optical coherence elastography

A novel optical needle probe for deep learning-based tissue elasticity characterization

Deep Learning in Ultrasound Elastography Imaging

High-accuracy Optical Coherence Elastography Digital Volume Correlation Methods to Measure Depth Regions with Low Correlation.

Spatial resolution in optical coherence elastography of bounded media

Real-time simulation of viscoelastic tissue behavior with physics-guided deep learning

Combining physics-based modeling and deep learning for ultrasound elastography

Optical Coherence Elastography Based on Inverse Compositional Gauss-Newton Digital Volume Correlation with Second-Order Shape Function.

VP-net: an end-to-end deep learning network for elastic wave velocity prediction in human skin in vivo using optical coherence elastography

Synthetic Elastography using B-mode Ultrasound through a Deep Fully-Convolutional Neural Network

Physics‐Informed Deep‐Learning For Elasticity: Forward, Inverse, and Mixed Problems

Physics-guided Deep Learning-Based Real-Time Image Reconstruction of Fourier-domain Optical Coherence Tomography.

Learning hidden elasticity with deep neural networks

In vivo Optical Coherence Elastography Reveals Spatial Variation and Anisotropy of Corneal Stiffness

Simultaneous reconstruction and displacement estimation for spectral-domain optical coherence elastography

Toward Improved Accuracy in Quasi-Static Elastography Using Deep Learning

SELFNet: Denoising Shear Wave Elastography Using Spatial-temporal Fourier Feature Networks

Ultrafast Cardiac Imaging Using Deep Learning For Speckle-Tracking Echocardiography