Abstract:Purpose: Ultrasound (US) imaging is an established imaging modality capable of offering video-rate volumetric images without ionizing radiation. It has the potential for intra-fraction motion tracking in radiation therapy. In this study, a deep learning-based method has been developed to tackle the challenges in motion tracking using US imaging. Methods: We present a Markov-like network, which is implemented via generative adversarial networks, to extract features from sequential US frames (one tracked frame followed by untracked frames) and thereby estimate a set of deformation vector fields (DVFs) through the registration of the tracked frame and the untracked frames. The positions of the landmarks in the untracked frames are finally determined by shifting landmarks in the tracked frame according to the estimated DVFs. The performance of the proposed method was evaluated on the testing dataset by calculating the tracking error (TE) between the predicted and ground truth landmarks on each frame. Results: The proposed method was evaluated using the MICCAI CLUST 2015 dataset which was collected using seven US scanners with eight types of transducers and the Cardiac Acquisitions for Multi-structure Ultrasound Segmentation (CAMUS) dataset which was acquired using GE Vivid E95 ultrasound scanners. The CLUST dataset contains 63 2D and 22 3D US image sequences respectively from 42 and 18 subjects, and the CAMUS dataset includes 2D US images from 450 patients. On CLUST dataset, our proposed method achieved a mean tracking error of 0.70 ± 0.38 mm for the 2D sequences and 1.71 ± 0.84 mm for the 3D sequences for those public available annotations. And on CAMUS dataset, a mean tracking error of 0.54 ± 1.24 mm for the landmarks in the left atrium was achieved. Conclusions: A novel motion tracking algorithm using US images based on modern deep learning techniques has been demonstrated in this study. The proposed method can offer millimeter-level tumor motion prediction in real time, which has the potential to be adopted into routine tumor motion management in radiation therapy.

Deep Learning-Based Displacement Tracking for Post-Stroke Myofascial Shear Strain Quantification

Automated Method for Tracking Human Muscle Architecture on Ultrasound Scans during Dynamic Tasks

Automatic Tracking of Muscle Fascicles in Ultrasound Images Using Localized Radon Transform

Displacement Tracking Techniques in Ultrasound Elastography: From Cross Correlation to Deep Learning

Deep learning enables accurate soft tissue tendon deformation estimation in vivo via ultrasound imaging

Exploiting Mechanics-Based Priors for Lateral Displacement Estimation in Ultrasound Elastography

Automatic Muscle Fiber Orientation Tracking in Ultrasound Images Using a New Adaptive Fading Bayesian Kalman Smoother

Integrated Dynamic Shape Tracking and RF Speckle Tracking for Cardiac Motion Analysis

A Hybrid Method for Ultrasound-Based Tracking of Skeletal Muscle Architecture

Fully Automated Myocardial Strain Estimation from CMR Tagged Images using a Deep Learning Framework in the UK Biobank

Deep Learning for Automatic Strain Quantification in Arrhythmogenic Right Ventricular Cardiomyopathy

Deep learning-based motion tracking using ultrasound images

DeepStrain: A Deep Learning Workflow for the Automated Characterization of Cardiac Mechanics

Convolutional Neural Network-Based Speckle Tracking for Ultrasound Strain Elastography: an Unsupervised Learning Approach.

Automatic tracking of muscle fascicle orientation in ultrasound images: a approach based on a normalized Radon transform and statistical measure

Displacement-based Reconstruction of Elasticity Distribution with Deep Neural Network

Deep Learning Algorithm for Predicting Subacromial Motion Trajectory: Dynamic Shoulder Ultrasound Analysis

3D Freehand Ultrasound using Visual Inertial and Deep Inertial Odometry for Measuring Patellar Tracking

Precise Tracking of Impulsive Acoustic Radiation Force Induced Small Displacements for Shear Wave Speed Estimation

Improved computation of Lagrangian tissue displacement and strain for cine DENSE MRI using a regularized spatiotemporal least squares method

Automatic Tracking of Aponeuroses and Estimation of Muscle Thickness in Ultrasonography: a Feasibility Study.