Abstract:Purpose: In abdominal interventional therapy, accurate motion tracking of the target is regarded as crucial to minimize trauma and optimize dosage delivery. Meanwhile, three-dimensional (3D) ultrasound (US) is an attractive modality to show the real-time motion pattern of the target. In this work, we developed an accurate and robust landmark tracking algorithm for 3D US sequences. Methods: The proposed algorithm introduces a three orthogonal planes (TOPs) based scale discriminative correlation filter network for 3D US landmarks tracking. First, we couple the fully convolutional network (FCN) with scale discriminative correlation filter (SDCF) to generate an effective tracker. And SDCF is reformulated as a differentiable layer, which ensures the network can perform scale learning and end-to-end training. Next, we train the end-to-end network on millions of natural images. Finally, we convert 3D US image to 2D three-channel image by TOP transformation and feed them to the proposed network for performing online tracking. Results: Online tracking performance was evaluated on the Challenge of Liver Ultrasound Tracking (CLUST) dataset with 22 sets of 3D US sequences, obtaining mean error of 1.63 ± 1.04 mm and 95th percentile (95%ile) error of 3.37 mm, when compared with manual annotations annotated by surgeons. Ablation study indicates that the promising results benefit from SDCF and scale learning, which alleviates the influence from deformation. The findings of the clinical analysis support that the proposed algorithm can work well with different initial patch sizes, which means that our algorithm has potential to lighten the burden of surgeons. Conclusions: We propose a flexible, accurate and robust landmark tracking algorithm for the image-guided interventions, and our algorithm is comparable with the state-of-the-art approaches. The tracking accuracy and robustness show that our algorithm has potential in 3D US-guided abdominal interventional therapies. Furthermore, more researches are needed to improve the computing speed of the algorithm to achieve real-time tracking.

Adaptive 3D Localization of 2D Freehand Ultrasound Brain Images

Automated 3D Fetal Brain Segmentation Using an Optimized Deep Learning Approach

Fully-automated alignment of 3D fetal brain ultrasound to a canonical reference space using multi-task learning

EchoFusion: Tracking and Reconstruction of Objects in 4D Freehand Ultrasound Imaging without External Trackers

SonoNet: Real-Time Detection and Localisation of Fetal Standard Scan Planes in Freehand Ultrasound

Geometric Transformation Uncertainty for Improving 3D Fetal Brain Pose Prediction from Freehand 2D Ultrasound Videos

Automatic Localization Of The Fetal Cerebellum On 3d Ultrasound Volumes

Agent Based Fetal Face Segmentation for Standard Plane Localization in 3D Ultrasound

Agent with Warm Start and Active Termination for Plane Localization in 3D Ultrasound

Pose-GuideNet: Automatic Scanning Guidance for Fetal Head Ultrasound from Pose Estimation

Joint Segmentation and Landmark Localization of Fetal Femur in Ultrasound Volumes

Localizing Scan Targets from Human Pose for Autonomous Lung Ultrasound Imaging

Sensorless volumetric reconstruction of fetal brain freehand ultrasound scans with deep implicit representation

Agent With Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasound

Towards segmentation and spatial alignment of the human embryonic brain using deep learning for atlas-based registration

Tracking 3D ultrasound anatomical landmarks via three orthogonal plane-based scale discriminative correlation filter network

Non-rigid registration of 3D ultrasound for neurosurgery using automatic feature detection and matching

Unsupervised Domain Adaptation for Anatomical Structure Detection in Ultrasound Images

A benchmark for 2D foetal brain ultrasound analysis

Standard Plane Localization in Fetal Ultrasound via Domain Transferred Deep Neural Networks