Abstract:Purpose: In abdominal interventional therapy, accurate motion tracking of the target is regarded as crucial to minimize trauma and optimize dosage delivery. Meanwhile, three-dimensional (3D) ultrasound (US) is an attractive modality to show the real-time motion pattern of the target. In this work, we developed an accurate and robust landmark tracking algorithm for 3D US sequences. Methods: The proposed algorithm introduces a three orthogonal planes (TOPs) based scale discriminative correlation filter network for 3D US landmarks tracking. First, we couple the fully convolutional network (FCN) with scale discriminative correlation filter (SDCF) to generate an effective tracker. And SDCF is reformulated as a differentiable layer, which ensures the network can perform scale learning and end-to-end training. Next, we train the end-to-end network on millions of natural images. Finally, we convert 3D US image to 2D three-channel image by TOP transformation and feed them to the proposed network for performing online tracking. Results: Online tracking performance was evaluated on the Challenge of Liver Ultrasound Tracking (CLUST) dataset with 22 sets of 3D US sequences, obtaining mean error of 1.63 ± 1.04 mm and 95th percentile (95%ile) error of 3.37 mm, when compared with manual annotations annotated by surgeons. Ablation study indicates that the promising results benefit from SDCF and scale learning, which alleviates the influence from deformation. The findings of the clinical analysis support that the proposed algorithm can work well with different initial patch sizes, which means that our algorithm has potential to lighten the burden of surgeons. Conclusions: We propose a flexible, accurate and robust landmark tracking algorithm for the image-guided interventions, and our algorithm is comparable with the state-of-the-art approaches. The tracking accuracy and robustness show that our algorithm has potential in 3D US-guided abdominal interventional therapies. Furthermore, more researches are needed to improve the computing speed of the algorithm to achieve real-time tracking.

Searching collaborative agents for multi-plane localization in 3D ultrasound

Agent With Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasound

Agent with Warm Start and Active Termination for Plane Localization in 3D Ultrasound

Agent with Tangent-based Formulation and Anatomical Perception for Standard Plane Localization in 3D Ultrasound

Image-Guided Navigation of a Robotic Ultrasound Probe for Autonomous Spinal Sonography Using a Shadow-aware Dual-Agent Framework

Deep Learning for Ultrasound Localization Microscopy

Multi-needle Detection in 3D Ultrasound Images with Sparse Dictionary Learning

Multi-agent Reinforcement Learning for Prostate Localization Based on Multi-Scale Image Representation

Precise Repositioning of Robotic Ultrasound: Improving Registration-Based Motion Compensation Using Ultrasound Confidence Optimization

Automatic Multi-Needle Localization in Ultrasound Images Using Large Margin Mask RCNN for Ultrasound-Guided Prostate Brachytherapy

Region Proposal Network with Graph Prior and Iou-Balance Loss for Landmark Detection in 3D Ultrasound

Adaptive 3D Localization of 2D Freehand Ultrasound Brain Images

Siamese Spatial Pyramid Matching Network with Location Prior for Anatomical Landmark Tracking in 3-Dimension Ultrasound Sequence

Deep learning-based plane pose regression in obstetric ultrasound

Measuring proximity to standard planes during fetal brain ultrasound scanning

Tracking 3D ultrasound anatomical landmarks via three orthogonal plane-based scale discriminative correlation filter network

Standard Plane Localization in Fetal Ultrasound via Domain Transferred Deep Neural Networks

Ultrasound Plane Pose Regression: Assessing Generalized Pose Coordinates in the Fetal Brain

Motion-Aware Robotic 3D Ultrasound

RecON: Online learning for sensorless freehand 3D ultrasound reconstruction

Order-Graph Regularized Sparse Dictionary Learning for Unsupervised Multi-Needle Detection in 3D Ultrasound Images