Abstract:Purpose: In abdominal interventional therapy, accurate motion tracking of the target is regarded as crucial to minimize trauma and optimize dosage delivery. Meanwhile, three-dimensional (3D) ultrasound (US) is an attractive modality to show the real-time motion pattern of the target. In this work, we developed an accurate and robust landmark tracking algorithm for 3D US sequences. Methods: The proposed algorithm introduces a three orthogonal planes (TOPs) based scale discriminative correlation filter network for 3D US landmarks tracking. First, we couple the fully convolutional network (FCN) with scale discriminative correlation filter (SDCF) to generate an effective tracker. And SDCF is reformulated as a differentiable layer, which ensures the network can perform scale learning and end-to-end training. Next, we train the end-to-end network on millions of natural images. Finally, we convert 3D US image to 2D three-channel image by TOP transformation and feed them to the proposed network for performing online tracking. Results: Online tracking performance was evaluated on the Challenge of Liver Ultrasound Tracking (CLUST) dataset with 22 sets of 3D US sequences, obtaining mean error of 1.63 ± 1.04 mm and 95th percentile (95%ile) error of 3.37 mm, when compared with manual annotations annotated by surgeons. Ablation study indicates that the promising results benefit from SDCF and scale learning, which alleviates the influence from deformation. The findings of the clinical analysis support that the proposed algorithm can work well with different initial patch sizes, which means that our algorithm has potential to lighten the burden of surgeons. Conclusions: We propose a flexible, accurate and robust landmark tracking algorithm for the image-guided interventions, and our algorithm is comparable with the state-of-the-art approaches. The tracking accuracy and robustness show that our algorithm has potential in 3D US-guided abdominal interventional therapies. Furthermore, more researches are needed to improve the computing speed of the algorithm to achieve real-time tracking.

Nonrigid Reconstruction of Freehand Ultrasound without a Tracker

RecON: Online learning for sensorless freehand 3D ultrasound reconstruction

Sensorless End-to-End Freehand Three-dimensional Ultrasound Reconstruction with Physics Guided Deep Learning

Neural Implicit Surface Reconstruction of Freehand 3D Ultrasound Volume with Geometric Constraints

Long-term Dependency for 3D Reconstruction of Freehand Ultrasound Without External Tracker

Online Global Non-rigid Registration for 3D Object Reconstruction Using Consumer-level Depth Cameras

EchoFusion: Tracking and Reconstruction of Objects in 4D Freehand Ultrasound Imaging without External Trackers

Privileged Anatomical and Protocol Discrimination in Trackerless 3D Ultrasound Reconstruction

Self Context and Shape Prior for Sensorless Freehand 3D Ultrasound Reconstruction

Rigid Registration of Freehand 3D Ultrasound and CT-Scan Kidney Images

Non-rigid Registration Algorithm Based on Modally Controlled Free Form Deformation

Skeleton Graph-based Ultrasound-CT Non-rigid Registration

Tracking 3D ultrasound anatomical landmarks via three orthogonal plane-based scale discriminative correlation filter network

3D Freehand Ultrasound using Visual Inertial and Deep Inertial Odometry for Measuring Patellar Tracking

Sensorless Freehand 3D Ultrasound Reconstruction via Deep Contextual Learning

Unsupervised Deformable Image Registration for Respiratory Motion Compensation in Ultrasound Images

Marker-less tracking of brain surface deformations by non-rigid registration integrating surface and vessel/sulci features

Geometric Transformation Uncertainty for Improving 3D Fetal Brain Pose Prediction from Freehand 2D Ultrasound Videos

FPSN-FNCC: an accurate and fast motion tracking algorithm in 3D ultrasound for image-guided interventions

Deep learning-based motion tracking using ultrasound images

Freehand 3D Ultrasound Imaging Based on Probe-mounted Vision and IMU System