Abstract:Ultrasound (US)-guided needle insertion is widely employed in percutaneous interventions. However, providing feedback on the needle tip position via US image presents challenges due to noise, artifacts, and the thin imaging plane of US, which degrades needle features and leads to intermittent tip visibility. In this paper, a Mamba-based US needle tracker MambaXCTrack utilizing structured state space models cross-correlation (SSMX-Corr) and implicit motion prompt is proposed, which is the first application of Mamba in US needle tracking. The SSMX-Corr enhances cross-correlation by long-range modeling and global searching of distant semantic features between template and search maps, benefiting the tracking under noise and artifacts by implicitly learning potential distant semantic cues. By combining with cross-map interleaved scan (CIS), local pixel-wise interaction with positional inductive bias can also be introduced to SSMX-Corr. The implicit low-level motion descriptor is proposed as a non-visual prompt to enhance tracking robustness, addressing the intermittent tip visibility problem. Extensive experiments on a dataset with motorized needle insertion in both phantom and tissue samples demonstrate that the proposed tracker outperforms other state-of-the-art trackers while ablation studies further highlight the effectiveness of each proposed tracking module.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the difficulty in tracking the position of the needle tip during ultrasound (US) - guided needle insertion due to problems such as noise, artifacts, and narrow imaging planes. Specifically: 1. **Impact of Noise and Artifacts**: Noise and artifacts in ultrasound images can blur or distort the position of the needle tip, degrading the needle - tip features and making accurate identification difficult. 2. **Intermittent Visibility of the Needle Tip**: Due to the occlusion of anatomical structures or the deviation of the ultrasound imaging plane, the needle tip may disappear intermittently in the image, which further increases the difficulty of tracking. 3. **Limitations of Existing Methods**: Traditional statistical filters and Gabor filters have certain effects, but they are sensitive to environmental factors and have complex workflows. Methods based on discriminative correlation filtering (DCF) are easily affected by background interference and image distortion. Existing deep - learning methods such as convolutional neural networks (CNN) and Transformer perform well in some tasks, but have limitations when dealing with long - distance semantic information. To solve these problems, the paper proposes an ultrasound - needle tracker based on Mamba - MambaXCTrack, which utilizes cross - correlation in structured state - space models (SSMX - Corr) and implicit motion prompts. The main innovations include: - **SSMX - Corr**: Through global search and long - distance modeling, it enhances the long - distance semantic feature interaction between the template and the search map, improving the tracking robustness under noise and artifact conditions. - **CIS (Cross - Image Interlaced Scanning)**: It introduces local pixel - level interaction and positional inductive bias, ensuring global search without losing local information. - **Implicit Low - Level Motion Descriptor**: As a non - visual prompt, it uses motion information to solve the problem of intermittent invisibility of the needle tip, enhancing the stability and consistency of tracking. Experimental results show that MambaXCTrack performs better than the existing state - of - the - art methods on phantoms and tissue samples, and the effectiveness of each module is verified through ablation studies.

MambaXCTrack: Mamba-based Tracker with SSM Cross-correlation and Motion Prompt for Ultrasound Needle Tracking

Ultrasound Robotic System to Multi-Approach Puncture for Endoscopic Spinal Surgery

Improving Needle Tip Tracking and Detection in Ultrasound-based Navigation System Using Deep Learning-enabled Approach

Needle Tip Tracking Based on Optical Imaging and AI

TipDet: A multi-keyframe motion-aware framework for tip detection during ultrasound-guided interventions

Medical needle tip tracking based on Optical Imaging and AI

FPSN-FNCC: an accurate and fast motion tracking algorithm in 3D ultrasound for image-guided interventions

Automatic and accurate needle detection in 2D ultrasound during robot-assisted needle insertion process

Miniaturized electromagnetic tracking enables efficient ultrasound-navigated needle insertions

A Novel Method for Enhanced Needle Localization Using Ultrasound-Guidance

MambaTrack: A Simple Baseline for Multiple Object Tracking with State Space Model

EchoTracker: Advancing Myocardial Point Tracking in Echocardiography

Motion-Guided Dual-Camera Tracker for Endoscope Tracking and Motion Analysis in a Mechanical Gastric Simulator

Tracking 3D ultrasound anatomical landmarks via three orthogonal plane-based scale discriminative correlation filter network

Optical Flow-Based Tracking of Needles and Needle-Tip Localization Using Circular Hough Transform in Ultrasound Images

Performance Enhanced Ultrasound Probe Tracking With a Hemispherical Marker Rigid Body

Ultrasound Transducer Tracking System For Correlation Of Masses In Combined X-Ray And Manual Breast Ultrasound Imaging

Development and evaluation of ultrasound image tracking technology based on Mask R-CNN applied to respiratory motion compensation system

Needle tracking in low-resolution ultrasound volumes using deep learning

Markerless Inside-Out Tracking for Interventional Applications

Weakly supervised multi-needle detection in 3D ultrasound images with bidirectional convolutional sparse coding