Abstract:We have previously developed a robotic ultrasound imaging system for motion monitoring in abdominal radiation therapy. Owing to the slow speed of ultrasound image processing, our previous system could only track abdominal motions under breath-hold. To overcome this limitation, a novel 2D-based image processing method for tracking intra-fraction respiratory motion is proposed. Fifty-seven different anatomical features acquired from 27 sets of 2D ultrasound sequences were used in this study. Three 2D ultrasound sequences were acquired with the robotic ultrasound system from three healthy volunteers. The remaining datasets were provided by the 2015 MICCAI Challenge on Liver Ultrasound Tracking. All datasets were preprocessed to extract the feature point, and a patient-specific motion pattern was extracted by principal component analysis and slow feature analysis (SFA). The tracking finds the most similar frame (or indexed frame) by a k-dimensional-tree-based nearest neighbor search for estimating the tracked object location. A template image was updated dynamically through the indexed frame to perform a fast template matching (TM) within a learned smaller search region on the incoming frame. The mean tracking error between manually annotated landmarks and the location extracted from the indexed training frame is 1.80 ± 1.42 mm. Adding a fast TM procedure within a small search region reduces the mean tracking error to 1.14 ± 1.16 mm. The tracking time per frame is 15 ms, which is well below the frame acquisition time. Furthermore, the anatomical reproducibility was measured by analyzing the location's anatomical landmark relative to the probe; the position-controlled probe has better reproducibility and yields a smaller mean error across all three volunteer cases, compared to the force-controlled probe (2.69 versus 11.20 mm in the superior-inferior direction and 1.19 versus 8.21 mm in the anterior-posterior direction). Our method reduces the processing time for tracking respiratory motion significantly, which can reduce the delivery uncertainty.

A Novel Ultrasound Imaging Assistance UI: Using Marker‐Based Coordinate System for Real‐Time Breathing Monitoring and Probe Positioning

Self-Adaptive Ultrasound Scanning System for Imaging Human Spine

Guiding the Last Centimeter: Novel Anatomy-Aware Probe Servoing for Standardized Imaging Plane Navigation in Robotic Lung Ultrasound

A Qualitative and Quantitative Interaction Technique for Freehand 3D Ultrasound Imaging

Implicit Neural Representations for Breathing-compensated Volume Reconstruction in Robotic Ultrasound

Motion-capture technique-based interface screen displaying real-time probe position and angle in kidney ultrasonography

Development and evaluation of ultrasound image tracking technology based on Mask R-CNN applied to respiratory motion compensation system

Freehand 3D Ultrasound Imaging Based on Probe-mounted Vision and IMU System

Development of A Real-time POCUS Image Quality Assessment and Acquisition Guidance System

Real-time ultrasound AR 3D visualization toward better topological structure perception for hepatobiliary surgery

IMU-Assisted Manual 3D-Ultrasound Imaging Using Motion-Constrained Swept-Fan Scans

A-SEE: Active-Sensing End-Effector Enabled Probe Self-Normal-Positioning for Robotic Ultrasound Imaging Applications

Precise Repositioning of Robotic Ultrasound: Improving Registration-Based Motion Compensation Using Ultrasound Confidence Optimization

A Respiratory Monitoring System in Surgical Environment Based on Fiducial Markers Tracking

2D ultrasound imaging based intra-fraction respiratory motion tracking for abdominal radiation therapy using machine learning

A Novel Augmented Reality Ultrasound Framework Using an RGB-D Camera and a 3D-printed Marker

Online 4D Ultrasound-Guided Robotic Tracking Enables 3D Ultrasound Localisation Microscopy with Large Tissue Displacements

Automatic Probe Movement Guidance for Freehand Obstetric Ultrasound

Real-Time 3D Ultrasound Imaging System Based on a Hybrid Reconstruction Algorithm

Free Scan Real Time 3D Ultrasound Imaging with Shading Artefacts Removal

HoloPOCUS: Portable Mixed-Reality 3D Ultrasound Tracking, Reconstruction and Overlay