Abstract:Navigating the ultrasound (US) probe to the standardized imaging plane (SIP) for image acquisition is a critical but operator-dependent task in conventional freehand diagnostic US. Robotic US systems (RUSS) offer the potential to enhance imaging consistency by leveraging real-time US image feedback to optimize the probe pose, thereby reducing reliance on operator expertise. However, determining the proper approach to extracting generalizable features from the US images for probe pose adjustment remain challenging. In this work, we propose a SIP navigation framework for RUSS, exemplified in the context of robotic lung ultrasound (LUS). This framework facilitates automatic probe adjustment when in proximity to the SIP. This is achieved by explicitly extracting multiple anatomical features presented in real-time LUS images and performing non-patient-specific template matching to generate probe motion towards the SIP using image-based visual servoing (IBVS). This framework is further integrated with the active-sensing end-effector (A-SEE), a customized robot end-effector that leverages patient external body geometry to maintain optimal probe alignment with the contact surface, thus preserving US signal quality throughout the navigation. The proposed approach ensures procedural interpretability and inter-patient adaptability. Validation is conducted through anatomy-mimicking phantom and in-vivo evaluations involving five human subjects. The results show the framework's high navigation precision with the probe correctly located at the SIP for all cases, exhibiting positioning error of under 2 mm in translation and under 2 degree in rotation. These results demonstrate the navigation process's capability to accomondate anatomical variations among patients.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to automatically navigate the ultrasound probe to the Standardized Imaging Plane (SIP) in Robotic Lung Ultrasound (LUS) to improve the consistency and accuracy of image acquisition. Specifically, the paper focuses on how to generate probe movement by real - time extraction of multiple anatomical features in ultrasound images and non - patient - specific template matching when approaching SIP, thereby achieving automatic probe adjustment. This process aims to reduce the dependence on the operator's experience and improve the consistency of imaging results among different patients. ### Main Challenges 1. **Difficulty in Interpreting Ultrasound Images**: Ultrasound images are planar images with limited information and are easily affected by noise and artifacts, making it difficult to automatically identify useful content. 2. **Variability among Patients**: The same anatomical structure in different patients may present different images, making SIP navigation difficult to generalize to different clinical cases. 3. **Alignment Problem between Probe and Contact Surface**: When the alignment between the probe and the tissue is poor, the quality of the echo signal will decline, affecting the robustness of navigation. ### Solutions The paper proposes a SIP navigation framework that combines artificial intelligence (AI) and Image - Based Visual Servoing (IBVS). The specific contributions are as follows: 1. **SIP Navigation Framework**: A real - time framework is introduced, which uses a convolutional neural network (CNN) to generate instance masks, identify multiple anatomical structures, and is further used for in - plane probe servo control. 2. **Anatomical Feature Map (AFM)**: A novel concept, AFM, is proposed to extract general visual features from the current ultrasound image for robust IBVS in - plane servo control. 3. **Active Sensing End - Effector (A - SEE)**: A customized robotic end - effector A - SEE is integrated, which ensures the best ultrasound image quality throughout the navigation process by continuously adjusting the probe direction. ### Experimental Verification This framework has been verified on simulated phantoms and multiple human subjects. The results show that the probe can be positioned at SIP with millimeter - level precision, with a translation error of less than 2 millimeters and a rotation error of less than 2 degrees. These results indicate that this navigation process can adapt to anatomical variations among different patients. ### Future Prospects Although the preliminary results demonstrate the effectiveness of this framework in guiding robotic LUS procedures, its performance in other soft - tissue examinations (such as liver and thyroid ultrasounds) still needs further verification. In the future, this framework can be applied to various ultrasound examinations by implementing specific anatomical feature detection modules.

Guiding the Last Centimeter: Novel Anatomy-Aware Probe Servoing for Standardized Imaging Plane Navigation in Robotic Lung Ultrasound

Compliant Joint Based Robotic Ultrasound Scanning System for Imaging Human Spine

A-SEE: Active-Sensing End-Effector Enabled Probe Self-Normal-Positioning for Robotic Ultrasound Imaging Applications

Ultrasound Robotic System to Multi-Approach Puncture for Endoscopic Spinal Surgery

Image-Guided Teleoperation for Soft Bronchoscopy Robot

Precise Repositioning of Robotic Ultrasound: Improving Registration-Based Motion Compensation Using Ultrasound Confidence Optimization

Towards Autonomous Robotic Minimally Invasive Ultrasound Scanning and Vessel Reconstruction on Non-Planar Surfaces

Image-Guided Navigation of a Robotic Ultrasound Probe for Autonomous Spinal Sonography Using a Shadow-aware Dual-Agent Framework

Towards Autonomous Atlas-based Ultrasound Acquisitions in Presence of Articulated Motion

Motion-Aware Robotic 3D Ultrasound

Visual Perception and Convolutional Neural Network-Based Robotic Autonomous Lung Ultrasound Scanning Localization System

Autonomous Robotic Ultrasound Vascular Imaging System with Decoupled Control Strategy for External-Vision-Free Environments.

Full-Coverage Path Planning and Stable Interaction Control for Automated Robotic Breast Ultrasound Scanning

Ultrasound Calibration for Dual-Armed Surgical Navigation System

Ultrasound Probe and Hand-Eye Calibrations for Robot-Assisted Needle Biopsy

Autonomous ultrasound scanning robotic system based on human posture recognition and image servo control: an application for cardiac imaging

Autonomous Robotic System for Carotid Artery Ultrasound Scanning with Visual Servo Navigation

A Portable Robot-Assisted Device With Built-In Intelligence for Autonomous Ultrasound Acquisitions in Follow-Up Diagnosis

Towards Safe and Collaborative Robotic Ultrasound Tissue Scanning in Neurosurgery

Freehand 3D Ultrasound Imaging Based on Probe-mounted Vision and IMU System

Automatic ultrasound scanning robotic system with optical waveguide-based force measurement