Abstract:Ultrasound image guidance could display the movement of soft tissue in real time, which provides an important basis for the operation path selection of tumor for examinations and interventions such as precise localization and puncture biopsy. However, factors such as tissue deformation, patient motion, and instrument contact pose great challenges for real-time smooth localization tracking of target tissues and maintaining a suitable acoustic window. Not only does it reduce the accuracy of ultrasound examination, but also may prolong the examination time. In this paper, a real-time autonomous ultrasound robot trajectory planning framework is proposed to achieve global scanning of breast tissue and real-time local tracking of suspicious tumor targets. In addition, an ultrasound suspicious tumor target next moment motion attitude and position estimation algorithm and an acceleration-continuous online trajectory generation (ACOTG) algorithm are proposed. Experiments on breast phantom showed that the fluctuation difference of both global scanning and tracking scanning force was less than 5 N $\pm$ 15%, and ACOTG takes less than 1 microsecond to calculate the next moment state. The position, velocity, and acceleration of the tracking path did not change abruptly when the unknown target changed. The ultrasound image of the suspected tumor target could always be smoothly maintained in a suitable acoustic window, while the errors between the center of the suspected tumor target image and the center of the acoustic window in the horizontal direction and the depth direction were less than $\pm$ 1 mm and 30 mm $\pm$ 10%, respectively. Note to Practitioners —The motivation of this study was to solve the clinical problem of difficulty in keeping the suspected breast tumor target stably in the center of the field of view under the influence of tissue deformation, patient motion and instrument contact in ultrasound guidance. We proposed the idea of global conventional scanning and local online tracking to achieve the autonomous scanning, detecting and tracking of suspicious tumor targets within the global scope of the breast. ACOTG algorithm is proposed and implemented, which can make the ultrasound image of suspicious tumor target can be displayed stably in the center of the acoustic window. With the help of this system, the accuracy of ultrasound examination can be improved and the time of examination can be reduced. The proposed system can also be applied to ultrasound scanning of other parts of the body.

Ultrasound-Guided Robotic Autonomous Operation Based on Real-Time Deformation Tracking and Prediction

Ultrasound Image Guided and Mixed Reality-Based Surgical System With Real-Time Soft Tissue Deformation Computing for Robotic Cervical Pedicle Screw Placement

Autonomous Robotic Ultrasound Vascular Imaging System with Decoupled Control Strategy for External-Vision-Free Environments.

Autonomous Tissue Scanning under Free-Form Motion for Intraoperative Tissue Characterisation

Real-time Prediction of Soft Tissue Deformations Using Data-driven Nonlinear Presurgical Simulations

Autonomous Trajectory Planning for Ultrasound-Guided Real-Time Tracking of Suspicious Breast Tumor Targets

Motion-Aware Robotic 3D Ultrasound

Clean visual field reconstruction in robot-assisted laparoscopic surgery based on dynamic prediction

Recovering tissue deformation

Towards Autonomous Robotic Minimally Invasive Ultrasound Scanning and Vessel Reconstruction on Non-Planar Surfaces

Collaborative Robotic Ultrasound Tissue Scanning for Surgical Resection Guidance in Neurosurgery

Soft Tissue Deformation Tracking For Robotic Assisted Minimally Invasive Surgery

Towards transcervical ultrasound image guidance for transoral robotic surgery

Real-to-Sim Registration of Deformable Soft Tissue with Position-Based Dynamics for Surgical Robot Autonomy

Three-Dimensional Tissue Deformation Recovery and Tracking.

Virtual‐force‐guided intraoperative ultrasound scanning with online lesion location prediction: A phantom study

An Adaptive Control Method and Learning Strategy for Ultrasound-Guided Puncture Robot

Dynamic guidance for robotic surgery using image-constrained biomechanical models.

Towards Safe and Collaborative Robotic Ultrasound Tissue Scanning in Neurosurgery

Computerized Medical Imaging and Graphics

Real-to-Sim Deformable Object Manipulation: Optimizing Physics Models with Residual Mappings for Robotic Surgery