Abstract:PurposeAutonomous ultrasound imaging by robotic ultrasound scanning systems in complex soft uncertain clinical environments is important and challenging to assist in therapy. To cope with the complex environment faced by the ultrasound probe during the scanning process, we propose an autonomous robotic ultrasound (US) control method based on reinforcement learning (RL) model to build the relationship between the environment and the system. The proposed method requires only contact force as input information to achieve robot control of the posture and contact force of the probe without any a priori information about the target and the environment.MethodsFirst, an RL agent is proposed and trained by a policy gradient theorem-based RL model with the 6-degree-of-freedom (DOF) contact force of the US probe to learn the relationship between contact force and output force directly. Then, a force control strategy based on the admittance controller is proposed for synchronous force, orientation and position control by defining the desired contact force as the action space.ResultsThe proposed method was evaluated via collected US images, contact force and scan trajectories by scanning an unknown soft phantom. The experimental results indicated that the proposed method differs from the free-hand scanned approach in the US images within 3 ± 0.4%. The analysis results of contact forces and trajectories indicated that our method could make stable scanning processes on a soft uncertain skin surface and obtained US images.ConclusionWe propose a concise and efficient force-guided US robot scanning control method for soft uncertain environment based on reinforcement learning. Experimental results validated our method's feasibility and validity for complex skin surface scanning, and the volunteer experiments indicated the potential application value in the complex clinical environment of robotic US imaging system especially with limited visual information.

The Proposal of Spiral Ascending Scanning Method for Pregnant Woman Ultrasound Support Robot, Built through the Analyzation of Mechanism of Contact Point of It

Compliant Joint Based Robotic Ultrasound Scanning System for Imaging Human Spine

Autonomous scanning motion generation adapted to individual differences in abdominal shape for robotic fetal ultrasound

Self-Adaptive Ultrasound Scanning System for Imaging Human Spine

A Flexible and Fully Autonomous Breast Ultrasound Scanning System

A Novel Ultrasound Robot With Force/Torque Measurement and Control for Safe and Efficient Scanning

Full-Coverage Path Planning and Stable Interaction Control for Automated Robotic Breast Ultrasound Scanning

Automatic ultrasound scanning robotic system with optical waveguide-based force measurement

Immersive Virtual Reality Platform for Robot-Assisted Antenatal Ultrasound Scanning

Robotic-assisted Ultrasound for Fetal Imaging: Evolution from Single-arm to Dual-arm System

Diagnostic Posture Control System for Seated-Style Echocardiography Robot

Automatic Generation of Autonomous Ultrasound Scanning Trajectory Based on 3-D Point Cloud

Force Tracking Control Method for Robotic Ultrasound Scanning System under Soft Uncertain Environment

Toward Fully Automated Robotic Platform for Remote Auscultation

Fetus Support Manipulator with Flexible Balloon-Based Stabilizer for Endoscopic Intrauterine Surgery

Automatic Probe Movement Guidance for Freehand Obstetric Ultrasound

Multi-Modal Interaction Control of Ultrasound Scanning Robots with Safe Human Guidance and Contact Recovery

Safe Contact Force Generation for Robotic Thyroid Ultrasound Imaging

Design And Evaluation Of A Flexible Manipulator For Endoscope Intrauterine Surgery

Force-guided autonomous robotic ultrasound scanning control method for soft uncertain environment