Abstract:PurposeAutonomous ultrasound imaging by robotic ultrasound scanning systems in complex soft uncertain clinical environments is important and challenging to assist in therapy. To cope with the complex environment faced by the ultrasound probe during the scanning process, we propose an autonomous robotic ultrasound (US) control method based on reinforcement learning (RL) model to build the relationship between the environment and the system. The proposed method requires only contact force as input information to achieve robot control of the posture and contact force of the probe without any a priori information about the target and the environment.MethodsFirst, an RL agent is proposed and trained by a policy gradient theorem-based RL model with the 6-degree-of-freedom (DOF) contact force of the US probe to learn the relationship between contact force and output force directly. Then, a force control strategy based on the admittance controller is proposed for synchronous force, orientation and position control by defining the desired contact force as the action space.ResultsThe proposed method was evaluated via collected US images, contact force and scan trajectories by scanning an unknown soft phantom. The experimental results indicated that the proposed method differs from the free-hand scanned approach in the US images within 3 ± 0.4%. The analysis results of contact forces and trajectories indicated that our method could make stable scanning processes on a soft uncertain skin surface and obtained US images.ConclusionWe propose a concise and efficient force-guided US robot scanning control method for soft uncertain environment based on reinforcement learning. Experimental results validated our method's feasibility and validity for complex skin surface scanning, and the volunteer experiments indicated the potential application value in the complex clinical environment of robotic US imaging system especially with limited visual information.

Lightweight Force-Controlled Device for Freehand Ultrasound Acquisition.

Portable Device to Assist with Force Control in Ultrasound Acquisition.

Force and Position Control System for Freehand Ultrasound

Compliant Joint Based Robotic Ultrasound Scanning System for Imaging Human Spine

A Novel Ultrasound Robot With Force/Torque Measurement and Control for Safe and Efficient Scanning

Cable-Driven Light-Weighting and Portable System for Robotic Medical Ultrasound Imaging

Automatic ultrasound scanning robotic system with optical waveguide-based force measurement

Force-Driven Robotic Drag Control For Freehand 3d Ultrasound-Guided Robot-Assisted Percutaneous Surgery

A Flexible and Fully Autonomous Breast Ultrasound Scanning System

A Constant-Force End-Effector With Online Force Adjustment for Robotic Ultrasonography

A-SEE: Active-Sensing End-Effector Enabled Probe Self-Normal-Positioning for Robotic Ultrasound Imaging Applications

Force control for the robot-assisted laparoscopic ultrasound scanning system

Ultrasound Probe Movement Analysis Using Depth Camera with Compact Handle Design for Probe Contact Force Measurement

Design and Evaluation of a Compliant Quasi Direct Drive End-effector for Safe Robotic Ultrasound Imaging

Force Tracking Control Method for Robotic Ultrasound Scanning System under Soft Uncertain Environment

Force-guided autonomous robotic ultrasound scanning control method for soft uncertain environment

Freehand 3D Ultrasound Imaging Based on Probe-mounted Vision and IMU System

A Wearable Ultrasound Interface for Prosthetic Hand Control

Safe Contact Force Generation for Robotic Thyroid Ultrasound Imaging