Abstract:The International Journal of Robotics Research, Ahead of Print. Ultrasound (US) imaging is widely used for biometric measurement and diagnosis of internal organs due to the advantages of being real-time and radiation-free. However, due to inter-operator variations, resulting images highly depend on the experience of sonographers. This work proposes an intelligent robotic sonographer to autonomously "explore" target anatomies and navigate a US probe to standard planes by learning from the expert. The underlying high-level physiological knowledge from experts is inferred by a neural reward function, using a ranked pairwise image comparison approach in a self-supervised fashion. This process can be referred to as understanding the "language of sonography." Considering the generalization capability to overcome inter-patient variations, mutual information is estimated by a network to explicitly disentangle the task-related and domain features in latent space. The robotic localization is carried out in coarse-to-fine mode based on the predicted reward associated with B-mode images. To validate the effectiveness of the proposed reward inference network, representative experiments were performed on vascular phantoms ("line" target), two types of ex vivo animal organ phantoms (chicken heart and lamb kidney representing "point" target), and in vivo human carotids. To further validate the performance of the autonomous acquisition framework, physical robotic acquisitions were performed on three phantoms (vascular, chicken heart, and lamb kidney). The results demonstrated that the proposed advanced framework can robustly work on a variety of seen and unseen phantoms as well as in vivo human carotid data. Code: https://github.com/yuan-12138/MI-GPSR. Video: https://youtu.be/u4ThAA9onE0.

Robotic navigation with deep reinforcement learning in transthoracic echocardiography

Towards Autonomous Robotic Ultrasound Scanning Using the Reinforcement Learning-Based Volumetric Data Navigation Method

Autonomous Path Planning for Intercostal Robotic Ultrasound Imaging Using Reinforcement Learning

Deep reinforcement learning for guidewire navigation in coronary artery phantom

A zero-shot reinforcement learning strategy for autonomous guidewire navigation

Multi-degree-of-freedom Intelligent Ultrasound Robot System Based on Reinforcement Learning

Goal-conditioned reinforcement learning for ultrasound navigation guidance

Automated Heart and Lung Auscultation in Robotic Physical Examinations

Hierarchical Planning with Deep Reinforcement Learning for 3D Navigation of Microrobots in Blood Vessels

Learning Robotic Ultrasound Scanning Skills via Human Demonstrations and Guided Explorations

Intelligent robotic sonographer: Mutual information-based disentangled reward learning from few demonstrations

Deep reinforcement learning for drone navigation using sensor data

Hierarchical deep reinforcement learning controlled three-dimensional navigation of microrobots in blood vessels

Guidewire Navigation and Delivery System for Robot-Assisted Cardiology Interventions

Intelligent Navigation of a Magnetic Microrobot with Model-Free Deep Reinforcement Learning in a Real-World Environment

Autonomous navigation of catheters and guidewires in mechanical thrombectomy using inverse reinforcement learning

Vision-based navigation and obstacle avoidance via deep reinforcement learning

Deep Local Trajectory Replanning and Control for Robot Navigation

Model-Based Reinforcement Learning for Ultrasound-Driven Autonomous Microrobots

Safe Navigation for Robotic Digestive Endoscopy via Human Intervention-based Reinforcement Learning