Abstract:Tele-echography has emerged as a promising and effective solution, leveraging the expertise of sonographers and the autonomy of robots to perform ultrasound scanning for patients residing in remote areas, without the need for in-person visits by the sonographer. Designing effective and natural human-robot interfaces for tele-echography remains challenging, with patient safety being a critical concern. In this article, we develop a teleoperation system for robot-assisted sonography with two different interfaces, a haptic device-based interface and a low-cost 3D Mouse-based interface, which can achieve continuous and intuitive telemanipulation by a leader device with a small workspace. To achieve compliant interaction with patients, we design impedance controllers in Cartesian space to track the desired position and orientation for these two teleoperation interfaces. We also propose comprehensive evaluation metrics of robot-assisted sonography, including subjective and objective evaluation, to evaluate tele-echography interfaces and control performance. We evaluate the ergonomic performance based on the estimated muscle fatigue and the acquired ultrasound image quality. We conduct user studies based on the NASA Task Load Index to evaluate the performance of these two human-robot interfaces. The tracking performance and the quantitative comparison of these two teleoperation interfaces are conducted by the Franka Emika Panda robot. The results and findings provide guidance on human-robot collaboration design and implementation for robot-assisted sonography. Note to Practitioners—Robot-assisted sonography has demonstrated efficacy in medical diagnosis during clinical trials. However, deploying fully autonomous robots for ultrasound scanning remains challenging due to various constraints in practice, such as patient safety, dynamic tasks, and environmental uncertainties. Semi-autonomous or teleoperation-based robot sonography represents a promising approach for practical deployment. Previous work has produced various expensive teleoperation interfaces but lacks user studies to guide teleoperation interface selection. In this article, we present two typical teleoperation interfaces and implement a continuous and intuitive teleoperation control system. We also propose a comprehensive evaluation metric for assessing their performance. Our findings show that the haptic device outperforms the 3D Mouse, based on operators’ feedback and acquired image quality. However, the haptic device requires more learning time and effort in the training stage. Furthermore, the developed teleoperation system offers a solution for shared control and human-robot skill transfer. Our results provide valuable guidance for designing and implementing human-robot interfaces for robot-assisted sonography in practice.

Combined perception, control, and learning for teleoperation: key technologies, applications, and challenges

Development of a Human-Robot Hybrid Intelligent System Based on Brain Teleoperation and Deep Learning SLAM

Enhancing Robot Teleoperation in Remote Automation Production Through an Event-Triggered Control Strategy

Unified Contact Model and Hybrid Motion/force Control for Teleoperated Manipulation in Unknown Environments

Teleoperation of Humanoid Robots: A Survey

A Teleoperation Framework for Mobile Robots Based on Shared Control

A Robot Learning Method with Physiological Interface for Teleoperation Systems

Still Not Solved: A Call for Renewed Focus on User-Centered Teleoperation Interfaces

Development of a Synchronized Human-Robot-Virtuality Interaction System Using Cooperative Robot and Motion Capture Device

Design of multi-modal feedback channel of human–robot cognitive interface for teleoperation in manufacturing

Design and Quantitative Assessment of Teleoperation-Based Human–Robot Collaboration Method for Robot-Assisted Sonography

Open-TeleVision: Teleoperation with Immersive Active Visual Feedback

Robotics Perception and Control: Key Technologies and Applications

Teleoperation and Visualization Interfaces for Remote Intervention in Space

Enhanced teleoperation performance using hybrid control and virtual fixture

Seamless Robot Teleoperation: Intuitive Control Through Hand Gestures and Neural Network Decoding

Learning compliant grasping and manipulation by teleoperation with adaptive force control

A Robotic Teleoperation System for Precise Robotic Manipulation by Human-Machine Interaction

Teleoperation system for multiple mobile robots

An Integrated Vision-Based System for Efficient Robot Arm Teleoperation

A Digital Map Based Mobile Robot Teleoperation System