Abstract:Objective: The objective of this feasibility study was to develop and assess a tele-ultrasound system that would enable an expert sonographer (situated at the remote site) to provide real-time guidance to an operator (situated at the imaging site) using a mixed-reality environment. Methods: An architecture along with the operational workflow of the system is designed and a prototype is developed that enables guidance in form of audiovisual cues. The visual cues comprise holograms (of the ultrasound images and ultrasound probe) and is rendered to the operator using a head-mounted display device. The position and orientation of the ultrasound probe's hologram are remotely controlled by the expert sonographer and guide the placement of a physical ultrasound probe at the imaging site. The developed prototype was evaluated for its performance on a network. In addition, a user study (with 12 participants) was conducted to assess the operator's ability to align the probe under different guidance modes. Results: The network performance revealed the view of the imaging site and ultrasound images were transferred to the remote site in 233 ± 42 and 158 ± 38 ms, respectively. The expert sonographer was able to transfer, to the imaging site, data related to position and orientation of the ultrasound probe's hologram in 78 ± 13 ms. The user study indicated that the audiovisual cues are sufficient for an operator to position and orient a physical probe for accurate depiction of the targeted tissue (p < 0.001). The probe's placement translational and rotational errors were 1.4 ± 0.6 mm and 5.4 ± 2.2º. Conclusion: The work illustrates the feasibility of using a mixed-reality environment for effective communication between an expert sonographer (ultrasound physician) and an operator. Further studies are required to determine its applicability in a clinical setting during tele-ultrasound.

Implementation Requirements and System Architecture for Mixed Reality Telepresence Application Scenario

Development of a Three-Dimensional Multimode Visual Immersive System With Applications in Telepresence

Virtual Reality Conferencing

Challenges in Implementing Low-Latency Holographic-Type Communication Systems

Viewpoint-Controllable Telepresence: A Robotic-Arm-Based Mixed-Reality Telecollaboration System

Collaborative System Design of Mixed Reality Communication for Medical Training

Real time stereo rendering for augmented reality on 3DTV system

Real-time stereoscopic rendering of realistic avatar for interactive 3D telepresence system

A Mixed Reality Telepresence System for Dissimilar Spaces Using Full-Body Avatar

A 3D Mixed Reality Interface for Human-Robot Teaming

3D telepresence for remote collaboration in extended reality (xR) application

Collaborative MR Workspace with Shared 3D Vision Based on Stereo Video Transmission

Mixed Reality: The Interface of the Future

Development and Evaluation of a Mixed-Reality Tele-ultrasound System

Head-worn mixed reality projection display application

REALISTIC NATURAL INTERACTION WITH VIRTUAL STATUES IN X-REALITY ENVIRONMENTS

Low-Complexity 3D-Vision Conferencing System Based on Accelerated RIFE Model

Extended Reality Telemedicine Collaboration System Using Patient Avatar Based on 3D Body Pose Estimation

ViewR: Architectural-Scale Multi-User Mixed Reality With Mobile Head-Mounted Displays

Remote Assistance with Mixed Reality for Procedural Tasks

Immersive teleconference system based on human-robot-avatar interaction using head-tracking devices