Abstract:Purpose. Ability to locate and track ultrasound images in the 3D operating space is of great benefit for multiple clinical applications. This is often accomplished by tracking the probe using a precise but expensive optical or electromagnetic tracking system. Our goal is to develop a simple and low cost augmented reality echography framework using a standard RGB-D Camera. Methods. A prototype system consisting of an Occipital Structure Core RGB-D camera, a specifically-designed 3D marker, and a fast point cloud registration algorithm FaVoR was developed and evaluated on an Ultrasonix ultrasound system. The probe was calibrated on a 3D-printed N-wire phantom using the software PLUS toolkit. The proposed calibration method is simplified, requiring no additional markers or sensors attached to the phantom. Also, a visualization software based on OpenGL was developed for the augmented reality application. Results. The calibrated probe was used to augment a real-world video in a simulated needle insertion scenario. The ultrasound images were rendered on the video, and visually-coherent results were observed. We evaluated the end-to-end accuracy of our AR US framework on localizing a cube of 5 cm size. From our two experiments, the target pose localization error ranges from 5.6 to 5.9 mm and from -3.9 to 4.2 degrees. Conclusion. We believe that with the potential democratization of RGB-D cameras integrated in mobile devices and AR glasses in the future, our prototype solution may facilitate the use of 3D freehand ultrasound in clinical routine. Future work should include a more rigorous and thorough evaluation, by comparing the calibration accuracy with those obtained by commercial tracking solutions in both simulated and real medical scenarios.

Design and test of a PC-based portable three-dimensional ultrasound software system Ultra3D

A software package for portable three-dimensional ultrasound imaging

Hand-held 3D Photoacoustic Imager with GPS

Freehand 3D Ultrasound Imaging Based on Probe-mounted Vision and IMU System

Real-time freehand 3D ultrasound imaging

Design and Implementation of Medical Ultrasound Remote Control Software Based on Sensor Design

Design and simulation of a 2-D array flexible ultrasound transducer system for tissue characterization – A pilot study

Three Dimensional Medical Imaging Software Based on PC

A Simplified 3D Ultrasound Freehand Imaging Framework Using 1D Linear Probe and Low-Cost Mechanical Track

A Review on Real-Time 3D Ultrasound Imaging Technology

[Software Design for a Portable Ultrasound Bone Densitometer].

3D Multi-Modality Free-Hand Ultrasound Imaging for Medical Research

Real-Time 3D Ultrasound Imaging System Based on a Hybrid Reconstruction Algorithm

Real-time ultrasound AR 3D visualization toward better topological structure perception for hepatobiliary surgery

3D Ultrasound Image Reconstruction from Irregularly Sampled 2D Images

Free Scan Real Time 3D Ultrasound Imaging with Shading Artefacts Removal

HoloPOCUS: Portable Mixed-Reality 3D Ultrasound Tracking, Reconstruction and Overlay

Open system for micro-ultrasound

Design and implementation of an in vivo 3-D fluorescent imaging system

A Novel Augmented Reality Ultrasound Framework Using an RGB-D Camera and a 3D-printed Marker

Interface Design and Control Strategies for a Robot Assisted Ultrasonic Examination System