Abstract:Optical fiber bundle based endomicroscopy is a low-cost optical biopsy technique for in vivo cellular level imaging. A limitation of such an imaging system, however, is its small field-of-view (FOV), typically less than 1 mm(2). With such a small FOV it is difficult to associate individual image frames with the larger scale anatomical structure. Video-sequence mosaicking algorithms have been proposed as a solution for increasing the image FOV while maintaining cellular-level resolution by stitching together the endomicroscopy images. Although extensive research has focused on image processing and mosaicking algorithms, there has been limited work on localization of the probe to assist with building high quality mosaics over large areas of tissue.In this paper, we propose the use of electromagnetic (EM) navigation to assist with large-area mosaicking of hand-held high-resolution endomicroscopy probes. A six degree-of-freedom EM sensor is used to track in real-time the position and orientation of the tip of the imaging probe during free-hand scanning. We present a proof-of-principle system for EM-video data co-calibration and registration and then describe a two-step image registration algorithm that assists mosaic reconstruction. Preliminary experimental investigations are carried out on phantoms and ex vivo porcine tissue for free-hand scanning. The results demonstrate that the proposed methodology significantly improves the quality and accuracy of reconstructed mosaics compared to reconstructions based only on conventional pair-wise image registration. In principle, this approach can be applied to other optical biopsy techniques such as confocal endomicroscopy and endocytoscopy.

Autonomous Scanning for Endomicroscopic Mosaicing and 3D Fusion

From Macro to Micro: Autonomous Multiscale Image Fusion for Robotic Surgery.

Robot assisted endomicroscopic image mosaicing with optimal surface coverage and reconstruction

Autonomous Tissue Scanning under Free-Form Motion for Intraoperative Tissue Characterisation

Three-dimensional Robotic-Assisted Endomicroscopy with a Force Adaptive Robotic Arm.

Cooperative In Situ Microscopic Scanning And Simultaneous Tissue Surface Reconstruction Using A Compliant Robotic Manipulator

Autonomous Ultrasound-Guided Tissue Dissection

A framework for sensorless and autonomous probe-tissue contact management in robotic endomicroscopic scanning.

Intraoperative Robotic-Assisted Large-Area High-Speed Microscopic Imaging and Intervention.

Development of a Large Area Scanner for Intraoperative Breast Endomicroscopy.

Motion-Compensated Autonomous Scanning for Tumour Localisation using Intraoperative Ultrasound

A Miniaturised Robotic Probe for Real-Time Intraoperative Fusion of Ultrasound and Endomicroscopy.

Robotic Arm Platform for Multi-View Image Acquisition and 3D Reconstruction in Minimally Invasive Surgery

Monocular tissue reconstruction via remote center motion for robot-assisted minimally invasive surgery

Electromagnetic Tracking of Handheld High-Resolution Endomicroscopy Probes to Assist with Real-Time Video Mosaicking

Flexible Robotic Scanning Device for Intraoperative Endomicroscopy in MIS

A Surgeon Preference-Guided Autonomous Instrument Tracking Method With a Robotic Flexible Endoscope Based on dVRK Platform

Force Adaptive Robotically Assisted Endomicroscopy for Intraoperative Tumour Identification

MEDiC: Autonomous Surgical Robotic Assistance to Maximizing Exposure for Dissection and Cautery

Two Dimensional Position-Based Visual Servoing for Soft Tissue Endomicroscopy

Robot-Assisted Optical Coherence Tomography for Automatic Wide-Field Scanning