Abstract:Multi-spectral video endoscopy provides considerable potential for early stage cancer detection. Previous multi-spectral image acquisition systems were of limited use for endoscopy due to (i) the necessary spatial scanning of push-broom approaches or (ii) the impractical long switching times of liquid crystal tunable filters. Recent technological advances in the field of tuneable filters, in particular fast acousto-optical tunable filters (AOTF), make switching times below 1ms feasible. Thus, AOTFs represent a suitable technology for the acquisition of hyper-spectral image and multi-spectral video data with excellent spatial and temporal resolution. In this paper, we propose a hyper-spectral imaging endoscope using a fast AOTF synchronized with a highly sensitive EMCCD camera for the detection of cancerous tissue. The setup demonstrates that the acquisition of hyper-spectral image and multi-spectral video data is feasible and enables the augmentation of endoscopic videos with overlays indicating cancerous tissue regions.Using hyper-spectral measurements from biopsies acquired with the setup in a clinical environment it is shown that the spectral characteristic of cancerous regions is tissue dependent. Even a sophisticated classifier such as a Support Vector Machines (SVM) or a Mixture of Gaussian Classifier (MOGC) cannot generalize the discriminative information if the training set contains measurements from different tissue types (e.g. larynx vs. parotid). In contrast, a training data selection scheme that chooses similar training sets for a given test set achieves a better prediction accuracy using an approach based on a Quadratic Discriminant Classifier (QDC) with the important advantage of improved robustness and less liability to overtraining. Combined with an image registration removing motion-based acquisition artefacts, the spectral information allows the augmentation of the video stream with overlays indicating cancerous tissue regions.

A Triple Endoscope System for Alignment of Multispectral Images of Moving Tissue

Multispectral Image Alignment Using a Three Channel Endoscope in Vivo During Minimally Invasive Surgery.

Multispectral Endoscopic Imaging Studies on the Tissue Components of Gastrointestinal Mucosa

A Multiparameter Tissue-Mimicking Phantom for Multispectral Endoscopic Imaging

Multi-spectral video endoscopy system for the detection of cancerous tissue

Stroboscopic Illumination Scheme for Seamless 3D Endoscopy

A Low-Cost Real-Time Three-Dimensional Confocal Fluorescence Endomicroscopy Imaging System

A Time-of-Flight Stereoscopic Endoscope for Anatomical 3D Reconstruction

Snapshot Multispectral Endomicroscopy.

Robotic Control of a Multi-Modal Rigid Endoscope Combining Optical Imaging with All-Optical Ultrasound

Force Adaptive Multi-Spectral Imaging with an Articulated Robotic Endoscope.

An Endoscope Designed with 3d Measurement Functions

Two-site microendoscopic imaging probe for simultaneous three-dimensional imaging at two anatomic locations in tissues

A Rapid Multispectral Endoscopic Imaging System for in Vivo Assessment of the Morphological and Physiological Characteristics of Mouse Intestines.

Multispectral Stereo-Image Fusion for 3D Hyperspectral Scene Reconstruction

Compact Dual-Channel (hyperspectral and Video) Endoscopy

Rapid multispectral endoscopic imaging system for in vivo assessing morphological and physiological characteristics of mouse intestinal

An Endoscopic Structured Lighting Probe Using Spectral Encoding

Multisource Differential Fusion Driven Monocular Endoscope Hybrid 3-D Tracking for Advanced Endoscopic Navigation Surgery

Multispectral Image Analysis for Patient Tissue Tracking During Complex Interventions.

The Design and Implementation of a Low-Cost Multispectral Endoscopy Through Galvo Scanning of a Fiber Bundle