Abstract:Multi-spectral video endoscopy provides considerable potential for early stage cancer detection. Previous multi-spectral image acquisition systems were of limited use for endoscopy due to (i) the necessary spatial scanning of push-broom approaches or (ii) the impractical long switching times of liquid crystal tunable filters. Recent technological advances in the field of tuneable filters, in particular fast acousto-optical tunable filters (AOTF), make switching times below 1ms feasible. Thus, AOTFs represent a suitable technology for the acquisition of hyper-spectral image and multi-spectral video data with excellent spatial and temporal resolution. In this paper, we propose a hyper-spectral imaging endoscope using a fast AOTF synchronized with a highly sensitive EMCCD camera for the detection of cancerous tissue. The setup demonstrates that the acquisition of hyper-spectral image and multi-spectral video data is feasible and enables the augmentation of endoscopic videos with overlays indicating cancerous tissue regions.Using hyper-spectral measurements from biopsies acquired with the setup in a clinical environment it is shown that the spectral characteristic of cancerous regions is tissue dependent. Even a sophisticated classifier such as a Support Vector Machines (SVM) or a Mixture of Gaussian Classifier (MOGC) cannot generalize the discriminative information if the training set contains measurements from different tissue types (e.g. larynx vs. parotid). In contrast, a training data selection scheme that chooses similar training sets for a given test set achieves a better prediction accuracy using an approach based on a Quadratic Discriminant Classifier (QDC) with the important advantage of improved robustness and less liability to overtraining. Combined with an image registration removing motion-based acquisition artefacts, the spectral information allows the augmentation of the video stream with overlays indicating cancerous tissue regions.

Snapshot Multispectral Endomicroscopy.

Multispectral Endoscopic Imaging Studies on the Tissue Components of Gastrointestinal Mucosa

A Multiparameter Tissue-Mimicking Phantom for Multispectral Endoscopic Imaging

A Multimodal Sensing CMOS Imager Based on Dual‐Focus Imaging(Adv. Sci. 14/2023)

Rapid multispectral endoscopic imaging system for in vivo assessing morphological and physiological characteristics of mouse intestinal

The Design and Implementation of a Low-Cost Multispectral Endoscopy Through Galvo Scanning of a Fiber Bundle

Snapshot Hyperspectral Volumetric Microscopy

Hyperspectral High-Dynamic-range Endoscopic Mucosal Imaging

Light-field Micro-Endoscopy Using a Fiber Bundle: a Snapshot 3D Epi-Fluorescence Endoscope

Portable Multi-Spectral Lens-Less Microscope with Wavelength-Self-calibrating Imaging Sensor

Emerging Fiber-Optic Endomicroscopy Technologies Towards Noninvasive Real-Time Visualization of Histology in Situ

Computational Snapshot Multispectral Cameras: Toward dynamic capture of the spectral world.

Multicore-fiber microendoscopy for functional cellular in-organ imaging

Side-port Endoscopic Imaging System with Macroscopic and Microscopic Field of View

Single-shot hybrid photoacoustic-fluorescent microendoscopy through a multi-mode fiber with wavefront shaping

Snapshot fiber spectral imaging using speckle correlations and compressive sensing

Image scanning lensless fiber-bundle endomicroscopy

Snapshot Multispectral Imaging Using a Diffractive Optical Network

Fast volumetric fluorescence imaging with multimode fibers

Probe-based Rapid Hybrid Hyperspectral and Tissue Surface Imaging Aided by Fully Convolutional Networks

Multi-spectral video endoscopy system for the detection of cancerous tissue