Abstract:Significance: Minimally invasive surgery (MIS) has shown vast improvement over open surgery by reducing post-operative stays, intraoperative blood loss, and infection rates. However, in spite of these improvements, there are still prevalent issues surrounding MIS that may be addressed through hyperspectral imaging (HSI). We present a laparoscopic HSI system to further advance the field of MIS. Aim: We present an imaging system that integrates high-speed HSI technology with a clinical laparoscopic setup and validate the system's accuracy and functionality. Different configurations that cover the visible (VIS) to near-infrared (NIR) range of electromagnetism are assessed by gauging the spectral fidelity and spatial resolution of each hyperspectral camera. Approach: Standard Spectralon reflectance tiles were used to provide ground truth spectral footprints to compare with those acquired by our system using the root mean squared error (RMSE). Demosaicing techniques were investigated and used to measure and improve spatial resolution, which was assessed with a USAF resolution test target. A perception-based image quality evaluator was used to assess the demosaicing techniques we developed. Two configurations of the system were developed for evaluation. The functionality of the system was investigated in a phantom study and by imaging ex vivo tissues. Results: Multiple configurations of our system were tested, each covering different spectral ranges, including VIS (460 to 600 nm), red/NIR (RNIR) (610 to 850 nm), and NIR (665 to 950 nm). Each configuration is capable of achieving real-time imaging speeds of up to 20 frames per second. RMSE values of 3.51 ± 2.03 % , 3.43 ± 0.84 % , and 3.47% were achieved for the VIS, RNIR, and NIR systems, respectively. We obtained sub-millimeter resolution using our demosaicing techniques. Conclusions: We developed and validated a high-speed hyperspectral laparoscopic imaging system. The HSI system can be used as an intraoperative imaging tool for tissue classification during laparoscopic surgery.

Surgical optomics: hyperspectral imaging and deep learning towards precision intraoperative automatic tissue recognition—results from the EX-MACHYNA trial

A Multiparameter Tissue-Mimicking Phantom for Multispectral Endoscopic Imaging

Automated Ovarian Cancer Identification Using End-to-End Deep Learning and Second Harmonic Generation Imaging

Analysis of Intraoperative Microscopy Imaging Techniques and Their Future Applications

Intra-operative Brain Tumor Detection with Deep Learning-Optimized Hyperspectral Imaging

Spectral organ fingerprints for machine learning-based intraoperative tissue classification with hyperspectral imaging in a porcine model

Endoscopic In Vivo Hyperspectral Imaging for Head and Neck Tumor Surgeries Using a Medically Approved CE-Certified Camera with Rapid Visualization During Surgery

Hyperspectral Imaging for Colon Cancer Classification in Surgical Specimens: Towards Optical Biopsy During Image-Guided Surgery

Spectral characterization of intraoperative renal perfusion using hyperspectral imaging and artificial intelligence

Hyperspectral Imaging for Glioblastoma Surgery: Improving Tumor Identification Using a Deep Spectral-Spatial Approach

Video-rate multispectral imaging in laparoscopic surgery: First-in-human application

Advancing laser ablation assessment in hyperspectral imaging through machine learning

Deep intra-operative illumination calibration of hyperspectral cameras

Uncertainty-Aware Organ Classification for Surgical Data Science Applications in Laparoscopy

Robust deep learning-based semantic organ segmentation in hyperspectral images

Hyperspectral imaging for tissue classification in glioblastoma tumor patients: a deep spectral-spatial approach

A Hyperspectral Imaging Dataset and Methodology for Intraoperative Pixel-Wise Classification of Metastatic Colon Cancer in the Liver

Design and validation of a high-speed hyperspectral laparoscopic imaging system

Workflow and hardware for intraoperative hyperspectral data acquisition in neurosurgery

Automatic Tissue Differentiation in Parotidectomy using Hyperspectral Imaging

RGB to Hyperspectral: Spectral Reconstruction for Enhanced Surgical Imaging