Abstract:Surgery is a crucial treatment for malignant brain tumors where gross total resection improves the prognosis. Tissue samples taken during surgery are either subject to a preliminary intraoperative histological analysis, or sent for a full pathological evaluation which can take days or weeks. Whereas a lengthy complete pathological analysis includes an array of techniques to be executed, a preliminary tissue analysis on frozen tissue is performed as quickly as possible (30-45 minutes on average) to provide fast feedback to the surgeon during the surgery. The surgeon uses the information to confirm that the resected tissue is indeed tumor and may, at least in theory, initiate repeated biopsies to help achieve gross total resection. However, due to the total turn-around time of the tissue inspection for repeated analyses, this approach may not be feasible during a single surgery. In this context, intraoperative image-guided techniques can improve the clinical workflow for tumor resection and improve outcome by aiding in the identification and removal of the malignant lesion. Hyperspectral imaging (HSI) is an optical imaging technique with the potential to extract combined spectral-spatial information. By exploiting HSI for human brain-tissue classification in 13 in-vivo hyperspectral images from 9 patients, a brain-tissue classifier is developed. The framework consists of a hybrid 3D-2D CNN-based approach and a band-selection step to enhance the capability of extracting both spectral and spatial information from the hyperspectral images. An overall accuracy of 77% was found when tumor, normal and hyper-vascularized tissue are classified, which clearly outperforms the state-of-the-art approaches (SVM, 2D-CNN). These results may open an attractive future perspective for intraoperative brain-tumor classification using HSI.

Identifying chromophore fingerprints of brain tumor tissue on hyperspectral imaging using principal component analysis

Hyperspectral imaging for tissue classification in glioblastoma tumor patients: a deep spectral-spatial approach

Hyperspectral Imaging for Glioblastoma Surgery: Improving Tumor Identification Using a Deep Spectral-Spatial Approach

Automated Classification of Brain Tissue: Comparison Between Hyperspectral Imaging and Diffuse Reflectance Spectroscopy.

An Intraoperative Visualization System Using Hyperspectral Imaging To Aid In Brain Tumor Delineation

Hyperspectral imaging for head and neck cancer detection: specular glare and variance of the tumor margin in surgical specimens

Blood Cancer Diagnosis Using Hyperspectral Imaging Assisted with Forward Searching Method and Machine Learning

Superpixel-based Spectral Classification for the Detection of Head and Neck Cancer with Hyperspectral Imaging

Supervised Machine Learning Methods and Hyperspectral Imaging Techniques Jointly Applied for Brain Cancer Classification

In-Vivo Hyperspectral Human Brain Image Database for Brain Cancer Detection

Hybrid brain tumor classification of histopathology hyperspectral images by linear unmixing and an ensemble of deep neural networks

Workflow and hardware for intraoperative hyperspectral data acquisition in neurosurgery

Intra-operative Brain Tumor Detection with Deep Learning-Optimized Hyperspectral Imaging

Applications of Hyperspectral Imaging in the Detection and Diagnosis of Solid Tumors

Spatio-spectral classification of hyperspectral images for brain cancer detection during surgical operations

Deep Learning-Based Correction and Unmixing of Hyperspectral Images for Brain Tumor Surgery

In Vivo Use of Hyperspectral Imaging to Develop A Noncontact Endoscopic Diagnosis Support System for Malignant Colorectal Tumors

Deformable Registration of Histological Cancer Margins to Gross Hyperspectral Images using Demons

Fusing Multiple Deep Models for in Vivo Human Brain Hyperspectral Image Classification to Identify Glioblastoma Tumor

Hyperspectral Imaging for Colon Cancer Classification in Surgical Specimens: Towards Optical Biopsy During Image-Guided Surgery

Spectral organ fingerprints for machine learning-based intraoperative tissue classification with hyperspectral imaging in a porcine model