Antibiotic resistance. Control strategies.

B. Cunha

DOI: https://doi.org/10.1016/S0749-0704(05)70397-3

IF: 3.879

1998-04-01

Critical Care Clinics

Abstract:

What problem does this paper attempt to address?

Impact of Pre- and Post-Processing Steps for Supervised Classification of Colorectal Cancer in Hyperspectral Images

Mariia Tkachenko,Claire Chalopin,Boris Jansen-Winkeln,Thomas Neumuth,Ines Gockel,Marianne Maktabi

DOI: https://doi.org/10.3390/cancers15072157

2023-04-05

Abstract:Background: Recent studies have shown that hyperspectral imaging (HSI) combined with neural networks can detect colorectal cancer. Usually, different pre-processing techniques (e.g., wavelength selection and scaling, smoothing, denoising) are analyzed in detail to achieve a well-trained network. The impact of post-processing was studied less. Methods: We tested the following methods: (1) Two pre-processing techniques (Standardization and Normalization), with (2) Two 3D-CNN models: Inception-based and RemoteSensing (RS)-based, with (3) Two post-processing algorithms based on median filter: one applies a median filter to a raw predictions map, the other applies the filter to the predictions map after adopting a discrimination threshold. These approaches were evaluated on a dataset that contains ex vivo hyperspectral (HS) colorectal cancer records of 56 patients. Results: (1) Inception-based models perform better than RS-based, with the best results being 92% sensitivity and 94% specificity; (2) Inception-based models perform better with Normalization, RS-based with Standardization; (3) Our outcomes show that the post-processing step improves sensitivity and specificity by 6.6% in total. It was also found that both post-processing algorithms have the same effect, and this behavior was explained. Conclusion: HSI combined with tissue classification algorithms is a promising diagnostic approach whose performance can be additionally improved by the application of the right combination of pre- and post-processing.
Supervised Machine Learning Methods and Hyperspectral Imaging Techniques Jointly Applied for Brain Cancer Classification

Gemma Urbanos,Alberto Martín,Guillermo Vázquez,Marta Villanueva,Manuel Villa,Luis Jimenez-Roldan,Miguel Chavarrías,Alfonso Lagares,Eduardo Juárez,César Sanz

DOI: https://doi.org/10.3390/s21113827

2021-05-31

Abstract:Hyperspectral imaging techniques (HSI) do not require contact with patients and are non-ionizing as well as non-invasive. As a consequence, they have been extensively applied in the medical field. HSI is being combined with machine learning (ML) processes to obtain models to assist in diagnosis. In particular, the combination of these techniques has proven to be a reliable aid in the differentiation of healthy and tumor tissue during brain tumor surgery. ML algorithms such as support vector machine (SVM), random forest (RF) and convolutional neural networks (CNN) are used to make predictions and provide in-vivo visualizations that may assist neurosurgeons in being more precise, hence reducing damages to healthy tissue. In this work, thirteen in-vivo hyperspectral images from twelve different patients with high-grade gliomas (grade III and IV) have been selected to train SVM, RF and CNN classifiers. Five different classes have been defined during the experiments: healthy tissue, tumor, venous blood vessel, arterial blood vessel and dura mater. Overall accuracy (OACC) results vary from 60% to 95% depending on the training conditions. Finally, as far as the contribution of each band to the OACC is concerned, the results obtained in this work are 3.81 times greater than those reported in the literature.
Hyperspectral imaging for head and neck cancer detection: specular glare and variance of the tumor margin in surgical specimens

Martin Halicek,Himar Fabelo,Samuel Ortega,James V. Little,Xu Wang,Amy Y. Chen,Gustavo Marrero Callico,Larry Myers,Baran D. Sumer,Baowei Fei

DOI: https://doi.org/10.1117/1.jmi.6.3.035004

2019-09-14

Journal of Medical Imaging

Abstract:Head and neck squamous cell carcinoma (SCC) is primarily managed by surgical cancer resection. Recurrence rates after surgery can be as high as 55%, if residual cancer is present. Hyperspectral imaging (HSI) is evaluated for detection of SCC in <i>ex-vivo</i> surgical specimens. Several machine learning methods are investigated, including convolutional neural networks (CNNs) and a spectral-spatial classification framework based on support vector machines. Quantitative results demonstrate that additional data preprocessing and unsupervised segmentation can improve CNN results to achieve optimal performance. The methods are trained in two paradigms, with and without specular glare. Classifying regions that include specular glare degrade the overall results, but the combination of the CNN probability maps and unsupervised segmentation using a majority voting method produces an area under the curve value of 0.81 [0.80, 0.83]. As the wavelengths of light used in HSI can penetrate different depths into biological tissue, cancer margins may change with depth and create uncertainty in the ground truth. Through serial histological sectioning, the variance in the cancer margin with depth is investigated and paired with qualitative classification heat maps using the methods proposed for the testing group of SCC patients. The results determined that the validity of the top section alone as the ground truth may be limited to 1 to 2 mm. The study of specular glare and margin variation provided better understanding of the potential of HSI for the use in the operating room.
Feedforward Artificial Neural Network-Based Colorectal Cancer Detection Using Hyperspectral Imaging: A Step towards Automatic Optical Biopsy

Boris Jansen-Winkeln,Manuel Barberio,Claire Chalopin,Katrin Schierle,Michele Diana,Hannes Köhler,Ines Gockel,Marianne Maktabi

DOI: https://doi.org/10.3390/cancers13050967

2021-02-25

Cancers

Abstract:Currently, colorectal cancer (CRC) is mainly identified via a visual assessment during colonoscopy, increasingly used artificial intelligence algorithms, or surgery. Subsequently, CRC is confirmed through a histopathological examination by a pathologist. Hyperspectral imaging (HSI), a non-invasive optical imaging technology, has shown promising results in the medical field. In the current study, we combined HSI with several artificial intelligence algorithms to discriminate CRC. Between July 2019 and May 2020, 54 consecutive patients undergoing colorectal resections for CRC were included. The tumor was imaged from the mucosal side with a hyperspectral camera. The image annotations were classified into three groups (cancer, CA; adenomatous margin around the central tumor, AD; and healthy mucosa, HM). Classification and visualization were performed based on a four-layer perceptron neural network. Based on a neural network, the classification of CA or AD resulted in a sensitivity of 86% and a specificity of 95%, by means of leave-one-patient-out cross-validation. Additionally, significant differences in terms of perfusion parameters (e.g., oxygen saturation) related to tumor staging and neoadjuvant therapy were observed. Hyperspectral imaging combined with automatic classification can be used to differentiate between CRC and healthy mucosa. Additionally, the biological changes induced by chemotherapy to the tissue are detectable with HSI.

oncology
Hyperspectral Imaging for Glioblastoma Surgery: Improving Tumor Identification Using a Deep Spectral-Spatial Approach

Francesca Manni,Fons van der Sommen,Himar Fabelo,Svitlana Zinger,Caifeng Shan,Erik Edstrom,Adrian Elmi-Terander,Samuel Ortega,Gustavo Marrero Callico,Peter H. N. de With

DOI: https://doi.org/10.3390/s20236955

IF: 3.9

2020-01-01

Sensors

Abstract:The primary treatment for malignant brain tumors is surgical resection. While gross total resection improves the prognosis, a supratotal resection may result in neurological deficits. On the other hand, accurate intraoperative identification of the tumor boundaries may be very difficult, resulting in subtotal resections. Histological examination of biopsies can be used repeatedly to help achieve gross total resection but this is not practically feasible due to the turn-around time of the tissue analysis. Therefore, intraoperative techniques to recognize tissue types are investigated to expedite the clinical workflow for tumor resection and improve outcome by aiding in the identification and removal of the malignant lesion. Hyperspectral imaging (HSI) is an optical imaging technique with the power of extracting additional information from the imaged tissue. Because HSI images cannot be visually assessed by human observers, we instead exploit artificial intelligence techniques and leverage a Convolutional Neural Network (CNN) to investigate the potential of HSI in twelve in vivo specimens. The proposed framework consists of a 3D–2D hybrid CNN-based approach to create a joint extraction of spectral and spatial information from hyperspectral images. A comparison study was conducted exploiting a 2D CNN, a 1D DNN and two conventional classification methods (SVM, and the SVM classifier combined with the 3D–2D hybrid CNN) to validate the proposed network. An overall accuracy of 80% was found when tumor, healthy tissue and blood vessels were classified, clearly outperforming the state-of-the-art approaches. These results can serve as a basis for brain tumor classification using HSI, and may open future avenues for image-guided neurosurgical applications.
In the use of artificial intelligence and hyperspectral imaging in digital pathology for breast cancer cell identification

Laura Quintana,Samuel Ortega,Raquel Leon,Himar Fabelo,Francisco J. Balea-Fernández,Esther Sauras,Marylene Lejeune,Ramon Bosch,Carlos Lopez,Gustavo M. Callico,Marylène Lejeune,Carlos López,Gustavo M. Callicó

DOI: https://doi.org/10.1117/12.2611419

2022-04-04

Abstract:Hyperspectral (HS) imaging (HSI) is a novel technique that allows a better understanding of materials, being an improvement respect to other imaging modalities in multiple applications. Specifically, HSI technology applied to breast cancer histology, could significantly reduce the time of tumor diagnosis at the histopathology department. First, histological samples from twelve different breast cancer patients have been prepared and examined. Second, they were digitally scanned, using RGB (Red-Green-Blue) whole-slide imaging, and further annotated at cell level. Then, the annotated regions were captured with an HS microscopic acquisition system at 20× magnification, covering the 400-1000 nm spectral range. The HS data was registered (through synthetic RGB images) to the whole-slide images, allowing the transfer of accurate annotations made by pathologists to the HS image and extract each annotated cell from such image. Then, both spectral and spatial-spectral classifications were carried out to automatically detect tumor cells from the rest of the coexisting cells in the breast tissue (fibroblasts and lymphocytes). In this work, different supervised classifiers have been employed, namely kNN (k-Nearest-Neighbors), Random Forest, DNN (Deep Neural Network), Support Vector Machines (SVM) and CNN (Convolutional Neural Network). Test results for tumor cells vs. fibroblast classification show that the kNN performed with the best sensitivity/specificity (64/52%) trade-off and the CNN achieved the best sensitivity and AUC results (96% and 0.91, respectively). Moreover, at the tumor cells vs. lymphocyte classification, kNN also provided the best sensitivity-specificity ratio (58.47/58.86%) and an F1-score of 74.12%. The SVM algorithm also provided a high F-score result (70.38%). In conclusion, several machine learning algorithms provide promising results for cell classification in breast cancer tissue and so, future work must include these discoveries for faster cancer diagnosis.
Deformable Registration of Histological Cancer Margins to Gross Hyperspectral Images using Demons

Martin Halicek,James V Little,Xu Wang,Zhuo Georgia Chen,Mihir Patel,Christopher C Griffith,Mark W El-Deiry,Nabil F Saba,Amy Y Chen,Baowei Fei

DOI: https://doi.org/10.1117/12.2293165

Abstract:Hyperspectral imaging (HSI), a non-contact optical imaging technique, has been recently used along with machine learning technique to provide diagnostic information about ex-vivo surgical specimens for optical biopsy. The computer-aided diagnostic approach requires accurate ground truths for both training and validation. This study details a processing pipeline for registering the cancer-normal margin from a digitized histological image to the gross-level HSI of a tissue specimen. Our work incorporates an initial affine and control-point registration followed by a deformable Demons-based registration of the moving mask obtained from the histological image to the fixed mask made from the HS image. To assess registration quality, Dice similarity coefficient (DSC) measures the image overlap, visual inspection is used to evaluate the margin, and average target registration error (TRE) of needle-bored holes measures the registration error between the histologic and HSI images. Excised tissue samples from seventeen patients, 11 head and neck squamous cell carcinoma (HNSCCa) and 6 thyroid carcinoma, were registered according to the proposed method. Three registered specimens are illustrated in this paper, which demonstrate the efficacy of the registration workflow. Further work is required to apply the technique to more patient data and investigate the ability of this procedure to produce suitable gold standards for machine learning validation.
Technological Frontiers in Brain Cancer: A Systematic Review and Meta-Analysis of Hyperspectral Imaging in Computer-Aided Diagnosis Systems

Joseph-Hang Leung,Riya Karmakar,Arvind Mukundan,Wen-Shou Lin,Fathima Anwar,Hsiang-Chen Wang

DOI: https://doi.org/10.3390/diagnostics14171888

IF: 3.6

2024-08-30

Diagnostics

Abstract:Brain cancer is a substantial factor in the mortality associated with cancer, presenting difficulties in the timely identification of the disease. The precision of diagnoses is significantly dependent on the proficiency of radiologists and neurologists. Although there is potential for early detection with computer-aided diagnosis (CAD) algorithms, the majority of current research is hindered by its modest sample sizes. This meta-analysis aims to comprehensively assess the diagnostic test accuracy (DTA) of computer-aided design (CAD) models specifically designed for the detection of brain cancer utilizing hyperspectral (HSI) technology. We employ Quadas-2 criteria to choose seven papers and classify the proposed methodologies according to the artificial intelligence method, cancer type, and publication year. In order to evaluate heterogeneity and diagnostic performance, we utilize Deeks' funnel plot, the forest plot, and accuracy charts. The results of our research suggest that there is no notable variation among the investigations. The CAD techniques that have been examined exhibit a notable level of precision in the automated detection of brain cancer. However, the absence of external validation hinders their potential implementation in real-time clinical settings. This highlights the necessity for additional studies in order to authenticate the CAD models for wider clinical applicability.

medicine, general & internal
Blood Cancer Diagnosis Using Hyperspectral Imaging Assisted with Forward Searching Method and Machine Learning

Riheng Chen,Ting Luo,Junfei Nie,Yanwu Chu,Chen Riheng,Luo Ting,Nie Junfei

DOI: https://doi.org/10.1039/d3ay00787a

IF: 3.1

2023-07-05

Analytical Methods

Abstract:Hyperspectral image (HSI), a widely used biosensor, has been applied to tumor detection. Rapid, accurate, and low-cost detection of blood cancer using hyperspectral technology remains a challenge. We developed a new method to discriminate blood cancer using hyperspectral imaging (HSI) and forward searching method. Four commonly used classification models are applied for four types of blood cancer spectra recognition. The support vector machine (SVM) model with the highest recognition accuracy (94.5%) combined with HSI achieves high-precision tumor identification. For higher recognition accuracy and lower hardware barriers, based on the selection probabilities of spectral lines calculated by a multi-objective atomic orbital search method, the forward search method (FSM) is proposed for HSI feature selection. With the proposed method, the wavelength band range of the spectrum is reduced by at least 50%. Compared with the traditional dimensionality reduction methods, the FSM method can obtain the higher accuracy rate with hardware requirements. These results show that our proposed method can achieve non-invasive rapid screening of blood cancers with lower hardware requirements. Therefore, HSI assisted with FSM and SVM hybrid models can be a powerful and promising tool for blood cancer detection.

spectroscopy,chemistry, analytical,food science & technology
In-Vivo Hyperspectral Human Brain Image Database for Brain Cancer Detection

H. Fabelo,S. Ortega,A. Szolna,D. Bulters,J.F. Pineiro,S. Kabwama,A. Shanahan,H. Bulstrode,S. Bisshopp,B.R. Kiran,D. Ravi,R. Lazcano,D. Madronal,C. Sosa,C. Espino,M. Marquez,M. De la Luz Plaza,R. Camacho,D. Carrera,M. Hernandez,G.M. Callico,J. Morera,B. Stanciulescu,G.Z. Yang,R. Salvador,E. Juarez,C. Sanz,R. Sarmiento

DOI: https://doi.org/10.1109/ACCESS.2019.2904788

2024-02-16

Abstract:The use of hyperspectral imaging for medical applications is becoming more common in recent years. One of the main obstacles that researchers find when developing hyperspectral algorithms for medical applications is the lack of specific, publicly available, and hyperspectral medical data. The work described in this paper was developed within the framework of the European project HELICoiD (HypErspectraL Imaging Cancer Detection), which had as a main goal the application of hyperspectral imaging to the delineation of brain tumors in real-time during neurosurgical operations. In this paper, the methodology followed to generate the first hyperspectral database of in-vivo human brain tissues is presented. Data was acquired employing a customized hyperspectral acquisition system capable of capturing information in the Visual and Near InfraRed (VNIR) range from 400 to 1000 nm. Repeatability was assessed for the cases where two images of the same scene were captured consecutively. The analysis reveals that the system works more efficiently in the spectral range between 450 and 900 nm. A total of 36 hyperspectral images from 22 different patients were obtained. From these data, more than 300 000 spectral signatures were labeled employing a semi-automatic methodology based on the spectral angle mapper algorithm. Four different classes were defined: normal tissue, tumor tissue, blood vessel, and background elements. All the hyperspectral data has been made available in a public repository.

Image and Video Processing,Computer Vision and Pattern Recognition
A Novel Visible and Near-Infrared Hyperspectral Imaging Platform for Automated Breast-Cancer Detection

Ahmed Youssef,Belaid Moa,Yasser H. El-Sharkawy

DOI: https://doi.org/10.1016/j.pdpdt.2024.104048

IF: 3.577

2024-03-14

Photodiagnosis and Photodynamic Therapy

Abstract:Background: Breast cancer is a leading cause of cancer-related deaths among women worldwide. Early and accurate detection is crucial for improving patient outcomes. Our study utilizes Visible and Near-Infrared Hyperspectral Imaging (VIS-NIR HSI), a promising non-invasive technique, to detect cancerous regions in ex-vivo breast specimens based on their hyperspectral response. Methods: In this paper, we present a novel HSI platform integrated with fuzzy c-means clustering for automated breast cancer detection. We acquire hyperspectral data from breast tissue samples, and preprocess it to reduce noise and enhance hyperspectral features. Fuzzy c-means clustering is then applied to segment cancerous regions based on their spectral characteristics. Results: Our approach demonstrates promising results. We evaluated the quality of the clustering using metrics like Silhouette Index (SI), Davies-Bouldin Index (DBI), and Calinski-Harabasz Index (CHI). The clustering metrics results revealed an optimal number of 6 clusters for breast tissue classification, and the SI values ranged from 0.68 to 0.72, indicating well-separated clusters. Moreover, the CHI values showed that the clusters were well-defined, and the DBI values demonstrated low cluster dispersion. Additionally, the sensitivity, specificity, and accuracy of our system were evaluated on a dataset of breast tissue samples. We achieved an average sensitivity of 96.83% , specificity of 93.39% , and accuracy of 95.12% . These results indicate the effectiveness of our HSI-based approach in distinguishing cancerous and non-cancerous regions. Conclusions: The paper introduces a robust hyperspectral imaging platform coupled with fuzzy c-means clustering for automated breast cancer detection. The clustering metrics results support the reliability of our approach in effectively segmenting breast tissue samples. In addition, the system shows high sensitivity and specificity, making it a valuable tool for early-stage breast cancer diagnosis. This innovative approach holds great potential for improving breast cancer screening and, thereby, enhancing our understanding of the disease and its detection patterns.

oncology
Hybrid brain tumor classification of histopathology hyperspectral images by linear unmixing and an ensemble of deep neural networks

Inés A Cruz-Guerrero,Daniel Ulises Campos-Delgado,Aldo R Mejía-Rodríguez,Raquel Leon,Samuel Ortega,Himar Fabelo,Rafael Camacho,Maria de la Luz Plaza,Gustavo Callico

DOI: https://doi.org/10.1049/htl2.12084

2024-06-18

Abstract:Hyperspectral imaging has demonstrated its potential to provide correlated spatial and spectral information of a sample by a non-contact and non-invasive technology. In the medical field, especially in histopathology, HSI has been applied for the classification and identification of diseased tissue and for the characterization of its morphological properties. In this work, we propose a hybrid scheme to classify non-tumor and tumor histological brain samples by hyperspectral imaging. The proposed approach is based on the identification of characteristic components in a hyperspectral image by linear unmixing, as a features engineering step, and the subsequent classification by a deep learning approach. For this last step, an ensemble of deep neural networks is evaluated by a cross-validation scheme on an augmented dataset and a transfer learning scheme. The proposed method can classify histological brain samples with an average accuracy of 88%, and reduced variability, computational cost, and inference times, which presents an advantage over methods in the state-of-the-art. Hence, the work demonstrates the potential of hybrid classification methodologies to achieve robust and reliable results by combining linear unmixing for features extraction and deep learning for classification.
Non-Invasive Skin Cancer Diagnosis Using Hyperspectral Imaging for In-Situ Clinical Support

Raquel Leon,Beatriz Martinez-Vega,Himar Fabelo,Samuel Ortega,Veronica Melian,Irene Castaño,Gregorio Carretero,Pablo Almeida,Aday Garcia,Eduardo Quevedo,Javier A. Hernandez,Bernardino Clavo,Gustavo M. Callico

DOI: https://doi.org/10.3390/jcm9061662

IF: 3.9

2020-06-01

Journal of Clinical Medicine

Abstract:Skin cancer is one of the most common forms of cancer worldwide and its early detection its key to achieve an effective treatment of the lesion. Commonly, skin cancer diagnosis is based on dermatologist expertise and pathological assessment of biopsies. Although there are diagnosis aid systems based on morphological processing algorithms using conventional imaging, currently, these systems have reached their limit and are not able to outperform dermatologists. In this sense, hyperspectral (HS) imaging (HSI) arises as a new non-invasive technology able to facilitate the detection and classification of pigmented skin lesions (PSLs), employing the spectral properties of the captured sample within and beyond the human eye capabilities. This paper presents a research carried out to develop a dermatological acquisition system based on HSI, employing 125 spectral bands captured between 450 and 950 nm. A database composed of 76 HS PSL images from 61 patients was obtained and labeled and classified into benign and malignant classes. A processing framework is proposed for the automatic identification and classification of the PSL based on a combination of unsupervised and supervised algorithms. Sensitivity and specificity results of 87.5% and 100%, respectively, were obtained in the discrimination of malignant and benign PSLs. This preliminary study demonstrates, as a proof-of-concept, the potential of HSI technology to assist dermatologists in the discrimination of benign and malignant PSLs during clinical routine practice using a real-time and non-invasive hand-held device.

medicine, general & internal
Parallel Implementations Assessment of a Spatial-Spectral Classifier for Hyperspectral Clinical Applications

Raquel Lazcano,Daniel Madroñal,Giordana Florimbi,Jaime Sancho,Sergio Sanchez,Raquel Leon,Himar Fabelo,Samuel Ortega,Emanuele Torti,Ruben Salvador,Margarita Marrero-Martin,Francesco Leporati,Eduardo Juarez,Gustavo M Callico,Cesar Sanz

DOI: https://doi.org/10.1109/ACCESS.2019.2938708

2024-03-29

Abstract:Hyperspectral (HS) imaging presents itself as a non-contact, non-ionizing and non-invasive technique, proven to be suitable for medical diagnosis. However, the volume of information contained in these images makes difficult providing the surgeon with information about the boundaries in real-time. To that end, High-Performance-Computing (HPC) platforms become necessary. This paper presents a comparison between the performances provided by five different HPC platforms while processing a spatial-spectral approach to classify HS images, assessing their main benefits and drawbacks. To provide a complete study, two different medical applications, with two different requirements, have been analyzed. The first application consists of HS images taken from neurosurgical operations; the second one presents HS images taken from dermatological interventions. While the main constraint for neurosurgical applications is the processing time, in other environments, as the dermatological one, other requirements can be considered. In that sense, energy efficiency is becoming a major challenge, since this kind of applications are usually developed as hand-held devices, thus depending on the battery capacity. These requirements have been considered to choose the target platforms: on the one hand, three of the most powerful Graphic Processing Units (GPUs) available in the market; and, on the other hand, a low-power GPU and a manycore architecture, both specifically thought for being used in battery-dependent environments.

Performance,Machine Learning
A Hyperspectral Imaging Dataset and Methodology for Intraoperative Pixel-Wise Classification of Metastatic Colon Cancer in the Liver

Ivica Kopriva,Dario Sitnik,Laura-Isabelle Dion-Bertrand,Marija Milković Periša,Mirko Hadžija,Marijana Popović Hadžija

2024-11-11

Abstract:Hyperspectral imaging (HSI) holds significant potential for transforming the field of computational pathology. However, there is currently a shortage of pixel-wise annotated HSI data necessary for training deep learning (DL) models. Additionally, the number of HSI-based research studies remains limited, and in many cases, the advantages of HSI over traditional RGB imaging have not been conclusively demonstrated, particularly for specimens collected intraoperatively. To address these challenges we present a database consisted of 27 HSIs of hematoxylin-eosin stained frozen sections, collected from 14 patients with colon adenocarcinoma metastasized to the liver. It is aimed to validate pixel-wise classification for intraoperative tumor resection. The HSIs were acquired in the spectral range of 450 to 800 nm, with a resolution of 1 nm, resulting in images of 1384x1035 pixels. Pixel-wise annotations were performed by three pathologists. To overcome challenges such as experimental variability and the lack of annotated data, we combined label-propagation-based semi-supervised learning (SSL) with spectral-spatial features extracted by: the multiscale principle of relevant information (MPRI) method and tensor singular spectrum analysis method. Using only 1% of labeled pixels per class the SSL-MPRI method achieved a micro balanced accuracy (BACC) of 0.9313 and a micro F1-score of 0.9235 on the HSI dataset. The performance on corresponding RGB images was lower, with a micro BACC of 0.8809 and a micro F1-score of 0.8688. These improvements are statistically significant. The SSL-MPRI approach outperformed six DL architectures trained with 63% of labeled pixels. Data and code are available at: <a class="link-external link-https" href="https://github.com/ikopriva/ColonCancerHSI" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition
Hyperspectral imaging for tissue classification in glioblastoma tumor patients: a deep spectral-spatial approach

Francesca Manni,Chuchen Cai,Fons van der Sommen,Svitlana Zinger,Caifeng Shan,Erik Edstrom,Adrian Elmi-Terander,Himar Fabelo,Samuel Ortega,Gustavo M. Callico,Peter H. N. de With

DOI: https://doi.org/10.1117/12.2580158

2021-01-01

Abstract:Surgery is a crucial treatment for malignant brain tumors where gross total resection improves the prognosis. Tissue samples taken during surgery are either subject to a preliminary intraoperative histological analysis, or sent for a full pathological evaluation which can take days or weeks. Whereas a lengthy complete pathological analysis includes an array of techniques to be executed, a preliminary tissue analysis on frozen tissue is performed as quickly as possible (30-45 minutes on average) to provide fast feedback to the surgeon during the surgery. The surgeon uses the information to confirm that the resected tissue is indeed tumor and may, at least in theory, initiate repeated biopsies to help achieve gross total resection. However, due to the total turn-around time of the tissue inspection for repeated analyses, this approach may not be feasible during a single surgery. In this context, intraoperative image-guided techniques can improve the clinical workflow for tumor resection and improve outcome by aiding in the identification and removal of the malignant lesion. Hyperspectral imaging (HSI) is an optical imaging technique with the potential to extract combined spectral-spatial information. By exploiting HSI for human brain-tissue classification in 13 in-vivo hyperspectral images from 9 patients, a brain-tissue classifier is developed. The framework consists of a hybrid 3D-2D CNN-based approach and a band-selection step to enhance the capability of extracting both spectral and spatial information from the hyperspectral images. An overall accuracy of 77% was found when tumor, normal and hyper-vascularized tissue are classified, which clearly outperforms the state-of-the-art approaches (SVM, 2D-CNN). These results may open an attractive future perspective for intraoperative brain-tumor classification using HSI.
Endoscopic In Vivo Hyperspectral Imaging for Head and Neck Tumor Surgeries Using a Medically Approved CE-Certified Camera with Rapid Visualization During Surgery

Ayman Bali,Thomas Bitter,Marcela Mafra,Jonas Ballmaier,Mussab Kouka,Gerlind Schneider,Anna Mühlig,Nadja Ziller,Theresa Werner,Ferdinand von Eggeling,Orlando Guntinas-Lichius,David Pertzborn

DOI: https://doi.org/10.3390/cancers16223785

2024-11-11

Cancers

Abstract:Background: In vivo visualization of malignant tumors remains the main challenge during head and neck cancer surgery. This can result in inadequate tumor margin assessment and incomplete tumor resection, adversely affecting patient outcomes. Hyperspectral imaging (HSI) is a promising approach to address this issue. However, its application in surgery has been limited by the lack of medically approved HSI devices compliant with MDR regulations, as well as challenges regarding the integration into the surgical workflow. Methods: In this feasibility study, we employed endoscopic HSI during surgery to visualize the tumor sites of 12 head and neck cancer patients. We optimized the HSI workflow to minimize time required during surgery and to reduce the adaptation period needed for surgeons to adjust to the new workflow. Additionally, we implemented data processing to enable real-time classification and visualization of HSI within the intraoperative setting. HSI evaluation was conducted using principal component analysis and k-means clustering, with this clustering validated through comparison with expert annotations. Results: Our complete HSI workflow requires two to three minutes, with each HSI measurement—including evaluation and visualization—taking less than 10 s, achieving an accuracy of 79%, sensitivity of 72%, and specificity of 84%. Medical personnel became proficient with the HSI system after two surgeries. Conclusions: This study presents an HSI workflow for in vivo tissue differentiation during head and neck cancer surgery, providing accurate and visually accessible results within minimal time. This approach enhances the in vivo evaluation of tumor margins, leading to more clear margins and, consequently, improved patient outcomes.

oncology
Spectral-Spatial Recurrent-Convolutional Networks for In-Vivo Hyperspectral Tumor Type Classification

Marcel Bengs,Nils Gessert,Wiebke Laffers,Dennis Eggert,Stephan Westermann,Nina A. Mueller,Andreas O. H. Gerstner,Christian Betz,Alexander Schlaefer

DOI: https://doi.org/10.48550/arXiv.2007.01042

2020-07-02

Abstract:Early detection of cancerous tissue is crucial for long-term patient survival. In the head and neck region, a typical diagnostic procedure is an endoscopic intervention where a medical expert manually assesses tissue using RGB camera images. While healthy and tumor regions are generally easier to distinguish, differentiating benign and malignant tumors is very challenging. This requires an invasive biopsy, followed by histological evaluation for diagnosis. Also, during tumor resection, tumor margins need to be verified by histological analysis. To avoid unnecessary tissue resection, a non-invasive, image-based diagnostic tool would be very valuable. Recently, hyperspectral imaging paired with deep learning has been proposed for this task, demonstrating promising results on ex-vivo specimens. In this work, we demonstrate the feasibility of in-vivo tumor type classification using hyperspectral imaging and deep learning. We analyze the value of using multiple hyperspectral bands compared to conventional RGB images and we study several machine learning models' ability to make use of the additional spectral information. Based on our insights, we address spectral and spatial processing using recurrent-convolutional models for effective spectral aggregating and spatial feature learning. Our best model achieves an AUC of 76.3%, significantly outperforming previous conventional and deep learning methods.

Image and Video Processing,Computer Vision and Pattern Recognition
Identifying chromophore fingerprints of brain tumor tissue on hyperspectral imaging using principal component analysis

Ivan Ezhov,Luca Giannoni,Suprosanna Shit,Frederic Lange,Florian Kofler,Bjoern Menze,Ilias Tachtsidis,Daniel Rueckert

2023-10-17

Abstract:Hyperspectral imaging (HSI) is an optical technique that processes the electromagnetic spectrum at a multitude of monochromatic, adjacent frequency bands. The wide-bandwidth spectral signature of a target object's reflectance allows fingerprinting its physical, biochemical, and physiological properties. HSI has been applied for various applications, such as remote sensing and biological tissue analysis. Recently, HSI was also used to differentiate between healthy and pathological tissue under operative conditions in a surgery room on patients diagnosed with brain tumors. In this article, we perform a statistical analysis of the brain tumor patients' HSI scans from the HELICoiD dataset with the aim of identifying the correlation between reflectance spectra and absorption spectra of tissue chromophores. By using the principal component analysis (PCA), we determine the most relevant spectral features for intra- and inter-tissue class differentiation. Furthermore, we demonstrate that such spectral features are correlated with the spectra of cytochrome, i.e., the chromophore highly involved in (hyper) metabolic processes. Identifying such fingerprints of chromophores in reflectance spectra is a key step for automated molecular profiling and, eventually, expert-free biomarker discovery.

Quantitative Methods,Data Analysis, Statistics and Probability,Optics
Advanced Analytical Methods for Multi-Spectral Transmission Imaging Optimization: Enhancing Breast Tissue Heterogeneity Detection and Tumor Screening with Hybrid Image Processing and Deep Learning

Fulong Liu,Gand Li,Junqi Wang

DOI: https://doi.org/10.1039/d4ay01755b

IF: 3.1

2024-11-22

Analytical Methods

Abstract:Light sources exhibit significant absorption and scattering effects during the transmission through biological tissues, posing challenges in identifying heterogeneities in multi-spectral images. This paper introduces a fusion of techniques encompassing the spatial pyramid matching model (SPM), modulation and demodulation (M_D), and frame accumulation (FA). These techniques not only elevate image quality but also augment the precision of heterogeneous classification in multi-spectral transmission images (MTI) within deep learning network models (DLNM). Initially, experiments are designed to capture MTI of phantoms. Subsequently, the images are preprocessed separately through a combination of different techniques such as SPM, M_D and FA. Ultimately, multi-spectral fusion pseudo-color images derived from U-Net semantic segmentation are fed into VGG16/19 and ResNet50/101 networks for heterogeneous classification. Among them, different combinations of SPM, M_D and FA significantly enhance the quality of images, facilitating the extraction of heterogeneous feature information from multi-spectral images. In comparison to the classification accuracy achieved in the original image VGG and ResNet network models, all images after preprocessing effectively improved the classification accuracy of heterogeneities. Following scatter correction, images processed with 3.5 Hz modulation-demodulation combined with frame accumulation (M_D-FA) attain the highest classification accuracy for heterogeneities in the VGG19 and ResNet101 models, achieving accuracies of 95.47% and 98.47%, respectively. In conclusion, this paper utilizes different combinations of SPM, M_D and FA techniques to not only enhance the quality of images but also further improve the accuracy of DLNM in heterogeneous classification, which will promote the clinical application of MTI technique in breast tumor screening.

spectroscopy,chemistry, analytical,food science & technology

Antibiotic resistance. Control strategies.

Impact of Pre- and Post-Processing Steps for Supervised Classification of Colorectal Cancer in Hyperspectral Images

Supervised Machine Learning Methods and Hyperspectral Imaging Techniques Jointly Applied for Brain Cancer Classification

Hyperspectral imaging for head and neck cancer detection: specular glare and variance of the tumor margin in surgical specimens

Feedforward Artificial Neural Network-Based Colorectal Cancer Detection Using Hyperspectral Imaging: A Step towards Automatic Optical Biopsy

Hyperspectral Imaging for Glioblastoma Surgery: Improving Tumor Identification Using a Deep Spectral-Spatial Approach

In the use of artificial intelligence and hyperspectral imaging in digital pathology for breast cancer cell identification

Deformable Registration of Histological Cancer Margins to Gross Hyperspectral Images using Demons

Technological Frontiers in Brain Cancer: A Systematic Review and Meta-Analysis of Hyperspectral Imaging in Computer-Aided Diagnosis Systems

Blood Cancer Diagnosis Using Hyperspectral Imaging Assisted with Forward Searching Method and Machine Learning

In-Vivo Hyperspectral Human Brain Image Database for Brain Cancer Detection

A Novel Visible and Near-Infrared Hyperspectral Imaging Platform for Automated Breast-Cancer Detection

Hybrid brain tumor classification of histopathology hyperspectral images by linear unmixing and an ensemble of deep neural networks

Non-Invasive Skin Cancer Diagnosis Using Hyperspectral Imaging for In-Situ Clinical Support

Parallel Implementations Assessment of a Spatial-Spectral Classifier for Hyperspectral Clinical Applications

A Hyperspectral Imaging Dataset and Methodology for Intraoperative Pixel-Wise Classification of Metastatic Colon Cancer in the Liver

Hyperspectral imaging for tissue classification in glioblastoma tumor patients: a deep spectral-spatial approach

Endoscopic In Vivo Hyperspectral Imaging for Head and Neck Tumor Surgeries Using a Medically Approved CE-Certified Camera with Rapid Visualization During Surgery

Spectral-Spatial Recurrent-Convolutional Networks for In-Vivo Hyperspectral Tumor Type Classification

Identifying chromophore fingerprints of brain tumor tissue on hyperspectral imaging using principal component analysis

Advanced Analytical Methods for Multi-Spectral Transmission Imaging Optimization: Enhancing Breast Tissue Heterogeneity Detection and Tumor Screening with Hybrid Image Processing and Deep Learning