Abstract:Cancer is one of the leading causes of death worldwide and stained tissues' biopsy analysis remains the standard method for pathology diagnostics. Major optical developments have improved pathological diagnostics lately.High quality microscopic optical scanners now allow whole-slide imaging of tissue sections and with the accessibility of datasets, digital imaging becomes attractive for biopsy analysis. Beyond its user-friendly features for image review and telepathology, digital imaging also enables the utilization of image processing and artificial intelligence (AI) which are advantageous for numerous applications. Nevertheless, AI faces significant barriers to widespread adoption. In order to extend the use of AI for clinical use in pathology, here we present an advanced approach for analyzing Hematoxylin and Eosin-stained biopsies and identify cancer cells. Our approach relies on the fusion of rapid spectral imaging measurements of biopsies with tailored machine learning algorithms designed explicitly for spectral images.The spectrum measured at each pixel provides much more information than standard color, that contains only three values of red, green, and blue intensities. We lately found that the spectral information provides high separability of normal and cancerous cells in Hematoxylin and Eosin-stained biopsies. This breakthrough surpasses previous obstacles, marking the potential for utilizing spectral imaging for cancer identification. Nevertheless, the method required identifying the nuclei in the tissue, a complex task that has not yet been addressed.Here, we demonstrate a rapid spectral imaging system combining artificial intelligence procedures for spectral-based nuclear segmentation using U-net models, with an adjusted input layer for the spectral imaging size. We trained two models; one with the full measured spectrum, and one based on color produced from the spectra. Excellent segmentation performance is achieved with both models, but the model trained on the full spectrum achieved significantly better results. The high performance of spectral image-based segmentation together with the simplicity of the system makes it applicable for tissue analysis and cancer classification in the clinical arena.

Processing HSV Colored Medical Images and Adapting Color Thresholds for Computational Image Analysis: a Practical Introduction to an open-source tool

A Flexible Assistant Tool with Dynamic Scanning to Enhance the Ability of Color Discrimination

An Artificial-Intelligence- and Telemedicine-Based Screening Tool to Identify Glaucoma Suspects from Color Fundus Imaging

Human Visual System-Based Fundus Image Quality Assessment of Portable Fundus Camera Photographs.

Medical Image Segmentation using the HSI color space and Fuzzy Mathematical Morphology

A Novel Interactive Image Processing Approach for DICOM Medical Image Data

Guided interactive image segmentation using machine learning and color-based image set clustering

A Color Guide for Color Blind People Using Image Processing and OpenCV

FalseColor-Python: A rapid intensity-leveling and digital-staining package for fluorescence-based slide-free digital pathology

approach to edge detection in medical imaging through histogram analysis and morphological gradient

Image-Based Quantification of Color and Its Machine Vision and Offline Applications

Physical Color Calibration of Digital Pathology Scanners for Robust Artificial Intelligence Assisted Cancer Diagnosis

A color‐based tumor segmentation method for clinical ex vivo breast tissue assessment utilizing a multi‐contrast brightfield imaging strategy

HistoColAi: An Open-Source Web Platform for Collaborative Digital Histology Image Annotation with AI-Driven Predictive Integration

Enhancing Diagnostic Images to Improve the Performance of the Segment Anything Model in Medical Image Segmentation

Facial image medical analysis system using quantitative chromatic feature

Generative models for color normalization in digital pathology and dermatology: Advancing the learning paradigm

Advancing automated digital pathology by rapid spectral imaging and AI for nuclear segmentation

A Hessian-Based Technique for Specular Reflection Detection and Inpainting in Colonoscopy Images

A Color Image Processing Pipeline for Digital Microscope

psudo: Exploring Multi-Channel Biomedical Image Data with Spatially and Perceptually Optimized Pseudocoloring