Abstract:Cancer is one of the leading causes of death worldwide and stained tissues' biopsy analysis remains the standard method for pathology diagnostics. Major optical developments have improved pathological diagnostics lately.High quality microscopic optical scanners now allow whole-slide imaging of tissue sections and with the accessibility of datasets, digital imaging becomes attractive for biopsy analysis. Beyond its user-friendly features for image review and telepathology, digital imaging also enables the utilization of image processing and artificial intelligence (AI) which are advantageous for numerous applications. Nevertheless, AI faces significant barriers to widespread adoption. In order to extend the use of AI for clinical use in pathology, here we present an advanced approach for analyzing Hematoxylin and Eosin-stained biopsies and identify cancer cells. Our approach relies on the fusion of rapid spectral imaging measurements of biopsies with tailored machine learning algorithms designed explicitly for spectral images.The spectrum measured at each pixel provides much more information than standard color, that contains only three values of red, green, and blue intensities. We lately found that the spectral information provides high separability of normal and cancerous cells in Hematoxylin and Eosin-stained biopsies. This breakthrough surpasses previous obstacles, marking the potential for utilizing spectral imaging for cancer identification. Nevertheless, the method required identifying the nuclei in the tissue, a complex task that has not yet been addressed.Here, we demonstrate a rapid spectral imaging system combining artificial intelligence procedures for spectral-based nuclear segmentation using U-net models, with an adjusted input layer for the spectral imaging size. We trained two models; one with the full measured spectrum, and one based on color produced from the spectra. Excellent segmentation performance is achieved with both models, but the model trained on the full spectrum achieved significantly better results. The high performance of spectral image-based segmentation together with the simplicity of the system makes it applicable for tissue analysis and cancer classification in the clinical arena.

Preserving Dense Features for Ki67 Nuclei Detection

Mutual-Complementing Framework for Nuclei Detection and Segmentation in Pathology Image

A deep learning pipeline for breast cancer ki-67 proliferation index scoring

Nucleus segmentation from the histopathological images of liver cancer through an efficient deep learning framework

Stain guided mean-shift filtering in automatic detection of human tissue nuclei

DeepSDCS: Dissecting cancer proliferation heterogeneity in Ki67 digital whole slide images

Microscopic Nuclei Classification, Segmentation and Detection with improved Deep Convolutional Neural Network (DCNN) Approaches

DSCA-Net: Double-stage Codec Attention Network for automatic nuclear segmentation

A Robust Deep Learning Approach for Joint Nuclei Detection and Cell Classification in Pan-Cancer Histology Images

High-resolution deep transferred ASPPU-Net for nuclei segmentation of histopathology images

A Deep Convolutional Networks and Combination Strategy for Automated Nuclear Atypia Grading on Breast Histopathology

DenseRes-Unet: Segmentation of overlapped/clustered nuclei from multi organ histopathology images

A dual decoder U-Net-based model for nuclei instance segmentation in hematoxylin and eosin-stained histological images

Multi-scale Deep Learning Architecture for Nucleus Detection in Renal Cell Carcinoma Microscopy Image

FRE-Net: Full-region enhanced network for nuclei segmentation in histopathology images

Automatic segmentation and supervised learning-based selection of nuclei in cancer tissue images

MIU-Net: MIX-Attention and Inception U-Net for Histopathology Image Nuclei Segmentation

Computer assisted recognition of breast cancer in biopsy images via fusion of nucleus-guided deep convolutional features

A deep learning algorithm for one-step contour aware nuclei segmentation of histopathology images

Advancing automated digital pathology by rapid spectral imaging and AI for nuclear segmentation

SFE-Net: Spatial-frequency Enhancement Network for Robust Nuclei Segmentation in Histopathology Images