Abstract:A clinically comparable multi-tasking computerized deep U-Net-based model is demonstrated in this paper. It intends to offer clinical gland morphometric information and cancer grade classification to be provided as referential opinions for pathologists in order to abate human errors. It embraces enhanced feature learning capability that aids in extraction of potent multi-scale features; efficacious semantic gap recovery during feature concatenation; and successful interception of resolution-degradation and vanishing gradient problems while performing moderate computations. It is proposed by integrating three unique novel structural components namely Hybrid Convolutional Learning Units in the encoder and decoder, Attention Learning Units in skip connection, and Multi-Scalar Dilated Transitional Unit as the transitional layer in the traditional U-Net architecture. These units are composed of the amalgamated phenomenon of multi-level convolutional learning through conventional, atrous, residual, depth-wise, and point-wise convolutions which are further incorporated with target-specific attention learning and enlarged effectual receptive field size. Also, pre-processing techniques of patch-sampling, augmentation (color and morphological), stain-normalization, etc. are employed to burgeon its generalizability. To build network invariance towards digital variability, exhaustive experiments are conducted using three public datasets (Colorectal Adenocarcinoma Gland (CRAG), Gland Segmentation (GlaS) challenge, and Lung Colon-25000 (LC-25K) dataset)) and then its robustness is verified using an in-house private dataset of Hospital Colon (HosC). For the cancer classification, the proposed model achieved results of Accuracy (CRAG(95%), GlaS(97.5%), LC-25K(99.97%), HosC(99.45%)), Precision (CRAG(0.9678), GlaS(0.9768), LC-25K(1), HosC(1)), F1-score (CRAG(0.968), GlaS(0.977), LC 25K(0.9997), HosC(0.9965)), and Recall (CRAG(0.9677), GlaS(0.9767), LC-25K(0.9994), HosC(0.9931)). For the gland detection and segmentation, the proposed model achieved competitive results of F1-score (CRAG(0.924), GlaS(Test A(0.949), Test B(0.918)), LC-25K(0.916), HosC(0.959)); Object-Dice Index (CRAG(0.959), GlaS(Test A(0.956), Test B(0.909)), LC-25K(0.929), HosC(0.922)), and Object-Hausdorff Distance (CRAG(90.47), GlaS(Test A(23.17), Test B(71.53)), LC-25K(96.28), HosC(85.45)). In addition, the activation mappings for testing the interpretability of the classification decision-making process are reported by utilizing techniques of Local Interpretable Model-Agnostic Explanations, Occlusion Sensitivity, and Gradient-Weighted Class Activation Mappings. This is done to provide further evidence about the model's self-learning capability of the comparable patterns considered relevant by pathologists without any pre-requisite for annotations. These activation mapping visualization outcomes are evaluated by proficient pathologists, and they delivered these images with a class-path validation score of (CRAG(9.31), GlaS(9.25), LC-25K(9.05), and HosC(9.85)). Furthermore, the seg-path validation score of (GlaS (Test A(9.40), Test B(9.25)), CRAG(9.27), LC-25K(9.01), HosC(9.19)) given by multiple pathologists is included for the final segmented outcomes to substantiate the clinical relevance and suitability for facilitation at the clinical level. The proposed model will aid pathologists to formulate an accurate diagnosis by providing a referential opinion during the morphology assessment of histopathology images. It will reduce unintentional human error in cancer diagnosis and consequently will enhance patient survival rate.

Deep Learning Based Multi-Organ Segmentation And Metastases Segmentation In Whole Mouse Body And The Cryo-Imaging Cancer Imaging And Therapy Analysis Platform (Citap)

A Semi-Automatic Validation Tool for Whole Mouse Metastatic Tumor Molecular Imaging Using the Cryo-Imaging Cancer Imaging and Therapy Platform (CITP)

Quantitative analysis of metastatic breast cancer in mice using deep learning on cryo-image data

Cryo-Imaging and Software Platform for Analysis of Molecular MR Imaging of Micrometastases

Deep learning multi-organ segmentation for whole mouse cryo-images including a comparison of 2D and 3D deep networks

Deep Learning Based Automated Orthotopic Lung Tumor Segmentation in Whole-Body Mouse CT-Scans

Automated Mouse Organ Segmentation: A Deep Learning Based Solution

Seeing Beyond Cancer: Multi-Institutional Validation of Object Localization and 3D Semantic Segmentation using Deep Learning for Breast MRI

Deep learning enabled multi-organ segmentation of mouse embryos

Multiple organ segmentation framework for brain metastasis radiotherapy

Classification of Mouse Lung Metastatic Tumor with Deep Learning

Segmentation of Brain Metastases in MRI: A Two-Stage Deep Learning Approach with Modality Impact Study

MTU: A multi-tasking U-net with hybrid convolutional learning and attention modules for cancer classification and gland Segmentation in Colon Histopathological Images

A Novel Mouse Segmentation Method Based on Dynamic Contrast Enhanced Micro-CT Images

A transformer-based deep learning approach for classifying brain metastases into primary organ sites using clinical whole brain MRI

Deep learning for automatic organ and tumor segmentation in nanomedicine pharmacokinetics

Deep learning-enabled quantification of simultaneous PET/MRI for cell transplantation monitoring

Anatomically Consistent Segmentation of Organs at Risk in MRI with Convolutional Neural Networks

Abstract 3529: Leveraging deep learning for fully automated analysis of pre-clinical mouse positron emission tomography

Deep Learning-Based Image Segmentation on Multimodal Medical Imaging

3D TUMOR SEGMENTATION AND DIAGNOSIS SYSTEM OF LUNG CANCER USING MULTISCALE APPROACHES