Abstract:Background: Recent advancements in anomaly detection have paved the way for novel radiological reading assistance tools that support the identification of findings, aimed at saving time. The clinical adoption of such applications requires a low rate of false positives while maintaining high sensitivity. Purpose: In light of recent interest and development in multi pathology identification, we present a novel method, based on a recent contrastive self-supervised approach, for multiple chest-related abnormality identification including low lung density area ("LLDA"), consolidation ("CONS"), nodules ("NOD") and interstitial pattern ("IP"). Our approach alerts radiologists about abnormal regions within a computed tomography (CT) scan by providing 3D localization. Methods: We introduce a new method for the classification and localization of multiple chest pathologies in 3D Chest CT scans. Our goal is to distinguish four common chest-related abnormalities: "LLDA", "CONS", "NOD", "IP" and "NORMAL". This method is based on a 3D patch-based classifier with a Resnet backbone encoder pretrained leveraging recent contrastive self supervised approach and a fine-tuned classification head. We leverage the SimCLR contrastive framework for pretraining on an unannotated dataset of randomly selected patches and we then fine-tune it on a labeled dataset. During inference, this classifier generates probability maps for each abnormality across the CT volume, which are aggregated to produce a multi-label patient-level prediction. We compare different training strategies, including random initialization, ImageNet weight initialization, frozen SimCLR pretrained weights and fine-tuned SimCLR pretrained weights. Each training strategy is evaluated on a validation set for hyperparameter selection and tested on a test set. Additionally, we explore the fine-tuned SimCLR pretrained classifier for 3D pathology localization and conduct qualitative evaluation. Results: Validated on 111 chest scans for hyperparameter selection and subsequently tested on 251 chest scans with multi-abnormalities, our method achieves an AUROC of 0.931 (95% confidence interval [CI]: [0.9034, 0.9557], p $ p$ -value < 0.001) and 0.963 (95% CI: [0.952, 0.976], p $ p$ -value < 0.001) in the multi-label and binary (i.e., normal versus abnormal) settings, respectively. Notably, our method surpasses the area under the receiver operating characteristic (AUROC) threshold of 0.9 for two abnormalities: IP (0.974) and LLDA (0.952), while achieving values of 0.853 and 0.791 for NOD and CONS, respectively. Furthermore, our results highlight the superiority of incorporating contrastive pretraining within the patch classifier, outperforming Imagenet pretraining weights and non-pretrained counterparts with uninitialized weights (F1 score = 0.943, 0.792, and 0.677 respectively). Qualitatively, the method achieved a satisfactory 88.8% completeness rate in localization and maintained an 88.3% accuracy rate against false positives. Conclusions: The proposed method integrates self-supervised learning algorithms for pretraining, utilizes a patch-based approach for 3D pathology localization and develops an aggregation method for multi-label prediction at patient-level. It shows promise in efficiently detecting and localizing multiple anomalies within a single scan.

CELNet: Evidence Localization for Pathology Images using Weakly Supervised Learning

Residual Convolutional Neural Networks With Global And Local Pathways For Classification Of Focal Liver Lesions

Space and Level Cooperation Framework for Pathological Cancer Grading

Multi-label Recognition of Cancer-Related Lesions with Clinical Priors on White-Light Endoscopy

Nuclei Segmentation with Point Annotations from Pathology Images via Self-Supervised Learning and Co-Training

An Explainable Classification Method Based on Complex Scaling in Histopathology Images for Lung and Colon Cancer

Weakly-Supervised Learning-Based Feature Localization in Confocal Laser Endomicroscopy Glioma Images

Histopathology Classification and Localization of Colorectal Cancer Using Global Labels by Weakly Supervised Deep Learning.

Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images

Whole-slide-imaging Cancer Metastases Detection and Localization with Limited Tumorous Data

Multi-modal vision-language model for generalizable annotation-free pathology localization and clinical diagnosis

Interpretable Classification of Pathology Whole-Slide Images Using Attention Based Context-Aware Graph Convolutional Neural Network

CAMEL2: Enhancing Weakly Supervised Learning for Histopathology Images by Incorporating the Significance Ratio

Weakly supervised histopathology cancer image segmentation and classification

Weakly-supervised learning-based pathology detection and localization in 3D chest CT scans

Weakly Supervised Deep Learning for Whole Slide Lung Cancer Image Analysis

Attention-Guided Curriculum Learning for Weakly Supervised Classification and Localization of Thoracic Diseases on Chest Radiographs

CAMEL: A Weakly Supervised Learning Framework for Histopathology Image Segmentation

Discriminative Cervical Lesion Detection in Colposcopic Images With Global Class Activation and Local Bin Excitation

Weakly Supervised Learning for cell recognition in immunohistochemical cytoplasm staining images