Abstract:Deep learning has potential to automate screening, monitoring and grading of disease in medical images. Pretraining with contrastive learning enables models to extract robust and generalisable features from natural image datasets, facilitating label-efficient downstream image analysis. However, the direct application of conventional contrastive methods to medical datasets introduces two domain-specific issues. Firstly, several image transformations which have been shown to be crucial for effective contrastive learning do not translate from the natural image to the medical image domain. Secondly, the assumption made by conventional methods, that any two images are dissimilar, is systematically misleading in medical datasets depicting the same anatomy and disease. This is exacerbated in longitudinal image datasets that repeatedly image the same patient cohort to monitor their disease progression over time. In this paper we tackle these issues by extending conventional contrastive frameworks with a novel metadata-enhanced strategy. Our approach employs widely available patient metadata to approximate the true set of inter-image contrastive relationships. To this end we employ records for patient identity, eye position (i.e. left or right) and time series information. In experiments using two large longitudinal datasets containing 170,427 retinal OCT images of 7,912 patients with age-related macular degeneration (AMD), we evaluate the utility of using metadata to incorporate the temporal dynamics of disease progression into pretraining. Our metadata-enhanced approach outperforms both standard contrastive methods and a retinal image foundation model in five out of six image-level downstream tasks related to AMD. Due to its modularity, our method can be quickly and cost-effectively tested to establish the potential benefits of including available metadata in contrastive pretraining.

Decoupled conditional contrastive learning with variable metadata for prostate lesion detection

A contrastive weakly supervised learning to characterize malignant prostate lesions in BP-MRI

Incorporating Clinical Guidelines through Adapting Multi-modal Large Language Model for Prostate Cancer PI-RADS Scoring

Domain Transfer Through Image-to-Image Translation for Uncertainty-Aware Prostate Cancer Classification

Deformable MRI Sequence Registration for AI-based Prostate Cancer Diagnosis

Metadata-enhanced contrastive learning from retinal optical coherence tomography images

Lesion-Aware Contrastive Learning for Diabetic Retinopathy Diagnosis

CDA-Net: A Contrastive Deep Adversarial Model for Prostate Cancer Segmentation in MRI Images.

Weakly supervised deep learning model with size constraint for prostate cancer detection in multiparametric MRI and generalization to unseen domains

Prostate cancer inference via weakly-supervised learning using a large collection of negative MRI

Leveraging multi-view data without annotations for prostate MRI segmentation: A contrastive approach

Unsupervised Contrastive Analysis for Salient Pattern Detection using Conditional Diffusion Models

Deep Learning Based Analysis of Prostate Cancer from MP-MRI

Weakly-supervised positional contrastive learning: application to cirrhosis classification

Annotation-efficient cancer detection with report-guided lesion annotation for deep learning-based prostate cancer detection in bpMRI

Precise Location Matching Improves Dense Contrastive Learning in Digital Pathology

MSCDA: Multi-level Semantic-guided Contrast Improves Unsupervised Domain Adaptation for Breast MRI Segmentation in Small Datasets

Generating and Weighting Semantically Consistent Sample Pairs for Ultrasound Contrastive Learning

Towards Learning Contrast Kinetics with Multi-Condition Latent Diffusion Models

Improving Computer-aided Detection using Convolutional Neural Networks and Random View Aggregation

Controlling False Positive/Negative Rates for Deep-Learning-Based Prostate Cancer Detection on Multiparametric MR images