Abstract:Self-supervised contrastive representation learning offers the advantage of learning meaningful visual representations from unlabeled medical datasets for transfer learning. However, applying current contrastive learning approaches to medical data without considering its domain-specific anatomical characteristics may lead to visual representations that are inconsistent in appearance and semantics. In this paper, we propose to improve visual representations of medical images via anatomy-aware contrastive learning (AWCL), which incorporates anatomy information to augment the positive/negative pair sampling in a contrastive learning manner. The proposed approach is demonstrated for automated fetal ultrasound imaging tasks, enabling the positive pairs from the same or different ultrasound scans that are anatomically similar to be pulled together and thus improving the representation learning. We empirically investigate the effect of inclusion of anatomy information with coarse- and fine-grained granularity, for contrastive learning and find that learning with fine-grained anatomy information which preserves intra-class difference is more effective than its counterpart. We also analyze the impact of anatomy ratio on our AWCL framework and find that using more distinct but anatomically similar samples to compose positive pairs results in better quality representations. Experiments on a large-scale fetal ultrasound dataset demonstrate that our approach is effective for learning representations that transfer well to three clinical downstream tasks, and achieves superior performance compared to ImageNet supervised and the current state-of-the-art contrastive learning methods. In particular, AWCL outperforms ImageNet supervised method by 13.8% and state-of-the-art contrastive-based method by 7.1% on a cross-domain segmentation task.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: in fetal ultrasound images, the existing self - supervised contrastive learning methods may lead to poor consistency in visual representation in terms of appearance and semantics because they do not consider the anatomical features in specific fields. Specifically, directly applying the existing contrastive learning methods to medical data may lead to inconsistent visual representation. For example, when sampling positive and negative sample pairs, the anatomical structure information in medical images is ignored, resulting in false negatives or false positives. To solve this problem, the author proposes a new Anatomy - Aware Contrastive Learning (AWCL) method, aiming to improve the visual representation learning of fetal ultrasound images by introducing anatomical information. ### Key points of the solution 1. **Introducing anatomical information**: - By combining anatomical information to enhance the sampling process of positive and negative sample pairs, images from the same or different ultrasound scans but with similar anatomical structures can be clustered more accurately. 2. **Multi - granularity anatomical categories**: - Coarse - granularity and fine - granularity anatomical categories are considered to evaluate their impact on the transferability of feature representation. Experiments show that using fine - granularity anatomical information to preserve intra - class differences is more effective than coarse - granularity. 3. **Alternating optimization framework**: - An alternating optimization framework is proposed, combining the traditional contrastive learning objective and the anatomy - aware contrastive learning objective to deal with the situation where anatomical information is not always available. 4. **Downstream task evaluation**: - Experimental evaluations are carried out on three clinical downstream tasks, including standard plane detection, NT and CRL segmentation, and early - pregnancy anatomical structure identification. The experimental results show that the AWCL method outperforms ImageNet - supervised pre - training and other contrastive learning methods in these tasks. ### Main contributions - An anatomy - aware contrastive learning method (AWCL) specifically designed for fetal ultrasound images is proposed. - Experiments prove that, compared with coarse - granularity anatomical information, fine - granularity anatomical information can improve the quality of feature representation more effectively. - The experimental results on multiple downstream clinical tasks show that the AWCL method significantly outperforms existing methods, especially in cross - domain segmentation tasks, with a performance improvement of 13.8%. Through these improvements, the AWCL method can better capture the anatomical structure features in fetal ultrasound images, thereby improving the generalization ability and performance of the model in various clinical tasks.

Anatomy-Aware Contrastive Representation Learning for Fetal Ultrasound

Anatomy-Aware Self-supervised Fetal MRI Synthesis from Unpaired Ultrasound Images

Improving the Quality of Fetal Heart Ultrasound Imaging with Multihead Enhanced Self-Attention and Contrastive Learning

FetalBrainAwareNet: Bridging GANs with anatomical insight for fetal ultrasound brain plane synthesis

Generating and Weighting Semantically Consistent Sample Pairs for Ultrasound Contrastive Learning

Statistical Dependency Guided Contrastive Learning for Multiple Labeling in Prenatal Ultrasound

Best of Both Worlds: Multimodal Contrastive Learning with Tabular and Imaging Data

LACL: Lesion-Aware Contrastive Learning Framework for Medical Image Classification

Positional Contrastive Learning for Volumetric Medical Image Segmentation

Contrastive learning-guided multi-meta attention network for breast ultrasound video diagnosis

Robust image representations with counterfactual contrastive learning

USCL: Pretraining Deep Ultrasound Image Diagnosis Model through Video Contrastive Representation Learning

Contrastive self-supervised learning from 100 million medical images with optional supervision

Contrastive Learning of Medical Visual Representations from Paired Images and Text

A Clinical-oriented Multi-level Contrastive Learning Method for Disease Diagnosis in Low-quality Medical Images

Biometric contrastive learning for data-efficient deep learning from electrocardiographic images

Learning Better Contrastive View from Radiologist's Gaze

Coarse-to-fine visual representation learning for medical images via class activation maps

Representation Disentanglement for Multi-task Learning with application to Fetal Ultrasound

Unsupervised Local Discrimination for Medical Images