Abstract:Self-supervised contrastive representation learning offers the advantage of learning meaningful visual representations from unlabeled medical datasets for transfer learning. However, applying current contrastive learning approaches to medical data without considering its domain-specific anatomical characteristics may lead to visual representations that are inconsistent in appearance and semantics. In this paper, we propose to improve visual representations of medical images via anatomy-aware contrastive learning (AWCL), which incorporates anatomy information to augment the positive/negative pair sampling in a contrastive learning manner. The proposed approach is demonstrated for automated fetal ultrasound imaging tasks, enabling the positive pairs from the same or different ultrasound scans that are anatomically similar to be pulled together and thus improving the representation learning. We empirically investigate the effect of inclusion of anatomy information with coarse- and fine-grained granularity, for contrastive learning and find that learning with fine-grained anatomy information which preserves intra-class difference is more effective than its counterpart. We also analyze the impact of anatomy ratio on our AWCL framework and find that using more distinct but anatomically similar samples to compose positive pairs results in better quality representations. Experiments on a large-scale fetal ultrasound dataset demonstrate that our approach is effective for learning representations that transfer well to three clinical downstream tasks, and achieves superior performance compared to ImageNet supervised and the current state-of-the-art contrastive learning methods. In particular, AWCL outperforms ImageNet supervised method by 13.8% and state-of-the-art contrastive-based method by 7.1% on a cross-domain segmentation task.

Semi-supervised Anatomy Tracking with Contrastive Representation Learning in Ultrasound Sequences.

USCL: Pretraining Deep Ultrasound Image Diagnosis Model through Video Contrastive Representation Learning

Anatomy-Aware Contrastive Representation Learning for Fetal Ultrasound

An improved contrastive learning network for semi-supervised multi-structure segmentation in echocardiography

PIPsUS: Self-Supervised Point Tracking in Ultrasound

Deep Semi-Supervised Ultrasound Image Segmentation by Using a Shadow Aware Network with Boundary Refinement.

Contrastive Semi-supervised Learning for Domain Adaptive Segmentation Across Similar Anatomical Structures

Contrastive Self-Supervised Learning for Spatio-Temporal Analysis of Lung Ultrasound Videos

Enabling Augmented Segmentation and Registration in Ultrasound-Guided Spinal Surgery via Realistic Ultrasound Synthesis from Diagnostic CT Volume

Spatial Attention Lesion Detection On Automated Breast Ultrasound

Image Retrieval with Intra-Sweep Representation Learning for Neck Ultrasound Scanning Guidance

Enhancing Multi-Object Detection in Ultrasound Images Through Semi-Supervised Learning, Focal Loss and Relation of Frame

Uncertainty-Guided Voxel-Level Supervised Contrastive Learning for Semi-Supervised Medical Image Segmentation

A Hybrid Enhanced Attention Transformer Network for Medical Ultrasound Image Segmentation

Learning Semi-Supervised Medical Image Segmentation from Spatial Registration

Statistical Dependency Guided Contrastive Learning for Multiple Labeling in Prenatal Ultrasound

SAM: Self-supervised Learning of Pixel-wise Anatomical Embeddings in Radiological Images

Generating and Weighting Semantically Consistent Sample Pairs for Ultrasound Contrastive Learning

Benchmarking Supervised and Self-Supervised Learning Methods in A Large Ultrasound Muti-task Images Dataset

Self-supervised multi-task learning for medical image analysis