Label-free segmentation from cardiac ultrasound using self-supervised learning

Danielle L. Ferreira,Zaynaf Salaymang,Rima Arnaout

2023-10-25

Abstract:Segmentation and measurement of cardiac chambers is critical in cardiac ultrasound but is laborious and poorly reproducible. Neural networks can assist, but supervised approaches require the same laborious manual annotations. We built a pipeline for self-supervised (no manual labels) segmentation combining computer vision, clinical domain knowledge, and deep learning. We trained on 450 echocardiograms (93,000 images) and tested on 8,393 echocardiograms (4,476,266 images; mean 61 years, 51% female), using the resulting segmentations to calculate biometrics. We also tested against external images from an additional 10,030 patients with available manual tracings of the left ventricle. r2 between clinically measured and pipeline-predicted measurements were similar to reported inter-clinician variation and comparable to supervised learning across several different measurements (r2 0.56-0.84). Average accuracy for detecting abnormal chamber size and function was 0.85 (range 0.71-0.97) compared to clinical measurements. A subset of test echocardiograms (n=553) had corresponding cardiac MRIs, where MRI is the gold standard. Correlation between pipeline and MRI measurements was similar to that between clinical echocardiogram and MRI. Finally, the pipeline accurately segments the left ventricle with an average Dice score of 0.89 (95% CI [0.89]) in the external, manually labeled dataset. Our results demonstrate a manual-label free, clinically valid, and highly scalable method for segmentation from ultrasound, a noisy but globally important imaging modality.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to achieve cardiac chamber segmentation without manual annotation in cardiac ultrasound examinations. Specifically, the authors propose a self - supervised learning method, aiming to overcome the problem that traditional supervised learning methods require a large amount of manually - annotated data. This method can not only reduce the workload of manual annotation, but also improve the accuracy and repeatability of cardiac ultrasound image segmentation, thereby improving the diagnosis and management of heart diseases.

The key points of the paper include:
1. **Problem background**: Chamber quantification in cardiac ultrasound examinations is crucial for diagnosis, prognosis, and management. However, traditional manual annotation methods are time - consuming, error - prone, and there are large differences in measurement results among different observers.
2. **Existing challenges**: Although deep - learning techniques can assist in solving this problem, existing supervised learning methods still rely on a large amount of manually - annotated data, which not only increases the workload but may also introduce annotation errors.
3. **Solution**: The authors developed a self - supervised learning pipeline, combining computer vision techniques and knowledge in the clinical field, to achieve cardiac chamber segmentation without manual annotation. This method generates initial weak labels and uses these labels to train neural networks, gradually improving the accuracy of segmentation.
4. **Verification and application**: This method was tested on large - scale internal and external datasets, and the results showed that its performance was comparable to that of clinical measurements and supervised learning methods, and even better in some indicators.

In conclusion, this paper aims to provide an efficient, accurate, and scalable method for the automatic segmentation of cardiac ultrasound images through self - supervised learning techniques, thereby reducing the workload of doctors and improving the accuracy and consistency of diagnosis.