Abstract:Measuring cross-sectional areas in ultrasound images is a standard tool to evaluate disease progress or treatment response. Often addressed today with supervised deep-learning segmentation approaches, existing solutions highly depend upon the quality of experts' annotations. However, the annotation quality in ultrasound is anisotropic and position-variant due to the inherent physical imaging principles, including attenuation, shadows, and missing boundaries, commonly exacerbated with depth. This work proposes a novel approach that guides ultrasound segmentation networks to account for sonographers' uncertainties and generate predictions with variability similar to the experts. We claim that realistic variability can reduce overconfident predictions and improve physicians' acceptance of deep-learning cross-sectional segmentation solutions. Our method provides CM's certainty for each pixel for minimal computational overhead as it can be precalculated directly from the image. We show that there is a correlation between low values in the confidence maps and expert's label uncertainty. Therefore, we propose to give the confidence maps as additional information to the networks. We study the effect of the proposed use of ultrasound CMs in combination with four state-of-the-art neural networks and in two configurations: as a second input channel and as part of the loss. We evaluate our method on 3D ultrasound datasets of the thyroid and lower limb muscles. Our results show ultrasound CMs increase the Dice score, improve the Hausdorff and Average Surface Distances, and decrease the number of isolated pixel predictions. Furthermore, our findings suggest that ultrasound CMs improve the penalization of uncertain areas in the ground truth data, thereby improving problematic interpolations. Our code and example data will be made public at <a class="link-external link-https" href="https://github.com/IFL-CAMP/Confidence-segmentation" rel="external noopener nofollow">this https URL</a>.

SMRVIS: Point cloud extraction from 3-D ultrasound for non-destructive testing

Automatic Spinal Ultrasound Image Segmentation and Deployment for Real-time Spine Volumetric Reconstruction

A target region extraction method for ultrasound medical images based on improved PRIDNet and UCTransNet

Weakly-Supervised White and Grey Matter Segmentation in 3D Brain Ultrasound

RapidVol: Rapid Reconstruction of 3D Ultrasound Volumes from Sensorless 2D Scans

DSC-Net: A Novel Interactive Two-Stream Network by Combining Transformer and CNN for Ultrasound Image Segmentation

Deep Learning-based Breast Tumor Detection and Segmentation in 3D Ultrasound Image

Can ultrasound confidence maps predict sonographers' labeling variability?

Joint Segmentation and Landmark Localization of Fetal Femur in Ultrasound Volumes

A CNN Segmentation-Based Approach to Object Detection and Tracking in Ultrasound Scans with Application to the Vagus Nerve Detection

A Deep Learning Framework for Spatiotemporal Ultrasound Localization Microscopy

Reslicing Ultrasound Images for Data Augmentation and Vessel Reconstruction

Efficient Medical Instrument Detection in 3D Volumetric Ultrasound Data

Siamese Spatial Pyramid Matching Network with Location Prior for Anatomical Landmark Tracking in 3-Dimension Ultrasound Sequence

A Unified Framework for 3D Point Cloud Visual Grounding

EchoFusion: Tracking and Reconstruction of Objects in 4D Freehand Ultrasound Imaging without External Trackers

SUMNet: Fully Convolutional Model For Fast Segmentation of Anatomical Structures in Ultrasound Volumes

CP-UNet: Contour-based Probabilistic Model for Medical Ultrasound Images Segmentation

Robust Segmentation of Various Anatomies in 3D Ultrasound Using Hough Forests and Learned Data Representations

Deep Spectral Methods for Unsupervised Ultrasound Image Interpretation

Segmentation MC Algorithm-Based Method for Ultrasound Image 3-D Reconstruction