Abstract:Background and ObjectiveDeep learning approaches are common in image processing, but often rely on supervised learning, which requires a large volume of training images, usually accompanied by hand-crafted labels. As labelled data are often not available, it would be desirable to develop methods that allow such data to be compiled automatically. In this study, we used a Generative Adversarial Network (GAN) to generate realistic B-mode musculoskeletal ultrasound images, and tested the suitability of two automated labelling approaches.MethodsWe used a model including two GANs each trained to transfer an image from one domain to another. The two inputs were a set of 100 longitudinal images of the gastrocnemius medialis muscle, and a set of 100 synthetic segmented masks that featured two aponeuroses and a random number of 'fascicles'. The model output a set of synthetic ultrasound images and an automated segmentation of each real input image. This automated segmentation process was one of the two approaches we assessed. The second approach involved synthesising ultrasound images and then feeding these images into an ImageJ/Fiji-based automated algorithm, to determine whether it could detect the aponeuroses and muscle fascicles.ResultsHistogram distributions were similar between real and synthetic images, but synthetic images displayed less variation between samples and a narrower range. Mean entropy values were statistically similar (real: 6.97, synthetic: 7.03; p = 0.218), but the range was much narrower for synthetic images (6.91 – 7.11 versus 6.30 – 7.62). When comparing GAN-derived and manually labelled segmentations, intersection-over-union values- denoting the degree of overlap between aponeurosis labels- varied between 0.0280 – 0.612 (mean ± SD: 0.312 ± 0.159), and pennation angles were higher for the GAN-derived segmentations (25.1° vs. 19.3 °; p < 0.001). For the second segmentation approach, the algorithm generally performed equally well on synthetic and real images, yielding pennation angles within the physiological range (13.8-20°).ConclusionsWe used a GAN to generate realistic B-mode ultrasound images, and extracted muscle architectural parameters from these images automatically. This approach could enable generation of large labelled datasets for image segmentation tasks, and may also be useful for data sharing. Automatic generation and labelling of ultrasound images minimises user input and overcomes several limitations associated with manual analysis.

Synthesizing Real-Time Ultrasound Images of Muscle Based on Biomechanical Simulation and Conditional Diffusion Network

Automatic Analysis of Transverse Musculoskeletal Ultrasound Images Based on the Multi-Task Learning Model

Quantifying skeletal muscle structure parameters in ultrasound images using deep learning without linear assumptions

Emulating Clinical Quality Muscle B-mode Ultrasound Images from Plane Wave Images Using a Two-Stage Machine Learning Model

Using deep learning to generate synthetic B-mode musculoskeletal ultrasound images

Weakly-supervised High-fidelity Ultrasound Video Synthesis with Feature Decoupling

Large-Scale Simulation of Realistic Cardiac Ultrasound Data With Clinical Appearance: Methodology and Open-Access Database

B-mode ultrasound to elastography synthesis using multiscale learning

Sketch guided and progressive growing GAN for realistic and editable ultrasound image synthesis

Echo from noise: synthetic ultrasound image generation using diffusion models for real image segmentation

Enhancing Multi-Object Detection in Ultrasound Images Through Semi-Supervised Learning, Focal Loss and Relation of Frame

IFSS-Net: Interactive Few-Shot Siamese Network for Faster Muscle Segmentation and Propagation in Volumetric Ultrasound

Cardiac ultrasound simulation for autonomous ultrasound navigation

Multimodal Distillation Pre-training Model for Ultrasound Dynamic Images Annotation

A Human-Centered Machine-Learning Approach for Muscle-Tendon Junction Tracking in Ultrasound Images

Automatic extraction and measurement of ultrasonic muscle morphological parameters based on multi-stage fusion and segmentation

Deep learning segmentation of transverse musculoskeletal ultrasound images for neuromuscular disease assessment

Deep Image Translation for Enhancing Simulated Ultrasound Images

Muscle Cross-Sectional Area Segmentation in Transverse Ultrasound Images Using Vision Transformers

Echocardiography Segmentation Based on Cross-modal Data Augmentation Method

HeartBeat: Towards Controllable Echocardiography Video Synthesis with Multimodal Conditions-Guided Diffusion Models