Abstract:Background and ObjectiveDeep learning approaches are common in image processing, but often rely on supervised learning, which requires a large volume of training images, usually accompanied by hand-crafted labels. As labelled data are often not available, it would be desirable to develop methods that allow such data to be compiled automatically. In this study, we used a Generative Adversarial Network (GAN) to generate realistic B-mode musculoskeletal ultrasound images, and tested the suitability of two automated labelling approaches.MethodsWe used a model including two GANs each trained to transfer an image from one domain to another. The two inputs were a set of 100 longitudinal images of the gastrocnemius medialis muscle, and a set of 100 synthetic segmented masks that featured two aponeuroses and a random number of 'fascicles'. The model output a set of synthetic ultrasound images and an automated segmentation of each real input image. This automated segmentation process was one of the two approaches we assessed. The second approach involved synthesising ultrasound images and then feeding these images into an ImageJ/Fiji-based automated algorithm, to determine whether it could detect the aponeuroses and muscle fascicles.ResultsHistogram distributions were similar between real and synthetic images, but synthetic images displayed less variation between samples and a narrower range. Mean entropy values were statistically similar (real: 6.97, synthetic: 7.03; p = 0.218), but the range was much narrower for synthetic images (6.91 – 7.11 versus 6.30 – 7.62). When comparing GAN-derived and manually labelled segmentations, intersection-over-union values- denoting the degree of overlap between aponeurosis labels- varied between 0.0280 – 0.612 (mean ± SD: 0.312 ± 0.159), and pennation angles were higher for the GAN-derived segmentations (25.1° vs. 19.3 °; p < 0.001). For the second segmentation approach, the algorithm generally performed equally well on synthetic and real images, yielding pennation angles within the physiological range (13.8-20°).ConclusionsWe used a GAN to generate realistic B-mode ultrasound images, and extracted muscle architectural parameters from these images automatically. This approach could enable generation of large labelled datasets for image segmentation tasks, and may also be useful for data sharing. Automatic generation and labelling of ultrasound images minimises user input and overcomes several limitations associated with manual analysis.

Deep adversarial data augmentation for biomedical spectroscopy: Application to modelling Raman spectra of bone

Ferritin synthesis and Iron uptake in developing erythroid cells

Data Augmentation Scheme for Raman Spectra with Highly Correlated Annotations

Bone-GAN: Generation of virtual bone microstructure of high resolution peripheral quantitative computed tomography

Three-dimensional Bone Image Synthesis with Generative Adversarial Networks

Using deep learning to generate synthetic B-mode musculoskeletal ultrasound images

Utilization of Synthetic Near-Infrared Spectra via Generative Adversarial Network to Improve Wood Stiffness Prediction

Machine Learning Data Augmentation Strategy for Electron Energy Loss Spectroscopy: Generative Adversarial Networks

Generative Image Translation for Data Augmentation of Bone Lesion Pathology

Optimizing number of Raman spectra using an artificial neural network guided Monte Carlo simulation approach to analyze human cortical bone

Enhancing synthetic training data for quantitative photoacoustic tomography with generative deep learning

Classification of osteoarthritic and healthy cartilage using deep learning with Raman spectra

GAN-based one dimensional medical data augmentation

Cross-Modality Synthetic Data Augmentation using GANs: Enhancing Brain MRI and Chest X-ray Classification

Bone metastasis scintigram generation using generative adversarial learning with multi-receptive field learning and two-stage training

A Comparative Analysis of Data Synthesis Techniques to Improve Classification Accuracy of Raman Spectroscopy Data

How Good Are Synthetic Medical Images? An Empirical Study with Lung Ultrasound

Generative Adversarial Networks for Data Augmentation

Optimized Preprocessing and Machine Learning for Quantitative Raman Spectroscopy in Biology

[Design and synthesis of subtype- and species-selective peroxisome proliferator-activated receptor (PPAR) alpha ligands].

Machine learning driven high-resolution Raman spectral generation for accurate molecular feature recognition