Abstract:Fetal ultrasound (US) four-chamber (FC) views are essential in diagnosing congenital heart defects (CHD). Gathering a sufficient number of diverse and high-quality fetal US FC views within a short period remains a significant challenge for training novice physicians or assisted-diagnosis intelligent models. As an effective data augmentation technique, medical image editing synthesis enables the synthesis of various structural views within specific regions as desired, thereby greatly facilitating the training of novice physicians and intelligent models. However, due to the high noise and artifacts within the views, the existing approaches do not necessarily synthesize perfect texture aligned with external guidance in editable areas while also struggling to maintain a contextual style consistent with preserved areas. To address this issue, we propose an enhanced style-consistent modulation (ESCM), a two-stage modulation technology that combines external semantic and sketch contours with contextual style to produce enhanced context-aware modulation parameters. We also develop an ESCM-based progressive growing generative adversarial network (ESCMPGGAN), which decomposes the synthetic process into three stages to synthesize faithful textures using a coarse-to-fine approach. Moreover, we propose a sketch mask loss that promotes the ESCMPGGAN’s emphasis on the background during training, thereby comprehensively exploiting sketch information to enhance the model’s capacity for learning background textures. Our experimental results demonstrate that the proposed method successfully synthesizes high-quality views with a consistent contextual style between the editable and preserved regions and realistic appearance details. In addition, the synthesized views meet the requirements for clinical standards, confirming our approach’s effectiveness.

A Progressive Growing Generative Adversarial Network Composed of Enhanced Style-Consistent Modulation for Fetal Ultrasound Four-Chamber View Editing Synthesis

A Pseudo-Siamese Feature Fusion Generative Adversarial Network for Synthesizing High-Quality Fetal Four-Chamber Views

OA-GAN: Organ-Aware Generative Adversarial Network for Synthesizing Contrast-Enhanced Medical Images

Sketch guided and progressive growing GAN for realistic and editable ultrasound image synthesis

Synthesis and Edition of Ultrasound Images via Sketch Guided Progressive Growing GANs

DPC-MSGATNet: Dual-Path Chain Multi-Scale Gated Axial-Transformer Network for Four-Chamber View Segmentation in Fetal Echocardiography

A Progressive Generative Adversarial Method for Structurally Inadequate Medical Image Data Augmentation

Cross-modal Interaction and Multi-Source Visual Fusion for Video Generation in Fetal Cardiac Screening

Improving the Quality of Fetal Heart Ultrasound Imaging with Multihead Enhanced Self-Attention and Contrastive Learning

FetalBrainAwareNet: Bridging GANs with anatomical insight for fetal ultrasound brain plane synthesis

Automatic Detection of Cardiac Chambers Using an Attention-based YOLOv4 Framework from Four-chamber View of Fetal Echocardiography

FLDS: an Intelligent Feature Learning Detection System for Visualizing Medical Images Supporting Fetal Four-Chamber Views

Segmentation of four-chamber view images in fetal ultrasound exams using a novel deep learning model ensemble method

Automatic Segmentation of a Fetal Echocardiogram Using Modified Active Appearance Models and Sparse Representation.

SPReCHD: Four-Chamber Semantic Parsing Network for Recognizing Fetal Congenital Heart Disease in Medical Metaverse.

Freehand Ultrasound Image Simulation with Spatially-Conditioned Generative Adversarial Networks

Automated interpretation of congenital heart disease from multi-view echocardiograms

Weakly-supervised High-fidelity Ultrasound Video Synthesis with Feature Decoupling

A Prior-Guided Generative Adversarial Net for Semantically Strict Ultrasound Images Augmentation.

Local Style Preservation in Improved GAN-Driven Synthetic Image Generation for Endoscopic Tool Segmentation

Anatomy-Aware Self-supervised Fetal MRI Synthesis from Unpaired Ultrasound Images