Abstract:The significance of medical image synthesis has exponentially grown due to constrained medical resources, making it a critical component in numerous clinical applications. This process facilitates the generation of high-quality, multi-modal medical images, ultimately enhancing medical image diagnostics. Currently, prevailing medical image synthesis methodologies primarily rely on voxel-based or GAN-based strategies to address substantial challenges arising from disparities in various imaging principles and significant noise. However, these methodologies rarely consider the intensity distribution difference among multi-modal or multi-parameters medical images, which generates unstable and unexplainable results. In response to these limitations, we propose a novel approach-a general variation-driven neural network for medical image synthesis that considers explicit data distribution. Within this method, we introduce the concept of a variation-based distance metric, providing a quantitative framework for capturing distribution disparities between medical images originating from both the source and target domains. Subsequently, guided by this variation-based distance metric, we introduce a robust end-to-end neural network architecture carefully designed to synthesize target medical images. Our proposed method has undergone extensive experimentation across various medical image synthesis tasks, including cross-modality transformations between CT and MRI, high-dose CT synthesis from low-dose CT, and the conversion of multi-parameters in MRI, including T1, T2, T1ce, and Flair sequences. In comparative assessments against existing methods, our approach consistently outperforms them across three publicly available datasets: Gold Atlas, LDCT, and BraTS2018. Additionally, we have successfully applied our model to generate high-quality Micro-CT images in dental clinics from CBCT data, significantly enhancing diagnostic capabilities in this clinical setting.

Cross-Domain Synthesis of Medical Images Using Efficient Location-Sensitive Deep Network.

Deep Networks and Mutual Information Maximization for Cross-Modal Medical Image Synthesis

OA-GAN: Organ-Aware Generative Adversarial Network for Synthesizing Contrast-Enhanced Medical Images

A Novel Method Of Synthetic Ct Generation From Mr Images Based On Convolutional Neural Networks

Generalized Brain Image Synthesis with Transferable Convolutional Sparse Coding Networks.

Self-Attentive Spatial Adaptive Normalization for Cross-Modality Domain Adaptation

Unsupervised Cross-Modal Synthesis of Subject-Specific Scans

A general variation-driven network for medical image synthesis

Simultaneous Super-Resolution and Cross-Modality Synthesis of 3D Medical Images using Weakly-Supervised Joint Convolutional Sparse Coding

Sparse Bayesian Deep Learning for Cross Domain Medical Image Reconstruction

Cross-Modality Image Synthesis via Weakly Coupled and Geometry Co-Regularized Joint Dictionary Learning

Cross-Modality Neuroimage Synthesis: A Survey

Deep Embedding Convolutional Neural Network for Synthesizing CT Image from T1-Weighted MR Image

Medical Imaging Synthesis using Deep Learning and its Clinical Applications: A Review

Make-A-Volume: Leveraging Latent Diffusion Models for Cross-Modality 3D Brain MRI Synthesis

Causality-Inspired Single-Source Domain Generalization for Medical Image Segmentation

An hetero-modal deep learning framework for medical image synthesis applied to contrast and non-contrast MRI

Deep Non-Linear Embedding Deformation Network for Cross-Modal Brain MRI Synthesis.

Towards cross-modal organ translation and segmentation: A cycle- and shape-consistent generative adversarial network

Domain-Adaptive 3D Medical Image Synthesis: An Efficient Unsupervised Approach

A Deep Learning Model for Multi-Domain MRI Synthesis Using Generative Adversarial Networks