Abstract:Generative AI models have recently achieved mainstream attention with the advent of powerful approaches such as stable diffusion, DALL-E and MidJourney. The underlying breakthrough generative mechanism of denoising diffusion modeling can generate high quality synthetic images and can learn the underlying distribution of complex, high-dimensional data. Recent research has begun to extend these models to medical and specifically neuroimaging data. Typical neuroimaging tasks such as diagnostic classification and predictive modeling often rely on deep learning approaches based on convolutional neural networks (CNNs) and vision transformers (ViTs), with additional steps to help in interpreting the results. In our paper, we train conditional latent diffusion models (LDM) and denoising diffusion probabilistic models (DDPM) to provide insight into Alzheimer’s disease (AD) effects on the brain’s anatomy at the individual level. We first created diffusion models that could generate synthetic MRIs, by training them on real 3D T1-weighted MRI scans, and conditioning the generative process on the clinical diagnosis as a context variable. We conducted experiments to overcome limitations in training dataset size, compute time and memory resources, testing different model sizes, effects of pretraining, training duration, and latent diffusion models. We tested the sampling quality of the disease-conditioned diffusion using metrics to assess realism and diversity of the generated synthetic MRIs. We also evaluated the ability of diffusion models to conditionally sample MRI brains using a 3D CNN-based disease classifier relative to real MRIs. In our experiments, the diffusion models generated synthetic data that helped to train an AD classifier (using only 500 real training scans) -and boosted its performance by over 3% when tested on real MRI scans. Further, we used implicit classifier-free guidance to alter the conditioning of an encoded individual scan to its counterfactual (representing a healthy subject of the same age and sex) while preserving subject-specific image details. From this counterfactual image (where the same person appears healthy), a personalized disease map was generated to identify possible disease effects on the brain. Our approach efficiently generates realistic and diverse synthetic data, and may create interpretable AI-based maps for neuroscience research and clinical diagnostic applications.

2D brain MRI image synthesis based on lightweight denoising diffusion probabilistic model

High-resolution MRI synthesis using a data-driven framework with denoising diffusion probabilistic modeling

2D medical image synthesis using transformer-based denoising diffusion probabilistic model

Conditional Diffusion Models for Semantic 3D Brain MRI Synthesis

Counterfactual MRI Generation with Denoising Diffusion Models for Interpretable Alzheimer's Disease Effect Detection

Counterfactual MRI Generation with Denoising Diffusion Models for Interpretable Alzheimer’s Disease Effect Detection

Evaluating Synthetic Diffusion MRI Maps created with Diffusion Denoising Probabilistic Models

Generating Realistic Brain MRIs via a Conditional Diffusion Probabilistic Model

Learning Implicit Brain MRI Manifolds with Deep Learning

Synthetic Brain Images: Bridging the Gap in Brain Mapping With Generative Adversarial Model

Bayesian Conditional GAN for MRI Brain Image Synthesis

Cycle-guided Denoising Diffusion Probability Model for 3D Cross-modality MRI Synthesis

Denoising diffusion probabilistic models for 3D medical image generation

An enhanced network for brain MR image denoising

Make-A-Volume: Leveraging Latent Diffusion Models for Cross-Modality 3D Brain MRI Synthesis

DDM$^2$: Self-Supervised Diffusion MRI Denoising with Generative Diffusion Models

Towards High-Quality MRI Reconstruction With Anisotropic Diffusion-Assisted Generative Adversarial Networks And Its Multi-Modal Images Extension

DDMM-Synth: A Denoising Diffusion Model for Cross-modal Medical Image Synthesis with Sparse-view Measurement Embedding

Multi-contrast high-field quality image synthesis for portable low-field MRI using generative adversarial networks and paired data

Synthesizing 3D Multi-Contrast Brain Tumor MRIs Using Tumor Mask Conditioning

Non-Reference Quality Assessment for Medical Imaging: Application to Synthetic Brain MRIs