Abstract:Brain tumors are a pernicious cancer with one of the lowest five-year survival rates. Neurologists often use magnetic resonance imaging (MRI) to diagnose the type of brain tumor. Automated computer-assisted tools can help them speed up the diagnosis process and reduce the burden on the health care systems. Recent advances in deep learning for medical imaging have shown remarkable results, especially in the automatic and instant diagnosis of various cancers. However, we need a large amount of data (images) to train the deep learning models in order to obtain good results. Large public datasets are rare in medicine. This paper proposes a framework based on unsupervised deep generative neural networks to solve this limitation. We combine two generative models in the proposed framework: variational autoencoders (VAEs) and generative adversarial networks (GANs). We swap the encoder–decoder network after initially training it on the training set of available MR images. The output of this swapped network is a noise vector that has information of the image manifold, and the cascaded generative adversarial network samples the input from this informative noise vector instead of random Gaussian noise. The proposed method helps the GAN to avoid mode collapse and generate realistic-looking brain tumor magnetic resonance images. These artificially generated images could solve the limitation of small medical datasets up to a reasonable extent and help the deep learning models perform acceptably. We used the ResNet50 as a classifier, and the artificially generated brain tumor images are used to augment the real and available images during the classifier training. We compared the classification results with several existing studies and state-of-the-art machine learning models. Our proposed methodology noticeably achieved better results. By using brain tumor images generated artificially by our proposed method, the classification average accuracy improved from 72.63% to 96.25%. For the most severe class of brain tumor, glioma, we achieved 0.769, 0.837, 0.833, and 0.80 values for recall, specificity, precision, and F1-score, respectively. The proposed generative model framework could be used to generate medical images in any domain, including PET (positron emission tomography) and MRI scans of various parts of the body, and the results show that it could be a useful clinical tool for medical experts.

A two-dimensional ZnII coordination polymer constructed from benzene-1,2,3-tricarboxylic acid and N,N'-bis[(pyridin-4-yl)methylidene]hydrazine.

Bidirectional Mapping Generative Adversarial Networks for Brain MR to PET Synthesis

Multi-Constraint Transferable Generative Adversarial Networks for Cross-Modal Brain Image Synthesis

MRI Cross-Modality NeuroImage-to-NeuroImage Translation

Bidirectional Mapping of Brain MRI and PET With 3D Reversible GAN for the Diagnosis of Alzheimer’s Disease

Brain Status Transferring Generative Adversarial Network for Decoding Individualized Atrophy in Alzheimer's Disease

Brain Tumor Classification Using a Combination of Variational Autoencoders and Generative Adversarial Networks

Synthetic Brain Images: Bridging the Gap in Brain Mapping With Generative Adversarial Model

Application and prospect for generative adversarial networks in cross-modality reconstruction of medical images.

Task-Induced Pyramid and Attention GAN for Multimodal Brain Image Imputation and Classification in Alzheimer's Disease

Applications of generative adversarial networks in neuroimaging and clinical neuroscience

A review of the applications of generative adversarial networks to structural and functional MRI based diagnostic classification of brain disorders

Improved Domain Adaptation Network Based on Wasserstein Distance for Motor Imagery EEG Classification

Generative Adversarial Networks for Brain Images Synthesis: A Review

Generative Learning-Based Lightweight MRI Brain Tumor Segmentation with Missing Modalities

MRI to PET Cross-Modality Translation using Globally and Locally Aware GAN (GLA-GAN) for Multi-Modal Diagnosis of Alzheimer's Disease

The role of generative adversarial networks in brain MRI: a scoping review

FedMed-GAN: Federated Domain Translation on Unsupervised Cross-Modality Brain Image Synthesis

Generating 3D Brain Tumor Regions in MRI using Vector-Quantization Generative Adversarial Networks

Functional brain network identification and fMRI augmentation using a VAE-GAN framework

MMFGAN: A novel multimodal brain medical image fusion based on the improvement of generative adversarial network