Abstract:Brain tumors are a pernicious cancer with one of the lowest five-year survival rates. Neurologists often use magnetic resonance imaging (MRI) to diagnose the type of brain tumor. Automated computer-assisted tools can help them speed up the diagnosis process and reduce the burden on the health care systems. Recent advances in deep learning for medical imaging have shown remarkable results, especially in the automatic and instant diagnosis of various cancers. However, we need a large amount of data (images) to train the deep learning models in order to obtain good results. Large public datasets are rare in medicine. This paper proposes a framework based on unsupervised deep generative neural networks to solve this limitation. We combine two generative models in the proposed framework: variational autoencoders (VAEs) and generative adversarial networks (GANs). We swap the encoder–decoder network after initially training it on the training set of available MR images. The output of this swapped network is a noise vector that has information of the image manifold, and the cascaded generative adversarial network samples the input from this informative noise vector instead of random Gaussian noise. The proposed method helps the GAN to avoid mode collapse and generate realistic-looking brain tumor magnetic resonance images. These artificially generated images could solve the limitation of small medical datasets up to a reasonable extent and help the deep learning models perform acceptably. We used the ResNet50 as a classifier, and the artificially generated brain tumor images are used to augment the real and available images during the classifier training. We compared the classification results with several existing studies and state-of-the-art machine learning models. Our proposed methodology noticeably achieved better results. By using brain tumor images generated artificially by our proposed method, the classification average accuracy improved from 72.63% to 96.25%. For the most severe class of brain tumor, glioma, we achieved 0.769, 0.837, 0.833, and 0.80 values for recall, specificity, precision, and F1-score, respectively. The proposed generative model framework could be used to generate medical images in any domain, including PET (positron emission tomography) and MRI scans of various parts of the body, and the results show that it could be a useful clinical tool for medical experts.

Medical image synthesis via conditional GANs: Application to segmenting brain tumours

Multi-modal brain tumor segmentation via conditional synthesis with Fourier domain adaptation

Brain Tumor Synthetic Segmentation in 3D Multimodal MRI Scans

Improvement of Multiparametric MR Image Segmentation by Augmenting the Data With Generative Adversarial Networks for Glioma Patients

Brain tumor segmentation using synthetic MR images -- A comparison of GANs and diffusion models

Brain tumor image pixel segmentation and detection using an aggregation of GAN models with vision transformer

BTS-GAN: Computer-aided Segmentation System for Breast Tumor Using MRI and Conditional Adversarial Networks

High Tissue Contrast MRI Synthesis Using Multi-Stage Attention-GAN for Glioma Segmentation

Brain tumor image generation using an aggregation of GAN models with style transfer

Low-Grade Gliomas MR Image Segmentation Based on Conditional Generative Adversarial Networks

Nimg-65. Synthetic Mri Generation To Facilitate Autosegmentation Of Pediatric Brain Tumors In Limited Data Scenarios

Using a generative adversarial network to generate synthetic MRI images for multi-class automatic segmentation of brain tumors

MMGan: a Multimodal MR Brain Tumor Image Segmentation Method

Lesion Mask-based Simultaneous Synthesis of Anatomic and MolecularMR Images using a GAN

Generating 3D Brain Tumor Regions in MRI using Vector-Quantization Generative Adversarial Networks

Generative Adversarial Networks for Weakly Supervised Generation and Evaluation of Brain Tumor Segmentations on MR Images

A Comparative Analysis of the Novel Conditional Deep Convolutional Neural Network Model, Using Conditional Deep Convolutional Generative Adversarial Network-Generated Synthetic and Augmented Brain Tumor Datasets for Image Classification

Brain Tumor Segmentation with Generative Adversarial Nets

DualMMP-GAN: Dual-scale Multi-Modality Perceptual Generative Adversarial Network for Medical Image Segmentation

Brain Tumor Classification Using a Combination of Variational Autoencoders and Generative Adversarial Networks

Cross-Modality Augmentation Of Brain Mr Images Using A Novel Pairwise Generative Adversarial Network For Enhanced Glioma Classification