Abstract:Brain tumors are a pernicious cancer with one of the lowest five-year survival rates. Neurologists often use magnetic resonance imaging (MRI) to diagnose the type of brain tumor. Automated computer-assisted tools can help them speed up the diagnosis process and reduce the burden on the health care systems. Recent advances in deep learning for medical imaging have shown remarkable results, especially in the automatic and instant diagnosis of various cancers. However, we need a large amount of data (images) to train the deep learning models in order to obtain good results. Large public datasets are rare in medicine. This paper proposes a framework based on unsupervised deep generative neural networks to solve this limitation. We combine two generative models in the proposed framework: variational autoencoders (VAEs) and generative adversarial networks (GANs). We swap the encoder–decoder network after initially training it on the training set of available MR images. The output of this swapped network is a noise vector that has information of the image manifold, and the cascaded generative adversarial network samples the input from this informative noise vector instead of random Gaussian noise. The proposed method helps the GAN to avoid mode collapse and generate realistic-looking brain tumor magnetic resonance images. These artificially generated images could solve the limitation of small medical datasets up to a reasonable extent and help the deep learning models perform acceptably. We used the ResNet50 as a classifier, and the artificially generated brain tumor images are used to augment the real and available images during the classifier training. We compared the classification results with several existing studies and state-of-the-art machine learning models. Our proposed methodology noticeably achieved better results. By using brain tumor images generated artificially by our proposed method, the classification average accuracy improved from 72.63% to 96.25%. For the most severe class of brain tumor, glioma, we achieved 0.769, 0.837, 0.833, and 0.80 values for recall, specificity, precision, and F1-score, respectively. The proposed generative model framework could be used to generate medical images in any domain, including PET (positron emission tomography) and MRI scans of various parts of the body, and the results show that it could be a useful clinical tool for medical experts.

Generative Active Learning with Variational Autoencoder for Radiology Data Generation in Veterinary Medicine

Improvement in Image Quality of Low-Dose CT of Canines with Generative Adversarial Network of Anti-Aliasing Generator and Multi-Scale Discriminator

Large-scale Generative Modeling to Improve Automated Veterinary Disease Coding

Medical variational autoencoder and generative adversarial network for medical imaging

Exploring Variational Autoencoders for Medical Image Generation: A Comprehensive Study

Deep neural models for automated multi-task diagnostic scan management—quality enhancement, view classification and report generation

Medical Image Generation Techniques for Data Augmentation: Disc-VAE versus GAN

A Critical Assessment of Generative Models for Synthetic Data Augmentation on Limited Pneumonia X-ray Data

Brain Tumor Classification Using a Combination of Variational Autoencoders and Generative Adversarial Networks

Discriminative Hamiltonian Variational Autoencoder for Accurate Tumor Segmentation in Data-Scarce Regimes

Vision-Language Generative Model for View-Specific Chest X-ray Generation

Synthetic Medical Imaging Generation with Generative Adversarial Networks For Plain Radiographs

End-to-end autoencoding architecture for the simultaneous generation of medical images and corresponding segmentation masks

Generative adversarial network in medical imaging: A review

Generative AI in orthopedics: an explainable deep few-shot image augmentation pipeline for plain knee radiographs and Kellgren-Lawrence grading

Generative Adversarial Networks for Data Augmentation

Generative Adversarial U-Net for Domain-free Medical Image Augmentation

Generative Adversarial Networks with Radiomics Supervision for Lung Lesion Generation

Generative Image Translation for Data Augmentation of Bone Lesion Pathology

Insights and Considerations in Development and Performance Evaluation of Generative Adversarial Networks (GANs): What Radiologists Need to Know

RADIOGAN: Deep Convolutional Conditional Generative adversarial Network To Generate PET Images