Abstract:Brain tumors are a pernicious cancer with one of the lowest five-year survival rates. Neurologists often use magnetic resonance imaging (MRI) to diagnose the type of brain tumor. Automated computer-assisted tools can help them speed up the diagnosis process and reduce the burden on the health care systems. Recent advances in deep learning for medical imaging have shown remarkable results, especially in the automatic and instant diagnosis of various cancers. However, we need a large amount of data (images) to train the deep learning models in order to obtain good results. Large public datasets are rare in medicine. This paper proposes a framework based on unsupervised deep generative neural networks to solve this limitation. We combine two generative models in the proposed framework: variational autoencoders (VAEs) and generative adversarial networks (GANs). We swap the encoder–decoder network after initially training it on the training set of available MR images. The output of this swapped network is a noise vector that has information of the image manifold, and the cascaded generative adversarial network samples the input from this informative noise vector instead of random Gaussian noise. The proposed method helps the GAN to avoid mode collapse and generate realistic-looking brain tumor magnetic resonance images. These artificially generated images could solve the limitation of small medical datasets up to a reasonable extent and help the deep learning models perform acceptably. We used the ResNet50 as a classifier, and the artificially generated brain tumor images are used to augment the real and available images during the classifier training. We compared the classification results with several existing studies and state-of-the-art machine learning models. Our proposed methodology noticeably achieved better results. By using brain tumor images generated artificially by our proposed method, the classification average accuracy improved from 72.63% to 96.25%. For the most severe class of brain tumor, glioma, we achieved 0.769, 0.837, 0.833, and 0.80 values for recall, specificity, precision, and F1-score, respectively. The proposed generative model framework could be used to generate medical images in any domain, including PET (positron emission tomography) and MRI scans of various parts of the body, and the results show that it could be a useful clinical tool for medical experts.

Semi-Supervised Variational Autoencoder for Survival Prediction

Deep Semisupervised Multitask Learning Model and Its Interpretability for Survival Analysis.

Segmentation then Prediction: A Multi-task Solution to Brain Tumor Segmentation and Survival Prediction

Leveraging segmentation-guided spatial feature embedding for overall survival prediction in glioblastoma with multimodal magnetic resonance imaging

Multi-task learning for concurrent survival prediction and semi-supervised segmentation of gliomas in brain MRI

Predicting survival of glioblastoma from automatic whole-brain and tumor segmentation of MR images

Merging-Diverging Hybrid Transformer Networks for Survival Prediction in Head and Neck Cancer

Multimodal PET/CT Tumour Segmentation and Prediction of Progression-Free Survival using a Full-Scale UNet with Attention

Variational Deep Survival Machines: Survival Regression with Censored Outcomes

Ensembles of Convolutional Neural Networks for Survival Time Estimation of High-Grade Glioma Patients from Multimodal MRI

Brain Tumor Segmentation and Survival Prediction Using Multimodal MRI Scans With Deep Learning

Ensemble Technique for Brain Tumor Patient Survival Prediction

Ensemble of CNNs for Segmentation of Glioma Sub-regions with Survival Prediction

Censor-aware Semi-supervised Learning for Survival Time Prediction from Medical Images

Multi-modal Intermediate Feature Interaction AutoEncoder for Overall Survival Prediction of Esophageal Squamous Cell Cancer

Leveraging the variational Bayes autoencoder for survival analysis

A multi-view co-training network for semi-supervised medical image-based prognostic prediction

Automated Neural Network-based Survival Prediction of Glioblastoma Patients Using Pre-operative MRI and Clinical Data

Brain Tumor Classification Using a Combination of Variational Autoencoders and Generative Adversarial Networks

A Semi-Supervised Method for Predicting Cancer Survival Using Incomplete Clinical Data

SAVAE: Leveraging the variational Bayes autoencoder for survival analysis