Abstract:Purpose: There has been burgeoning interest in applying machine learning methods for predicting radiotherapy outcomes. However, the imbalanced ratio of a large number of variables to a limited sample size in radiation oncology constitutes a major challenge. Therefore, dimensionality reduction methods can be a key to success. The study investigates and contrasts the application of traditional machine learning methods and deep learning approaches for outcome modeling in radiotherapy. In particular, new joint architectures based on variational autoencoder (VAE) for dimensionality reduction are presented and their application is demonstrated for the prediction of lung radiation pneumonitis (RP) from a large-scale heterogeneous dataset. Methods: A large-scale heterogeneous dataset containing a pool of 230 variables including clinical factors (e.g., dose, KPS, stage) and biomarkers (e.g., single nucleotide polymorphisms (SNPs), cytokines, and micro-RNAs) in a population of 106 nonsmall cell lung cancer (NSCLC) patients who received radiotherapy was used for modeling RP. Twenty-two patients had grade 2 or higher RP. Four methods were investigated, including feature selection (case A) and feature extraction (case B) with traditional machine learning methods, a VAE-MLP joint architecture (case C) with deep learning and lastly, the combination of feature selection and joint architecture (case D). For feature selection, Random forest (RF), Support Vector Machine (SVM), and multilayer perceptron (MLP) were implemented to select relevant features. Specifically, each method was run for multiple times to rank features within several cross-validated (CV) resampled sets. A collection of ranking lists were then aggregated by top 5% and Kemeny graph methods to identify the final ranking for prediction. A synthetic minority oversampling technique was applied to correct for class imbalance during this process. For deep learning, a VAE-MLP joint architecture where a VAE aimed for dimensionality reduction and an MLP aimed for classification was developed. In this architecture, reconstruction loss and prediction loss were combined into a single loss function to realize simultaneous training and weights were assigned to different classes to mitigate class imbalance. To evaluate the prediction performance and conduct comparisons, the area under receiver operating characteristic curves (AUCs) were performed for nested CVs for both handcrafted feature selections and the deep learning approach. The significance of differences in AUCs was assessed using the DeLong test of U-statistics. Results: An MLP-based method using weight pruning (WP) feature selection yielded the best performance among the different hand-crafted feature selection methods (case A), reaching an AUC of 0.804 (95% CI: 0.761-0.823) with 29 top features. A VAE-MLP joint architecture (case C) achieved a comparable but slightly lower AUC of 0.781 (95% CI: 0.737-0.808) with the size of latent dimension being 2. The combination of handcrafted features (case A) and latent representation (case D) achieved a significant AUC improvement of 0.831 (95% CI: 0.805-0.863) with 22 features (P-value = 0.000642 compared with handcrafted features only (Case A) and P-value = 0.000453 compared to VAE alone (Case C)) with an MLP classifier. Conclusion: The potential for combination of traditional machine learning methods and deep learning VAE techniques has been demonstrated for dealing with limited datasets in modeling radiotherapy toxicities. Specifically, latent variables from a VAE-MLP joint architecture are able to complement handcrafted features for the prediction of RP and improve prediction over either method alone.

A deep learning‐based dual‐omics prediction model for radiation pneumonitis

Multi-omics deep learning for radiation pneumonitis prediction in lung cancer patients underwent volumetric modulated arc therapy

Synergizing the interaction of single nucleotide polymorphisms with dosiomics features to build a dual-omics model for the prediction of radiation pneumonitis

Multi-region Multiomic Random Forest Toxicity Modeling of Radiation Pneumonitis.

Computed tomography and radiation dose images-based deep-learning model for predicting radiation pneumonitis in lung cancer patients after radiation therapy

Radiation Pneumonitis Prediction after Stereotactic Body Radiation Therapy Based on 3D Dose Distribution: Dosiomics And/or Deep Learning-Based Radiomics Features

Improvement of Prediction Performance for Radiation Pneumonitis by Using 3-Dimensional Dosiomic Features

Integration of dosimetric parameters, clinical factors, and radiomics to predict symptomatic radiation pneumonitis in lung cancer patients undergoing combined immunotherapy and radiotherapy

Enhancing the prediction of symptomatic radiation pneumonitis for locally advanced non-small-cell lung cancer by combining 3D deep learning-derived imaging features with dose–volume metrics: a two-center study

Predicting Severe Radiation Pneumonitis in Patients with Locally- Advanced Non-Small Cell Lung Cancer after Thoracic Radiotherapy: Development and Internal Validation of a Nomogram Based on the Clinical, Hematological and Dose–volume Histogram Parameters

Deep-Learning Model Prediction of Radiation Pneumonitis Using Pretreatment Chest Computed Tomography and Clinical Factors

Prediction of Radiation Pneumonitis with Dose Distribution: A Convolutional Neural Network (CNN) Based Model

Combining handcrafted features with latent variables in machine learning for prediction of radiation-induced lung damage

Integrative prediction model for radiation pneumonitis incorporating genetic and clinical-pathological factors using machine learning

Radiation pneumonitis prediction with dual-radiomics for esophageal cancer underwent radiotherapy

Predicting radiation pneumonitis in lung cancer: a EUD-based machine learning approach for volumetric modulated arc therapy patients

CT-based different regions of interest radiomics analysis for acute radiation pneumonitis in patients with locally advanced NSCLC after chemoradiotherapy

Radiomics-based hybrid model for predicting radiation pneumonitis: A systematic review and meta-analysis

Radiomics analysis of 3D dose distributions to predict toxicity of radiotherapy for lung cancer

Developing a prediction model for radiation pneumonitis in lung cancer patients treated with stereotactic body radiation therapy combined with clinical, dosimetric factors and laboratory biomarkers

A Machine Learning Framework for Early Prediction of Radiation Dermatitis in Patients with Breast Cancer Receiving Radiation Treatment: A Multicenter Retrospective Analysis Study