Abstract:Introduction: Unscheduled machine downtime can cause treatment interruptions and adversely impact patient treatment outcomes. Conventional Quality Assurance (QA) programs of a proton Pencil Beam Scanning (PBS) system ensure its operational performance by keeping the beam parameters within clinical tolerances but often do not reveal the underlying issues of the device prior to a machine malfunction event. In this study, we propose a Predictive Maintenance (PdM) approach that leverages an advanced analytical tool built on a deep neural network to detect treatment delivery machine issues early. Methods: Beam delivery log file data from daily QA performed at the Burr Proton Center of Massachusetts General Hospital were collected. A novel PdM framework consisting of long short-term memory-based autoencoder (LSTM-AE) modeling of the proton PBS delivery system and a Mahalanobis distance-based error metric evaluation was constructed to detect rare anomalous machine events. These included QA beam pauses, clinical operational issues, and treatment interruptions. The model was trained in an unsupervised fashion on the QA data of normal sessions so that the model learned characteristics of normal machine operation. The anomaly is quantified as the multivariate deviation between the model predicted data and the measured data of the day using Mahalanobis distance (M-Score). Two-layer and three-layer Long short-term memory-based stacked autoencoder (LSTM-SAE) models were optimized for exploring model performance improvement. Model validation was performed with two clinical datasets and was analyzed using the area under the precision-recall curve (AUPRC) and the area under the receiver operating characteristic (AUROC). Results: LSTM-SAE models showed strong performance in predicting QA beam pauses for both clinical validation datasets. Despite severe skew in the dataset, the model achieved AUPRC of 0.60 and 0.82 and AUROC of 0.75 and 0.92 in the respective 2018 and 2020 datasets. Moreover, these amount to 2.8-fold and 10.7-fold enhancement compared to the respective baseline event rates. In addition, in terms of treatment interruption events, model prediction enabled 3.88-fold and 51.2-fold detection improvement, while the detection improvement for clinical operational issues was 1.04-fold and 1.37-fold, respectively, in the 2018 and 2020 datasets. Conclusion: Our novel deep LSTM-SAE-based framework allows for highly discriminative prediction of anomalous machine events and demonstrates great promise for enabling PdM for proton PBS beam delivery.

Preliminary study on the design of a predictive structural model for daily quality assurance in proton beams

A study on the effect of correlated data on predictive capabilities

A deep LSTM autoencoder-based framework for predictive maintenance of a proton radiotherapy delivery system

Neural Network Model Based on Branch Architecture for the Quality Assurance of Volumetric Modulated Arc Therapy

An artificial neural network based approach for predicting the proton beam spot dosimetric characteristics of a pencil beam scanning technique

Comparative Study of Structural Anomaly Diagnosis Based on ANN Model Using Random Displacement and Acceleration Responses with Incomplete Measurements

Effectiveness Analysis of Structural Anomaly Diagnosis Based on ANN Model

Software Quality Prediction for High-Assurance Network Telecommunications Systems.

Pretreatment Patient-Specific Quality Assurance Prediction Based on 1D Complexity Metrics and 3D Planning Dose: Classification, Gamma Passing Rates, and DVH Metrics.

Multilayer Perceptron Neural Network with Regression and Ranking Loss for Patient-Specific Quality Assurance

Modeling of Gamma Index for Prediction of Pretreatment Quality Assurance in Stereotactic Body Radiation Therapy of the Liver

Verification of helical tomotherapy delivery using autoassociative kernel regression

A deep learning method for predicting proton beam range and spread-out Bragg peak in passive scattering mode

Machine learning and deep learning prediction of patient specific quality assurance in breast IMRT radiotherapy plans using Halcyon specific complexity indices

Research on Particle Accelerator Control Network Deformation Prediction Algorithm with Machine Learning

Predicting the likelihood of QA failure using treatment plan accuracy metrics

Dose Calculation Accuracy of Beam Models in RadCalc for a 1.5 T MR-Linac

Improvement of deep learning prediction model in patient‐specific QA for VMAT with MLC leaf position map and patient's dose distribution

RNN-based integrated system for real-time sensor fault detection and fault-informed accident diagnosis in nuclear power plant accidents

A TPS integrated machine learning tool for predicting patient-specific quality assurance outcomes in volumetric-modulated arc therapy

Invertible and Variable Augmented Network for Pretreatment Patient-Specific Quality Assurance Dose Prediction