Abstract:Although adaptive cancer therapy shows promise in integrating evolutionary dynamics into treatment scheduling, the stochastic nature of cancer evolution has seldom been taken into account. Various sources of random perturbations can impact the evolution of heterogeneous tumors, making performance metrics of any treatment policy random as well. In this paper, we propose an efficient method for selecting optimal adaptive treatment policies under randomly evolving tumor dynamics. The goal is to improve the cumulative "cost" of treatment, a combination of the total amount of drugs used and the total treatment time. As this cost also becomes random in any stochastic setting, we maximize the probability of reaching the treatment goals (tumor stabilization or eradication) without exceeding a pre-specified cost threshold (or a "budget"). We use a novel Stochastic Optimal Control formulation and Dynamic Programming to find such "threshold-aware" optimal treatment policies. Our approach enables an efficient algorithm to compute these policies for a range of threshold values simultaneously. Compared to treatment plans shown to be optimal in a deterministic setting, the new "threshold-aware" policies significantly improve the chances of the therapy succeeding under the budget, which is correlated with a lower general drug usage. We illustrate this method using two specific examples, but our approach is far more general and provides a new tool for optimizing adaptive therapies based on a broad range of stochastic cancer models. Tumor heterogeneities provide an opportunity to improve therapies by leveraging complex (often competitive) interactions of different types of cancer cells. These interactions are usually stochastic due to both individual cell differences and random events affecting the patient as a whole. The new generation of cancer models strive to account for this inherent stochasticity, and adaptive treatment plans need to reflect it as well. In optimizing such treatment, the most common approach is to maximize the probability of eventually stabilizing or eradicating the tumor. In this paper, we consider a more nuanced version of success, maximizing the probability of reaching these therapy goals before the cumulative burden from the disease and treatment exceed a chosen threshold. Importantly, our method allows computing such optimal treatment plans efficiently and for a range of thresholds at once. If used on a high-fidelity personalized model, our general approach could potentially be used by clinicians to choose the most suitable threshold after a detailed discussion of a specific patient's goals (e.g., to include the trade-offs between toxicity and quality of life).

Finding Optimal Cancer Treatment using Markov Decision Process to Improve Overall Health and Quality of Life

A Markov decision process approach to optimizing cancer therapy using multiple modalities

Markov Decision Process Modeling for Multi-stage Optimization of Intervention and Treatment Strategies in Breast Cancer

Use of a Markov Decision Process Model for Treatment Selection in an Asymptomatic Disease with Consideration of Risk Sensitivity

Markov models for clinical decision‐making in radiation oncology: A systematic review

Threshold-awareness in adaptive cancer therapy

Optimizing adaptive cancer therapy: dynamic programming and evolutionary game theory

Medical follow-up optimization: A Monte-Carlo planning strategy

A Decision Making Approach for Chemotherapy Planning based on Evolutionary Processing

Personalized Dynamic Treatment Regimes in Continuous Time: A Bayesian Approach for Optimizing Clinical Decisions with Timing

Improving cancer treatments via dynamical biophysical models

Cost-Effectiveness of Personalized Policies for Implementing Organ-at-Risk Sparing Adaptive Radiation Therapy in Head and Neck Cancer: A Markov Decision Process Approach

An Optimal Control Strategy for Mathematically Modeling Cancer Combination Therapy

Decision making and uncertainty quantification for individualized treatments using Bayesian Additive Regression Trees

On Estimation of Optimal Treatment Regimes For Maximizing t-Year Survival Probability

Optimization of chemotherapy regimens using mathematical programming

Estimation of Optimal Dynamic Treatment Regimes using Gaussian Process Emulation

Quality of Decision Making in Radiation Oncology

Minimizing Metastatic Risk in Radiotherapy Fractionation Schedules

Improving Observed Decisions Quality using Inverse Optimization: A Radiation Therapy Treatment Planning Application