Abstract:In this work, we examine recently developed methods for Bayesian inference of optimal dynamic treatment regimes (DTRs). DTRs are a set of treatment decision rules aimed at tailoring patient care to patient-specific characteristics, thereby falling within the realm of precision medicine. In this field, researchers seek to tailor therapy with the intention of improving health outcomes; therefore, they are most interested in identifying optimal DTRs. Recent work has developed Bayesian methods for identifying optimal DTRs in a family indexed by ψ via Bayesian dynamic marginal structural models (MSMs) (Rodriguez Duque D, Stephens DA, Moodie EEM, Klein MB. Semiparametric Bayesian inference for dynamic treatment regimes via dynamic regime marginal structural models. Biostatistics; 2022. (In Press)); we review the proposed estimation procedure and illustrate its use via the new BayesDTR R package. Although methods in Rodriguez Duque D, Stephens DA, Moodie EEM, Klein MB. (Semiparametric Bayesian inference for dynamic treatment regimes via dynamic regime marginal structural models. Biostatistics; 2022. (In Press)) can estimate optimal DTRs well, they may lead to biased estimators when the model for the expected outcome if everyone in a population were to follow a given treatment strategy, known as a value function, is misspecified or when a grid search for the optimum is employed. We describe recent work that uses a Gaussian process ( G P ) prior on the value function as a means to robustly identify optimal DTRs (Rodriguez Duque D, Stephens DA, Moodie EEM. Estimation of optimal dynamic treatment regimes using Gaussian processes; 2022. Available from: https://doi.org/10.48550/arXiv.2105.12259). We demonstrate how a G P approach may be implemented with the BayesDTR package and contrast it with other value-search approaches to identifying optimal DTRs. We use data from an HIV therapeutic trial in order to illustrate a standard analysis with these methods, using both the original observed trial data and an additional simulated component to showcase a longitudinal (two-stage DTR) analysis.

Optimal Treatment Regimes: A Review and Empirical Comparison

Interpretable Dynamic Treatment Regimes

On Estimation of Optimal Treatment Regimes For Maximizing t-Year Survival Probability

Using decision lists to construct interpretable and parsimonious treatment regimes

Targeted Optimal Treatment Regime Learning Using Summary Statistics

Optimal regimes for algorithm-assisted human decision-making

Reinforcement Learning in Clinical Medicine: a Method to Optimize Dynamic Treatment Regime over Time.

An optimal learning method for developing personalized treatment regimes

Estimation of optimal treatment regimes with electronic medical record data using the residual life value estimator

Adaptive Semi-Supervised Inference for Optimal Treatment Decisions with Electronic Medical Record Data

Optimal dynamic treatment regime estimation using information extraction from unstructured clinical text

Identification of the Optimal Treatment Regimen in the Presence of Missing Covariates

Estimation and Optimization of Composite Outcomes

Safe and Interpretable Estimation of Optimal Treatment Regimes

Estimating Bayesian Optimal Treatment Regimes for Dichotomous Outcomes using Observational Data

Optimal Biomarker-Guided Design for Targeted Therapy with Imperfectly Measured Biomarkers

Estimating Individualized Treatment Regimes from Crossover Designs

Improved bounds and inference on optimal regimes

On estimating optimal regime for treatment initiation time based on restricted mean residual lifetime

A matching-based machine learning approach to estimating optimal dynamic treatment regimes with time-to-event outcomes

Bayesian inference for optimal dynamic treatment regimes in practice