Abstract:Observational longitudinal studies are a common means to study treatment efficacy and safety in chronic mental illness. In many such studies, treatment changes may be initiated by either the patient or by their clinician and can thus vary widely across patients in their timing, number, and type. Indeed, in the observational longitudinal pathway of the STEP-BD study of bipolar depression, one of the motivations for this work, no two patients have the same treatment history even after coarsening clinic visits to a weekly time-scale. Estimation of an optimal treatment regime using such data is challenging as one cannot naively pool together patients with the same treatment history, as is required by methods based on inverse probability weighting, nor is it possible to apply backwards induction over the decision points, as is done in Q-learning and its variants. Thus, additional structure is needed to effectively pool information across patients and within a patient over time. Current scientific theory for many chronic mental illnesses maintains that a patient's disease status can be conceptualized as transitioning among a small number of discrete states. We use this theory to inform the construction of a partially observable Markov decision process model of patient health trajectories wherein observed health outcomes are dictated by a patient's latent health state. Using this model, we derive and evaluate estimators of an optimal treatment regime under two common paradigms for quantifying long-term patient health. The finite sample performance of the proposed estimator is demonstrated through a series of simulation experiments and application to the observational pathway of the STEP-BD study. We find that the proposed method provides high-quality estimates of an optimal treatment strategy in settings where existing approaches cannot be applied without ad hoc modifications.

A Latent Gaussian Process Model with Application to Monitoring Clinical Trials

A Novel Bayesian Robust Model and Its Application for Fault Detection and Automatic Supervision of Nonlinear Process

Linear mixed effects models for non‐Gaussian continuous repeated measurement data

Nonlinear Probabilistic Monitoring Based on the Gaussian Process Latent Variable Model

Modelling Sparse Generalized Longitudinal Observations with Latent Gaussian Processes

A Bayesian Phase II Proof-of-concept Design for Clinical Trials with Longitudinal Endpoints.

Heterogeneous Clinical Trial Outcomes via Multi-Output Gaussian Processes

Optimized Gaussian-Process-Based Probabilistic Latent Variable Modeling Framework for Distributed Nonlinear Process Monitoring

A Bayesian Design for Phase II Clinical Trials with Delayed Responses Based on Multiple Imputation.

Latent-state models for precision medicine

An additive Gaussian process regression model for interpretable non-parametric analysis of longitudinal data

Recursive Gaussian Mixture Models for Adaptive Process Monitoring

Joint Hierarchical Gaussian Process Model with Application to Forecast in Medical Monitoring

Advanced models for predicting event occurrence in event-driven clinical trials accounting for patient dropout, cure and ongoing recruitment

Estimation of Optimal Dynamic Treatment Regimes using Gaussian Process Emulation

Blinded continuous information monitoring of recurrent event endpoints with time trends in clinical trials

Latent Gaussian Mixture Models for Nationwide Kidney Transplant Center Evaluation

Latent Gaussian Process Regression

Monitoring Ongoing Clinical Trials under Fractional Brownian Motion with Drift

Generalized Linear Latent Variable Modeling for Multi-Group Studies

Joint models for the longitudinal analysis of measurement scales in the presence of informative dropout