Estimating heterogeneity of treatment effect in psychiatric clinical trials

Joshua S. Siegel,Jinglin Zhong,Sasagu Tomioka,Ajay Ogirala,Stephen V. Faraone,Steven T. Szabo,Kenneth S. Koblan,Seth C. Hopkins

DOI: https://doi.org/10.1101/2024.04.23.24306211

2024-04-23

Abstract:Currently, placebo-controlled clinical trials report mean change and effect sizes, which masks information about heterogeneity of treatment effects (HTE). Here, we present a method to estimate HTE and evaluate the null hypothesis (H ) that a drug has equal benefit for all participants (HTE=0). We developed measure termed ‘estimated heterogeneity of treatment effect’ or , which estimates variability in drug response by comparing distributions between study arms. This approach was tested across numerous large placebo-controlled clinical trials. In contrast with variance-based methods which have not identified heterogeneity in psychiatric trials, reproducible instances of treatment heterogeneity were found. For example, heterogeneous response was found in a trial of venlafaxine for depression (p =0.034), and two trials of dasotraline for binge eating disorder (Phase 2, p =0.002; Phase 3, 4mg p =0.011; Phase 3, 6mg p =0.003). Significant response heterogeneity was detected in other datasets as well, often despite no difference in variance between placebo and drug arms. The implications of eHTE as a clinical trial outcomes independent from central tendency of the group is considered and the important of the eHTE method and results for drug developers, providers, and patients is discussed.

Psychiatry and Clinical Psychology

What problem does this paper attempt to address?

The main focus of this paper is on assessing and estimating the heterogeneity of treatment effect (HTE) in clinical trials for mental disorders. Current clinical trials typically report average changes and effect sizes, but this approach obscures the differential information on individual treatment responses. The study proposes a new method called "estimated heterogeneity of treatment effect" or eHTE, which estimates the variability of drug response by comparing the distributions between study arms (e.g., placebo and drug group).

The paper points out that despite the relatively small average treatment effect of antidepressants in large meta-analyses, there is generally believed to be a subgroup that benefits significantly from the medication. However, due to the roughly equal variability between antidepressant and placebo groups, some studies infer no heterogeneity in response to antidepressants. The eHTE method developed in the paper identifies reproducible instances of treatment heterogeneity in multiple large clinical trials, such as those for venlafaxine (used for depression) and lisdexamfetamine (used for binge eating disorder).

As a clinical trial outcome measure independent of population centering, eHTE has important implications for drug developers, providers, and patients. The paper demonstrates different types of heterogeneity through simulation and real clinical trial data, proving the existence of treatment heterogeneity in psychiatric clinical trials. Furthermore, the eHTE method can be used to guide when enrichment and subgroup analyses should be conducted, aiding the development of personalized medicine.

In summary, this paper aims to address how to identify and quantify the differences in treatment effects among individuals in clinical trials for mental disorders, in order to facilitate more personalized medical decisions and provide guidance for drug development.