Bayesian methods including nonrandomized study data increased the efficiency of postlaunch RCTs.

A. Schmidt,I. Klugkist,O. Klungel,M. Nielen,A. de Boer,A. Hoes,R. Groenwold

DOI: https://doi.org/10.1016/j.jclinepi.2014.11.015

IF: 7.407

2015-04-01

Journal of Clinical Epidemiology

Abstract:

What problem does this paper attempt to address?

BASIC: A Bayesian Adaptive Synthetic-Control Design for Phase II Clinical Trials.

Liyun Jiang,Peter F. Thall,Fangrong Yan,Scott Kopetz,Ying Yuan

DOI: https://doi.org/10.1177/17407745231176445

2023-01-01

Clinical Trials

Abstract:BACKGROUND:Randomized controlled trials are considered the gold standard for evaluating experimental treatments but often require large sample sizes. Single-arm trials require smaller sample sizes but are subject to bias when using historical control data for comparative inferences. This article presents a Bayesian adaptive synthetic-control design that exploits historical control data to create a hybrid of a single-arm trial and a randomized controlled trial.METHODS:The Bayesian adaptive synthetic control design has two stages. In stage 1, a prespecified number of patients are enrolled in a single arm given the experimental treatment. Based on the stage 1 data, applying propensity score matching and Bayesian posterior prediction methods, the usefulness of the historical control data for identifying a pseudo sample of matched synthetic-control patients for making comparative inferences is evaluated. If a sufficient number of synthetic controls can be identified, the single-arm trial is continued. If not, the trial is switched to a randomized controlled trial. The performance of The Bayesian adaptive synthetic control design is evaluated by computer simulation.RESULTS:The Bayesian adaptive synthetic control design achieves power and unbiasedness similar to a randomized controlled trial but on average requires a much smaller sample size, provided that the historical control data patients are sufficiently comparable to the trial patients so that a good number of matched controls can be identified in the historical control data. Compared to a single-arm trial, The Bayesian adaptive synthetic control design yields much higher power and much smaller bias.CONCLUSION:The Bayesian adaptive synthetic-control design provides a useful tool for exploiting historical control data to improve the efficiency of single-arm phase II clinical trials, while addressing the problem of bias when comparing trial results to historical control data. The proposed design achieves power similar to a randomized controlled trial but may require a substantially smaller sample size.
Bayesian Approach for Design and Analysis of Medical Device Trials in the Era of Modern Clinical Studies

Han Cao,Chen Yao,Ying Yuan

DOI: https://doi.org/10.1515/mr-2023-0026

2023-01-01

Abstract:Medical device technology develops rapidly, and the life cycle of a medical device is much shorter than drugs. It is necessary to evaluate the safety and effectiveness of a medical device in a timely manner to keep up with technology flux. Bayesian methods provides an efficient approach to addressing this challenge. In this article, we review the characteristics of the Bayesian approach and some Bayesian designs that were commonly used in medical device regulatory setting, including Bayesian adaptive design, Bayesian diagnostic design, Bayesian multiregional design, and Bayesian label expansion study. We illustrate these designs with medical devices approved by the US Food and Drug Administration (FDA). We also review several innovative Bayesian information borrowing methods, and briefly discuss the challenges and future directions of the Bayesian application in medical device trials. Our objective is to promote the use of the Bayesian approach to accelerate the development of innovative medical devices and their accessibility to patients for effective disease diagnoses and treatments.
Bayesian Optimal Phase II Design for Randomized Clinical Trials

Yujie Zhao,Bo Yang,J. Jack Lee,Li Wang,Ying Yuan

DOI: https://doi.org/10.1080/19466315.2022.2050290

2022-01-01

Statistics in Biopharmaceutical Research

Abstract:Randomized clinical trials are the gold standard to evaluate the efficacy of an experimental treatment. We propose a flexible Bayesian optimal phase II (BOP2) design for two-arm randomized trials. The proposed two-arm BOP2 design is flexible and can handle single, multiple primary and coprimary endpoints for superiority and noninferiority trials under a unified framework. It also allows users to specify the number and timing of interim analyses to meet clinical needs. While enjoying the flexibility of Bayesian adaptive designs, the two-arm BOP2 design explicitly controls the Type I error rate and is optimal for maximizing power, thereby ensuring desirable frequentist operating characteristics. Another feature of the two-arm BOP2 design is that its decision rule can be tabulated and included in the trial protocol prior to trial commence. To conduct the trial, no complicated Bayesian calculation is needed; clinicians can simply look up the table and make go/no-go decisions. Simulation studies show that the two-arm BOP2 design has desirable operating characteristics. Easy-to-use online application is freely available at www.trialdesign.org to facilitate the use of the two-arm BOP2 design in clinical trials.
Adaptive designs in public health: Vaccine and cluster randomized trials go Bayesian

Ofir Harari,Jay J. H. Park,Prince Kumar Lat,Edward J. Mills

DOI: https://doi.org/10.1002/sim.10104

2024-05-09

Statistics in Medicine

Abstract:Clinical trials in public health—particularly those conducted in low‐ and middle‐income countries—often involve communicable and non‐communicable diseases with high disease burden and unmet needs. Trials conducted in these regions often are faced with resource limitations, so improving the efficiencies of these trials is critical. Adaptive trial designs have the potential to save trial time and resources and reduce the number of patients receiving ineffective interventions. In this paper, we provide a detailed account of the implementation of vaccine and cluster randomized trials within the framework of Bayesian adaptive trials, with emphasis on computational efficiency and flexibility with regard to stopping rules and allocation ratios. We offer an educated approach to selecting prior distributions and a data‐driven empirical Bayes method for plug‐in estimates for nuisance parameters.

public, environmental & occupational health,medicine, research & experimental,medical informatics,mathematical & computational biology,statistics & probability
Covariate adjustment in Bayesian adaptive randomized controlled trials

James Willard,Shirin Golchi,Erica EM Moodie

DOI: https://doi.org/10.1177/09622802241227957

IF: 2.494

2024-02-09

Statistical Methods in Medical Research

Abstract:Statistical Methods in Medical Research, Ahead of Print. In conventional randomized controlled trials, adjustment for baseline values of covariates known to be at least moderately associated with the outcome increases the power of the trial. Recent work has shown a particular benefit for more flexible frequentist designs, such as information adaptive and adaptive multi-arm designs. However, covariate adjustment has not been characterized within the more flexible Bayesian adaptive designs, despite their growing popularity. We focus on a subclass of these which allow for early stopping at an interim analysis given evidence of treatment superiority. We consider both collapsible and non-collapsible estimands and show how to obtain posterior samples of marginal estimands from adjusted analyses. We describe several estimands for three common outcome types. We perform a simulation study to assess the impact of covariate adjustment using a variety of adjustment models in several different scenarios. This is followed by a real-world application of the compared approaches to a COVID-19 trial with a binary endpoint. For all scenarios, it is shown that covariate adjustment increases power and the probability of stopping the trials early, and decreases the expected sample sizes as compared to unadjusted analyses.

health care sciences & services,medical informatics,mathematical & computational biology,statistics & probability
A Tutorial on Modern Bayesian Methods in Clinical Trials

Natalia Muehlemann,Tianjian Zhou,Rajat Mukherjee,Munshi Imran Hossain,Satrajit Roychoudhury,Estelle Russek-Cohen

DOI: https://doi.org/10.1007/s43441-023-00515-3

2023-04-21

Abstract:Clinical trials continue to be the gold standard for evaluating new medical technologies. New advancements in modern computation power have led to increasing interest in Bayesian methods. Despite the multiple benefits of Bayesian approaches, application to clinical trials has been limited. Based on insights from the survey of clinical researchers in drug development conducted by the Drug Information Association Bayesian Scientific Working Group (DIA BSWG), insufficient knowledge of Bayesian approaches was ranked as the most important perceived barrier to implementing Bayesian methods. Results of the same survey indicate that clinical researchers may find the interpretation of results from a Bayesian analysis to be more useful than conventional interpretations. In this article, we illustrate key concepts tied to Bayesian methods, starting with familiar concepts widely used in clinical practice before advancing in complexity, and use practical illustrations from clinical development.

pharmacology & pharmacy,medical informatics
Quinazolines. II. 2-Guanidino-4,6,7-trimethylquinazoline as a by-product in the three-component synthesis of 4,6-diamino-2,2-dimethyl-1-(3,4-xylyl)-1,2-dihydro-s-triazine-1,2.

A. Rosowsky,H. K. Protopapa,E. Modest

DOI: https://doi.org/10.1021/JO01012A501

Abstract:
Bayesian Interim Analysis and Efficiency of Phase III Randomized Trials

Alexander Dean Sherry,Pavlos Msaouel,Avital Miller,Timothy Lin,Gabrielle Kupferman,Joseph Abi Jaoude,Ramez Kouzy,Molly B. El-Alam,Roshal Patel,Alex Koong,Christine Lin,Tomer Meirson,Zachary B. McCaw,Ethan Ludmir

DOI: https://doi.org/10.1101/2024.06.27.24309608

2024-06-28

Abstract:IMPORTANCE Improving the efficiency of interim assessments in phase III trials should reduce trial costs, hasten the approval of efficacious therapies, and mitigate patient exposure to disadvantageous randomizations. OBJECTIVE We hypothesized that in silico Bayesian early stopping rules improve the efficiency of phase III trials compared with the original frequentist analysis without compromising overall interpretation. DESIGN Cross-sectional analysis. SETTING 230 randomized phase III oncology trials enrolling 184,752 participants. PARTICIPANTS Individual patient-level data were manually reconstructed from primary endpoint Kaplan-Meier curves. INTERVENTIONS Trial accruals were simulated 100 times per trial and leveraged published patient outcomes such that only the accrual dynamics, and not the patient outcomes, were randomly varied. MAIN OUTCOMES AND MEASURES Early stopping was triggered per simulation if interim analysis demonstrated >= 85% probability of minimum clinically important difference/3 for efficacy or futility. Trial-level early closure was defined by stopping frequencies >= 0.75. RESULTS A total of 12,451 simulations (54%) met early stopping criteria. Trial-level early stopping frequency was highly predictive of the published outcome (OR, 7.24; posterior probability of association, >99.99%; AUC, 0.91; P < 0.0001). Trial-level early closure was recommended for 82 trials (36%), including 62 trials (76%) which had performed frequentist interim analysis. Bayesian early stopping rules were 96% sensitive (95% CI, 91% to 98%) for detecting trials with a primary endpoint difference, and there was a high level of agreement in overall trial interpretation (Bayesian Cohen k, 0.95; 95% CrI, 0.92 to 0.99). However, Bayesian interim analysis was associated with >99.99% posterior probability of reducing patient enrollment requirements (P < 0.0001), with an estimated cumulative enrollment reduction of 20,543 patients (11%; 89 patients averaged equally over all studied trials) and an estimated cumulative cost savings of 851 million USD (3.7 million USD averaged equally over all studied trials). CONCLUSIONS AND RELEVANCE Bayesian interim analyses may improve randomized trial efficiency by reducing enrollment requirements without compromising trial interpretation. Increased utilization of Bayesian interim analysis has the potential to reduce costs of late-phase trials, reduce patient exposures to ineffective therapies, and accelerate approvals of effective therapies.

Oncology
A Bayesian Group Sequential Design for Randomized Biosimilar Clinical Trials with Adaptive Information Borrowing from Historical Data

Wen Zhang,Zhiying Pan,Ying Yuan

DOI: https://doi.org/10.1080/10543406.2022.2080700

2022-01-01

Journal of Biopharmaceutical Statistics

Abstract:At the time of developing a biosimilar, the reference product has been on market for years and thus ample data are available on its efficacy and characteristics. We develop a Bayesian adaptive design for randomized biosimilar clinical trials to leverage the rich historical data on the reference product. This design takes a group sequential approach. At each interim, we employ the elastic meta-analytic-predictive (EMAP) prior methodology to adaptively borrow information from the historical data of the reference product to make go/no-go decision based on Bayesian posterior probabilities. In addition, the randomization ratio between the test and reference arms is adaptively adjusted at the interim with the goal to balance the sample size of the two arms at the end of trials. Simulation study shows that the proposed Bayesian adaptive design can substantially reduce the sample size of the reference arm, while achieving comparable power as the traditional randomized clinical trials that ignore the historical data. We apply our design to a biosimilar trial for treating breast cancer patients.
[Psychological-psychiatric problems of mid-life (author's transl)].

T. Haenel

1981-09-08

Abstract:
Using Bayesian Statistics in Confirmatory Clinical Trials in the Regulatory Setting

Se Yoon Lee

DOI: https://doi.org/10.48550/arXiv.2311.16506

2023-12-01

Abstract:Bayesian statistics plays a pivotal role in advancing medical science by enabling healthcare companies, regulators, and stakeholders to assess the safety and efficacy of new treatments, interventions, and medical procedures. The Bayesian framework offers a unique advantage over the classical framework, especially when incorporating prior information into a new trial with quality external data, such as historical data or another source of co-data. In recent years, there has been a significant increase in regulatory submissions using Bayesian statistics due to its flexibility and ability to provide valuable insights for decision-making, addressing the modern complexity of clinical trials where frequentist trials are inadequate. For regulatory submissions, companies often need to consider the frequentist operating characteristics of the Bayesian analysis strategy, regardless of the design complexity. In particular, the focus is on the frequentist type I error rate and power for all realistic alternatives. This tutorial review aims to provide a comprehensive overview of the use of Bayesian statistics in sample size determination in the regulatory environment of clinical trials. Fundamental concepts of Bayesian sample size determination and illustrative examples are provided to serve as a valuable resource for researchers, clinicians, and statisticians seeking to develop more complex and innovative designs.

Applications
A comparison of computational algorithms for the Bayesian analysis of clinical trials

Ziming Chen,Jeffrey S Berger,Lana A Castellucci,Michael Farkouh,Ewan C Goligher,Erinn M Hade,Beverley J Hunt,Lucy Z Kornblith,Patrick R Laweler,Eric S Leifer,Elizabeth Lorenzi,Matthew D Neal,Ryan Zarychanski,Anna Heath

DOI: https://doi.org/10.1177/17407745241247334

2024-05-17

Clinical Trials

Abstract:Clinical Trials, Ahead of Print. Background:Clinical trials are increasingly using Bayesian methods for their design and analysis. Inference in Bayesian trials typically uses simulation-based approaches such as Markov Chain Monte Carlo methods. Markov Chain Monte Carlo has high computational cost and can be complex to implement. The Integrated Nested Laplace Approximations algorithm provides approximate Bayesian inference without the need for computationally complex simulations, making it more efficient than Markov Chain Monte Carlo. The practical properties of Integrated Nested Laplace Approximations compared to Markov Chain Monte Carlo have not been considered for clinical trials. Using data from a published clinical trial, we aim to investigate whether Integrated Nested Laplace Approximations is a feasible and accurate alternative to Markov Chain Monte Carlo and provide practical guidance for trialists interested in Bayesian trial design.Methods:Data from an international Bayesian multi-platform adaptive trial that compared therapeutic-dose anticoagulation with heparin to usual care in non-critically ill patients hospitalized for COVID-19 were used to fit Bayesian hierarchical generalized mixed models. Integrated Nested Laplace Approximations was compared to two Markov Chain Monte Carlo algorithms, implemented in the software JAGS and stan, using packages available in the statistical software R. Seven outcomes were analysed: organ-support free days (an ordinal outcome), five binary outcomes related to survival and length of hospital stay, and a time-to-event outcome. The posterior distributions for the treatment and sex effects and the variances for the hierarchical effects of age, site and time period were obtained. We summarized these posteriors by calculating the mean, standard deviations and the 95% equitailed credible intervals and presenting the results graphically. The computation time for each algorithm was recorded.Results:The average overlap of the 95% credible interval for the treatment and sex effects estimated using Integrated Nested Laplace Approximations was 96% and 97.6% compared with stan, respectively. The graphical posterior densities for these effects overlapped for all three algorithms. The posterior mean for the variance of the hierarchical effects of age, site and time estimated using Integrated Nested Laplace Approximations are within the 95% credible interval estimated using Markov Chain Monte Carlo but the average overlap of the credible interval is lower, 77%, 85.6% and 91.3%, respectively, for Integrated Nested Laplace Approximations compared to stan. Integrated Nested Laplace Approximations and stan were easily implemented in clear, well-established packages in R, while JAGS required the direct specification of the model. Integrated Nested Laplace Approximations was between 85 and 269 times faster than stan and 26 and 1852 times faster than JAGS.Conclusion:Integrated Nested Laplace Approximations could reduce the computational complexity of Bayesian analysis in clinical trials as it is easy to implement in R, substantially faster than Markov Chain Monte Carlo methods implemented in JAGS and stan, and provides near identical approximations to the posterior distributions for the treatment effect. Integrated Nested Laplace Approximations was less accurate when estimating the posterior distribution for the variance of hierarchical effects, particularly for the proportional odds model, and future work should determine if the Integrated Nested Laplace Approximations algorithm can be adjusted to improve this estimation.

medicine, research & experimental
Bayesian Phase II Adaptive Randomization by Jointly Modeling Time-to-event Efficacy and Binary Toxicity

Xiudong Lei,Ying Yuan,Guosheng Yin

DOI: https://doi.org/10.1007/s10985-010-9163-z

2010-01-01

Lifetime Data Analysis

Abstract:In oncology, toxicity is typically observable shortly after a chemotherapy treatment, whereas efficacy, often characterized by tumor shrinkage, is observable after a relatively long period of time. In a phase II clinical trial design, we propose a Bayesian adaptive randomization procedure that accounts for both efficacy and toxicity outcomes. We model efficacy as a time-to-event endpoint and toxicity as a binary endpoint, sharing common random effects in order to induce dependence between the bivariate outcomes. More generally, we allow the randomization probability to depend on patients’ specific covariates, such as prognostic factors. Early stopping boundaries are constructed for toxicity and futility, and a superior treatment arm is recommended at the end of the trial. Following the setup of a recent renal cancer clinical trial at M. D. Anderson Cancer Center, we conduct extensive simulation studies under various scenarios to investigate the performance of the proposed method, and compare it with available Bayesian adaptive randomization procedures.
Application of Bayesian Dynamic Linear Models to Random Allocation Clinical Trials

Albert. H. Lee III,Edward L Boone,Roy T. Sabo,Erin Donahue

DOI: https://doi.org/10.48550/arXiv.2008.00339

2020-08-02

Abstract:Random allocation models used in clinical trials aid researchers in determining which of a particular treatment provides the best results by reducing bias between groups. Often however, this determination leaves researchers battling ethical issues of providing patients with unfavorable treatments. Many methods such as Play the Winner and Randomized Play the Winner Rule have historically been utilized to determine patient allocation, however, these methods are prone to the increased assignment of unfavorable treatments. Recently a new Bayesian Method using Decreasingly Informative Priors has been proposed by \citep{sabo2014adaptive}, and later \citep{donahue2020allocation}. Yet this method can be time consuming if MCMC methods are required. We propose the use of a new method which uses Dynamic Linear Model (DLM) \citep{harrison1999bayesian} to increase allocation speed while also decreasing patient allocation samples necessary to identify the more favorable treatment. Furthermore, a sensitivity analysis is conducted on multiple parameters. Finally, a Bayes Factor is calculated to determine the proportion of unused patient budget remaining at a specified cut off and this will be used to determine decisive evidence in favor of the better treatment.

Applications
Modern Bayesian Statistics in Clinical Research

Ton J. Cleophas,Aeilko H. Zwinderman

DOI: https://doi.org/10.1007/978-3-319-92747-3

2018-01-01

Abstract:The current textbook has been written as a help to medical / health professionals and students for the study of modern Bayesian statistics, where posterior and prior odds have been replaced with posterior and prior likelihood distributions. Why may likelihood distributions better than normal distributions estimate uncertainties of statistical test results? Nobody knows for sure, and the use of likelihood distributions instead of normal distributions for the purpose has only just begun, but already everybody is trying and using them. SPSS statistical software version 25 (2017) has started to provide a combined module entitled Bayesian Statistics including almost all of the modern Bayesian tests (Bayesian t-tests, analysis of variance (anova), linear regression, crosstabs etc.). Modern Bayesian statistics is based on biological likelihoods, and may better fit clinical data than traditional tests based normal distributions do. This is the first edition to systematically imply modern Bayesian statistics in traditional clinical data analysis. This edition also demonstrates that Markov Chain Monte Carlo procedures laid out as Bayesian tests provide more robust correlation coefficients than traditional tests do. It also shows that traditional path statistics are both textually and conceptionally like Bayes theorems, and that structural equations models computed from them are the basis of multistep regressions, as used with causal Bayesian networks.
Bayesian adaptive N-of-1 trials for estimating population and individual treatment effects

S. G. Jagath Senarathne,Antony M. Overstall,James M. McGree

DOI: https://doi.org/10.48550/arXiv.1911.00878

2020-07-29

Abstract:This article proposes a novel adaptive design algorithm that can be used to find optimal treatment allocations in N-of-1 clinical trials. This new methodology uses two Laplace approximations to provide a computationally efficient estimate of population and individual random effects within a repeated measures, adaptive design framework. Given the efficiency of this approach, it is also adopted for treatment selection to target the collection of data for the precise estimation of treatment effects. To evaluate this approach, we consider both a simulated and motivating N-of-1 clinical trial from the literature. For each trial, our methods were compared to the multi-armed bandit approach and a randomised N-of-1 trial design in terms of identifying the best treatment for each patient and the information gained about the model parameters. The results show that our new approach selects designs that are highly efficient in achieving each of these objectives. As such, we propose our Laplace-based algorithm as an efficient approach for designing adaptive N-of-1 trials.

Computation,Methodology
Estimation in Parallel Randomized Experiments

David Weisburd,David B. Wilson,Alese Wooditch,Chester Britt

DOI: https://doi.org/10.3102/10769986006004377

1981-01-01

Journal of Educational Statistics

Abstract:Many studies comparing new treatments to standard treatments consist of parallel randomized experiments. In the example considered here, randomized experiments were conducted in eight schools to determine the effectiveness of special coaching programs for the SAT. The purpose here is to illustrate Bayesian and empirical Bayesian techniques that can be used to help summarize the evidence in such data about differences among treatments, thereby obtaining improved estimates of the treatment effect in each experiment, including the one having the largest observed effect. Three main tools are illustrated: 1) graphical techniques for displaying sensitivity within an empirical Bayes framework, 2) simple simulation techniques for generating Bayesian posterior distributions of individual effects and the largest effect, and 3) methods for monitoring the adequacy of the Bayesian model specification by simulating the posterior predictive distribution in hypothetical replications of the same treatments in the same eight schools.
Improving Adaptive Seamless Designs through Bayesian optimization

Jakob Richter,Tim Friede,Jörg Rahnenführer

DOI: https://doi.org/10.48550/arXiv.2105.09223

2021-05-20

Abstract:We propose to use Bayesian optimization (BO) to improve the efficiency of the design selection process in clinical trials. BO is a method to optimize expensive black-box functions, by using a regression as a surrogate to guide the search. In clinical trials, planning test procedures and sample sizes is a crucial task. A common goal is to maximize the test power, given a set of treatments, corresponding effect sizes, and a total number of samples. From a wide range of possible designs we aim to select the best one in a short time to allow quick decisions. The standard approach to simulate the power for each single design can become too time-consuming. When the number of possible designs becomes very large, either large computational resources are required or an exhaustive exploration of all possible designs takes too long. Here, we propose to use BO to quickly find a clinical trial design with high power from a large number of candidate designs. We demonstrate the effectiveness of our approach by optimizing the power of adaptive seamless designs for different sets of treatment effect sizes. Comparing BO with an exhaustive evaluation of all candidate designs shows that BO finds competitive designs in a fraction of the time.

Methodology
A Bayesian adaptive design approach for stepped-wedge cluster randomized trials

Jijia Wang,Jing Cao,Chul Ahn,Song Zhang

DOI: https://doi.org/10.1177/17407745231221438

2024-01-20

Clinical Trials

Abstract:Clinical Trials, Ahead of Print. Background:The Bayesian group sequential design has been applied widely in clinical studies, especially in Phase II and III studies. It allows early termination based on accumulating interim data. However, to date, there lacks development in its application to stepped-wedge cluster randomized trials, which are gaining popularity in pragmatic trials conducted by clinical and health care delivery researchers.Methods:We propose a Bayesian adaptive design approach for stepped-wedge cluster randomized trials, which makes adaptive decisions based on the predictive probability of declaring the intervention effective at the end of study given interim data. The Bayesian models and the algorithms for posterior inference and trial conduct are presented.Results:We present how to determine design parameters through extensive simulations to achieve desired operational characteristics. We further evaluate how various design factors, such as the number of steps, cluster size, random variability in cluster size, and correlation structures, impact trial properties, including power, type I error, and the probability of early stopping. An application example is presented.Conclusion:This study presents the incorporation of Bayesian adaptive strategies into stepped-wedge cluster randomized trials design. The proposed approach provides the flexibility to stop the trial early if substantial evidence of efficacy or futility is observed, improving the flexibility and efficiency of stepped-wedge cluster randomized trials.

medicine, research & experimental
Analysis of Bayesian posterior significance and effect size indices for the two-sample t-test to support reproducible medical research

Riko Kelter

DOI: https://doi.org/10.1186/s12874-020-00968-2

2020-04-22

BMC Medical Research Methodology

Abstract:Abstract Background The replication crisis hit the medical sciences about a decade ago, but today still most of the flaws inherent in null hypothesis significance testing (NHST) have not been solved. While the drawbacks of p -values have been detailed in endless venues, for clinical research, only a few attractive alternatives have been proposed to replace p -values and NHST. Bayesian methods are one of them, and they are gaining increasing attention in medical research, as some of their advantages include the description of model parameters in terms of probability, as well as the incorporation of prior information in contrast to the frequentist framework. While Bayesian methods are not the only remedy to the situation, there is an increasing agreement that they are an essential way to avoid common misconceptions and false interpretation of study results. The requirements necessary for applying Bayesian statistics have transitioned from detailed programming knowledge into simple point-and-click programs like JASP. Still, the multitude of Bayesian significance and effect measures which contrast the gold standard of significance in medical research, the p -value, causes a lack of agreement on which measure to report. Methods Therefore, in this paper, we conduct an extensive simulation study to compare common Bayesian significance and effect measures which can be obtained from a posterior distribution. In it, we analyse the behaviour of these measures for one of the most important statistical procedures in medical research and in particular clinical trials, the two-sample Student’s (and Welch’s) t-test. Results The results show that some measures cannot state evidence for both the null and the alternative. While the different indices behave similarly regarding increasing sample size and noise, the prior modelling influences the obtained results and extreme priors allow for cherry-picking similar to p-hacking in the frequentist paradigm. The indices behave quite differently regarding their ability to control the type I error rates and regarding their ability to detect an existing effect. Conclusion Based on the results, two of the commonly used indices can be recommended for more widespread use in clinical and biomedical research, as they improve the type I error control compared to the classic two-sample t-test and enjoy multiple other desirable properties.

health care sciences & services

Bayesian methods including nonrandomized study data increased the efficiency of postlaunch RCTs.

BASIC: A Bayesian Adaptive Synthetic-Control Design for Phase II Clinical Trials.

Bayesian Approach for Design and Analysis of Medical Device Trials in the Era of Modern Clinical Studies

Bayesian Optimal Phase II Design for Randomized Clinical Trials

Adaptive designs in public health: Vaccine and cluster randomized trials go Bayesian

Covariate adjustment in Bayesian adaptive randomized controlled trials

A Tutorial on Modern Bayesian Methods in Clinical Trials

Quinazolines. II. 2-Guanidino-4,6,7-trimethylquinazoline as a by-product in the three-component synthesis of 4,6-diamino-2,2-dimethyl-1-(3,4-xylyl)-1,2-dihydro-s-triazine-1,2.

Bayesian Interim Analysis and Efficiency of Phase III Randomized Trials

A Bayesian Group Sequential Design for Randomized Biosimilar Clinical Trials with Adaptive Information Borrowing from Historical Data

[Psychological-psychiatric problems of mid-life (author's transl)].

Using Bayesian Statistics in Confirmatory Clinical Trials in the Regulatory Setting

A comparison of computational algorithms for the Bayesian analysis of clinical trials

Bayesian Phase II Adaptive Randomization by Jointly Modeling Time-to-event Efficacy and Binary Toxicity

Application of Bayesian Dynamic Linear Models to Random Allocation Clinical Trials

Modern Bayesian Statistics in Clinical Research

Bayesian adaptive N-of-1 trials for estimating population and individual treatment effects

Estimation in Parallel Randomized Experiments

Improving Adaptive Seamless Designs through Bayesian optimization

A Bayesian adaptive design approach for stepped-wedge cluster randomized trials

Analysis of Bayesian posterior significance and effect size indices for the two-sample t-test to support reproducible medical research