A novel statistical method for comparing effectiveness of two treatments-simulated randomized controlled trials

Weili Yan,Shaoke Chen,Yi Cheng,Chongfan Zhang
DOI: https://doi.org/10.3969/j.issn.1673-5501.2013.01.003
2013-01-01
Abstract:Objective To develop a new statistical method for comparing effectiveness of two treatments for the same disease indication.A statistical method needs to be developed to compare effectiveness of different treatments by using existing clinical data when lacking of evidence from randomized controlled trials.Methods Datasets including an outcome variable and a confounder for two treatments were simulated.Subjects in each dataset were randomly divided into two arms for 100 times,and the means were compared by using student-t tests and Per-protocol analysis strategy was applied.Subjects with assigned treatment by randomization that was contradictory to the actual received treatment were considered drop-out of conventional RCTs,and were excluded from comparisons of means.The ratio of the frequency of hypothesis tests that rejected H0 to the frequency of hypothesis tests that did not reject H0,called odds,was used to predict the probability of significant tests for group difference.To document the consistency and reliability of the method,the distribution of odds and its 95% CI,and the confounding effect were described in simulated datasets with various between-group mean differences and statistical power(ranging from 0.5 to 0.85) with varied sample sizes(n=50,100,500,and 1 000).Stata 11.0 was used to program and perform the analysis.Results The odds and its 95%CI of simulated RCTs were perfectly and linearly correlated with the change of between-group mean differences and statistical power,by difference sample size.A conclusion could be made based on the hypothesis of the simulated randomized controlled trials(sRCT).The probability of loss of balance of confounding was over 95% for equal and unequal sample size of two arms after excluding misclassified subjects.Conclusions The proposed novel analytical method,simulated RCTs based on real clinical treatment data,can be used to compare effectiveness of two treatments when evidence from RCTs is unavailable.
What problem does this paper attempt to address?