Abstract:Objective To develop a new statistical method for comparing effectiveness of two treatments for the same disease indication.A statistical method needs to be developed to compare effectiveness of different treatments by using existing clinical data when lacking of evidence from randomized controlled trials.Methods Datasets including an outcome variable and a confounder for two treatments were simulated.Subjects in each dataset were randomly divided into two arms for 100 times,and the means were compared by using student-t tests and Per-protocol analysis strategy was applied.Subjects with assigned treatment by randomization that was contradictory to the actual received treatment were considered drop-out of conventional RCTs,and were excluded from comparisons of means.The ratio of the frequency of hypothesis tests that rejected H0 to the frequency of hypothesis tests that did not reject H0,called odds,was used to predict the probability of significant tests for group difference.To document the consistency and reliability of the method,the distribution of odds and its 95% CI,and the confounding effect were described in simulated datasets with various between-group mean differences and statistical power(ranging from 0.5 to 0.85) with varied sample sizes(n=50,100,500,and 1 000).Stata 11.0 was used to program and perform the analysis.Results The odds and its 95%CI of simulated RCTs were perfectly and linearly correlated with the change of between-group mean differences and statistical power,by difference sample size.A conclusion could be made based on the hypothesis of the simulated randomized controlled trials(sRCT).The probability of loss of balance of confounding was over 95% for equal and unequal sample size of two arms after excluding misclassified subjects.Conclusions The proposed novel analytical method,simulated RCTs based on real clinical treatment data,can be used to compare effectiveness of two treatments when evidence from RCTs is unavailable.

Statistical Power Analysis for Comparing Means with Binary or Count Data Based on Analogous ANOVA

Power Analysis and Sample Size Planning in ANCOVA Designs

A note on extending Scheffé's modified multiple-comparison procedure to other analysis situations

A Comparative Review of Methods for Comparing Means Using Partially Paired Data

Calculating the Statistical Power of the Univariate and the Multivariate Repeated Measures Analyses of Variance for the Single Group Case Under Various Conditions

A comparison of methods for the analysis of binomial proportion data in behavioral research

Summary-statistics-based power analysis: A new and practical method to determine sample size for mixed-effects modeling.

Power Analysis Software for Educational Researchers

Simulation-Based Power-Analysis for Factorial ANOVA Designs

Simulation-Based Power Analysis for Factorial Analysis of Variance Designs

The Type Ⅰ Error and Power of the Conventional Statistic Analysis Methods in Minimization

Comparison of Type I Error and Statistical Power Between State Trace Analysis and Analysis of Variance

A tutorial on using the paired t test for power calculations in repeated measures ANOVA with interactions

Analysis of Frequency Count Data Using the Negative Binomial Distribution

Comparing Ratios of the Mean to a Power of Variance in Two Samples Via Self-Normalized Test Statistics

A Practical Approach for Comparing Means of Two Groups Without Equal Variance Assumption

A comparison of four methods for the analysis of N-of-1 trials

ISSUES IN BIOMEDICAL STATISTICS: COMPARING MEANS UNDER NORMAL DISTRIBUTION THEORY

Power and sample size calculations. A review and computer program

A novel statistical method for comparing effectiveness of two treatments-simulated randomized controlled trials

Population Power Curves in ASCA With Permutation Testing