Abstract:Objective To develop a new statistical method for comparing effectiveness of two treatments for the same disease indication.A statistical method needs to be developed to compare effectiveness of different treatments by using existing clinical data when lacking of evidence from randomized controlled trials.Methods Datasets including an outcome variable and a confounder for two treatments were simulated.Subjects in each dataset were randomly divided into two arms for 100 times,and the means were compared by using student-t tests and Per-protocol analysis strategy was applied.Subjects with assigned treatment by randomization that was contradictory to the actual received treatment were considered drop-out of conventional RCTs,and were excluded from comparisons of means.The ratio of the frequency of hypothesis tests that rejected H0 to the frequency of hypothesis tests that did not reject H0,called odds,was used to predict the probability of significant tests for group difference.To document the consistency and reliability of the method,the distribution of odds and its 95% CI,and the confounding effect were described in simulated datasets with various between-group mean differences and statistical power(ranging from 0.5 to 0.85) with varied sample sizes(n=50,100,500,and 1 000).Stata 11.0 was used to program and perform the analysis.Results The odds and its 95%CI of simulated RCTs were perfectly and linearly correlated with the change of between-group mean differences and statistical power,by difference sample size.A conclusion could be made based on the hypothesis of the simulated randomized controlled trials(sRCT).The probability of loss of balance of confounding was over 95% for equal and unequal sample size of two arms after excluding misclassified subjects.Conclusions The proposed novel analytical method,simulated RCTs based on real clinical treatment data,can be used to compare effectiveness of two treatments when evidence from RCTs is unavailable.

The Non-Inferiority Test in the Research of Methodology and the Experiment of Comparison

Sample size estimation and statistical inference in noninferiority/equivalence trials

Dealing with Non-inferiority Test in Multicenter Trials

The use of actual water samples for laboratory comparison between the results of evaluation and analysis

Testing two variances for superiority/non-inferiority and equivalence: Using the exhaustion algorithm for sample size allocation with cost

Comparation of Non-null Figure Error Reduction Methods in Testing Deep Aspherics with Large Errors

Pour down the pros and cons analysis of the test methods

Non-inferiority and networks: inferring efficacy from a web of data

A Direct Approach to Simultaneous Tests of Superiority and Noninferiority with Multiple Endpoints

Unconditional Exact Tests for Equivalence or Noninferiority for Paired Binary Endpoints

A Reproducibility Probability-Based Bias-Adjustment Approach on the Specification of Non-Inferiority Margin Using Historical Data

Evaluation Methods and Empirical Analysis for Non-Experimental Data

A reproducibility probability-based bias-adjustment approach on the specification of non-inferiority margin using historical data.

A Comparative Review of Methods for Comparing Means Using Partially Paired Data

A framework for testing non-inferiority in a three-arm, sequential, multiple assignment randomized trial

An improved sample size calculation method for score tests in generalized linear models

Comparing the variances of several treatments with that of a control treatment: Theory and applications

A Multiple Comparisons Procedure for Detecting Differences Between Treatments and A Control in Two-Factor Experiments

Systematic Evaluation of Non-Inferiority and Equivalence Randomized Trials of Anti-Infective Drugs

A novel statistical method for comparing effectiveness of two treatments-simulated randomized controlled trials

How to compare summary estimates of different subgroups in meta-analysis