Abstract:Objective To develop a new statistical method for comparing effectiveness of two treatments for the same disease indication.A statistical method needs to be developed to compare effectiveness of different treatments by using existing clinical data when lacking of evidence from randomized controlled trials.Methods Datasets including an outcome variable and a confounder for two treatments were simulated.Subjects in each dataset were randomly divided into two arms for 100 times,and the means were compared by using student-t tests and Per-protocol analysis strategy was applied.Subjects with assigned treatment by randomization that was contradictory to the actual received treatment were considered drop-out of conventional RCTs,and were excluded from comparisons of means.The ratio of the frequency of hypothesis tests that rejected H0 to the frequency of hypothesis tests that did not reject H0,called odds,was used to predict the probability of significant tests for group difference.To document the consistency and reliability of the method,the distribution of odds and its 95% CI,and the confounding effect were described in simulated datasets with various between-group mean differences and statistical power(ranging from 0.5 to 0.85) with varied sample sizes(n=50,100,500,and 1 000).Stata 11.0 was used to program and perform the analysis.Results The odds and its 95%CI of simulated RCTs were perfectly and linearly correlated with the change of between-group mean differences and statistical power,by difference sample size.A conclusion could be made based on the hypothesis of the simulated randomized controlled trials(sRCT).The probability of loss of balance of confounding was over 95% for equal and unequal sample size of two arms after excluding misclassified subjects.Conclusions The proposed novel analytical method,simulated RCTs based on real clinical treatment data,can be used to compare effectiveness of two treatments when evidence from RCTs is unavailable.

A Comparative Review of Methods for Comparing Means Using Partially Paired Data

Exact Tests for Comparing Two Paired Proportions with Incomplete Data

Optimal Weighted Two-Sample T-Test with Partially Paired Data in a Unified Framework

Weighted Mean Difference Statistics for Paired Data in Presence of Missing Values

Mistaken identities lead to missed opportunities: Testing for mean differences in partially matched data

Testing the equality of response rate functions for paired binary data with multiple groups

Comparison of Correlated Proportions Based on Paired Binary Data from Clustered Samples

Accurate Mean Comparisons for Paired Samples with Missing Data: an Application to a Smoking‐cessation Trial

Hypothesis Test to Compare Two Paired Binomial Proportions: Assessment of 24 Methods

Assessing Non-Inferiority for Incomplete Paired-Data under Non-Ignorable Missing Mechanism

Homogeneity Test Of Difference Between Two Correlated Proportions In Stratified Matched-Pair Studies

A Comparative Study of Matched Pair Designs with Two Binary Endpoints

Models for Paired Comparison Data: A Review with Emphasis on Dependent Data

Statistical Analysis of Noninferiority Trials with a Rate Ratio in Small-Sample Matched-Pair Designs.

New Non-parametric Tests for Multivariate Paired Data

Comparison of paired ordinal data with mis-classification and covariates adjustment

Tests for equivalence based on odds ratio for matched-pair design

The power of a paired t-test with a covariate

A novel statistical method for comparing effectiveness of two treatments-simulated randomized controlled trials

On the Statistical Testing Methods for Single Laboratory Validation of Qualitative Microbiological Assays with a Paired Design

Comparing three groups