Abstract:Numerical data that are normally distributed can be analyzed with parametric tests, that is, tests which are based on the parameters that define a normal distribution curve. If the distribution is uncertain, the data can be plotted as a normal probability plot and visually inspected, or tested for normality using one of a number of goodness of fit tests, such as the Kolmogorov-Smirnov test. The widely used Student's t-test has three variants. The one-sample t-test is used to assess if a sample mean (as an estimate of the population mean) differs significantly from a given population mean. The means of two independent samples may be compared for a statistically significant difference by the unpaired or independent samples t-test. If the data sets are related in some way, their means may be compared by the paired or dependent samples t-test. The t-test should not be used to compare the means of more than two groups. Although it is possible to compare groups in pairs, when there are more than two groups, this will increase the probability of a Type I error. The one-way analysis of variance (ANOVA) is employed to compare the means of three or more independent data sets that are normally distributed. Multiple measurements from the same set of subjects cannot be treated as separate, unrelated data sets. Comparison of means in such a situation requires repeated measures ANOVA. It is to be noted that while a multiple group comparison test such as ANOVA can point to a significant difference, it does not identify exactly between which two groups the difference lies. To do this, multiple group comparison needs to be followed up by an appropriate post hoc test. An example is the Tukey's honestly significant difference test following ANOVA. If the assumptions for parametric tests are not met, there are nonparametric alternatives for comparing data sets. These include Mann-Whitney U-test as the nonparametric counterpart of the unpaired Student's t-test, Wilcoxon signed-rank test as the counterpart of the paired Student's t-test, Kruskal-Wallis test as the nonparametric equivalent of ANOVA and the Friedman's test as the counterpart of repeated measures ANOVA.

ISSUES IN BIOMEDICAL STATISTICS: COMPARING MEANS UNDER NORMAL DISTRIBUTION THEORY

Biostatistics series module 3: Comparing groups: Numerical variables

Comparing Ratios of the Mean to a Power of Variance in Two Samples Via Self-Normalized Test Statistics

More about the basic assumptions of t-test: normality and sample size

A Note on Sample Size Calculation for Mean Comparisons Based on Noncentral T-Statistics.

Testing normality using the summary statistics with application to meta-analysis

A power comparison of various normality tests

Statistical tests for homogeneity of variance for clinical trials and recommendations

A Comparative Review of Methods for Comparing Means Using Partially Paired Data

The effects of violations of assumptions underlying the t test.

Introduction to biostatistics: Part 4, statistical inference techniques in hypothesis testing

T test as a parametric statistic

The New and Improved Two-Sample t Test

On Testing the Mean Equivalence of Treatments from Correlated Normal Populations

Parametric versus non-parametric statistics in the analysis of randomized trials with non-normally distributed data

Statistical methods for medical studies

t-tests, non-parametric tests, and large studies—a paradox of statistical practice?

Normality and significance testing in simple linear regression model for large sample sizes: a simulation study

Hypothesis Test to Compare Two Paired Binomial Proportions: Assessment of 24 Methods

Power analysis of several normality tests: A Monte Carlo simulation study

Finite sample t-tests for high-dimensional means