Abstract:In this study, we investigate how Wilks’ lambda, Pillai’s trace, Hotelling’s trace, and Roy’s largest root test statistics can be affected when the normal and homogeneous variance assumptions of the MANOVA method are violated. In other words, in these cases, the robustness of the tests is examined. For this purpose, a simulation study is conducted in different scenarios. In different variable numbers and different sample sizes, considering the group variances are homogeneous σ 12 = σ 22 = ⋯ = σ g 2 and heterogeneous (increasing) σ 12 < σ 22 < ⋯ < σ g 2 , random numbers are generated from Gamma(4-4-4; 0.5), Gamma(4-9-36; 0.5), Student’s t (2), and Normal(0; 1) distributions. Furthermore, the number of observations in the groups being balanced and unbalanced is also taken into account. After 10000 repetitions, type-I error values are calculated for each test for α = 0.05. In the Gamma distribution, Pillai’s trace test statistic gives more robust results in the case of homogeneous and heterogeneous variances for 2 variables, and in the case of 3 variables, Roy’s largest root test statistic gives more robust results in balanced samples and Pillai’s trace test statistic in unbalanced samples. In Student’s t distribution, Pillai’s trace test statistic gives more robust results in the case of homogeneous variance and Wilks’ lambda test statistic in the case of heterogeneous variance. In the normal distribution, in the case of homogeneous variance for 2 variables, Roy’s largest root test statistic gives relatively more robust results and Wilks’ lambda test statistic for 3 variables. Also in the case of heterogeneous variance for 2 and 3 variables, Roy’s largest root test statistic gives robust results in the normal distribution. The test statistics used with MANOVA are affected by the violation of homogeneity of covariance matrices and normality assumptions particularly from unbalanced number of observations.

Type I Error Rate and Power of Three Normality Tests

A power comparison of various normality tests

Power analysis of several normality tests: A Monte Carlo simulation study

Comparison of Test Statistics of Nonnormal and Unbalanced Samples for Multivariate Analysis of Variance in terms of Type-I Error Rates

Comparative evaluation of goodness of fit tests for normal distribution using simulation and empirical data

Efficient three-stage $t$-tests

Detection of Non-Normality in Data Sets and Comparison between Different Normality Tests

More about the basic assumptions of t-test: normality and sample size

Impact of Sample Size and Variability on the Power and Type I Error Rates of Equivalence Tests: A Simulation Study.

Some p-variate adaptations of the shapiro-wilk test of normality

Comparison of Normality Tests in Terms of Sample Sizes under Different Skewness and Kurtosis Coefficients

Sensitivity and specificity of normality tests and consequences on reference interval accuracy at small sample size: a computer-simulation study

Are the tests overpowered or underpowered? A unified solution to correctly specify type I errors in design of clinical trials for two sample proportions

Efficiency Comparison of the Statistical Tests for Multivariate Normal Distribution

Comparing type 1 and type 2 error rates of different tests for heterogeneous treatment effects

Testing experimental data for univariate normality

What should be the measure of conformity to normal distribution (normality) test in Likert type digital and face-to-face survey data?

Comparing Ratios of the Mean to a Power of Variance in Two Samples Via Self-Normalized Test Statistics

Normality and significance testing in simple linear regression model for large sample sizes: a simulation study

Comparison of selected tests for univariate normality based on measures of moments

On testing the skew normal distribution by using Shapiro–Wilk test