Abstract:In this study, we investigate how Wilks’ lambda, Pillai’s trace, Hotelling’s trace, and Roy’s largest root test statistics can be affected when the normal and homogeneous variance assumptions of the MANOVA method are violated. In other words, in these cases, the robustness of the tests is examined. For this purpose, a simulation study is conducted in different scenarios. In different variable numbers and different sample sizes, considering the group variances are homogeneous σ 12 = σ 22 = ⋯ = σ g 2 and heterogeneous (increasing) σ 12 < σ 22 < ⋯ < σ g 2 , random numbers are generated from Gamma(4-4-4; 0.5), Gamma(4-9-36; 0.5), Student’s t (2), and Normal(0; 1) distributions. Furthermore, the number of observations in the groups being balanced and unbalanced is also taken into account. After 10000 repetitions, type-I error values are calculated for each test for α = 0.05. In the Gamma distribution, Pillai’s trace test statistic gives more robust results in the case of homogeneous and heterogeneous variances for 2 variables, and in the case of 3 variables, Roy’s largest root test statistic gives more robust results in balanced samples and Pillai’s trace test statistic in unbalanced samples. In Student’s t distribution, Pillai’s trace test statistic gives more robust results in the case of homogeneous variance and Wilks’ lambda test statistic in the case of heterogeneous variance. In the normal distribution, in the case of homogeneous variance for 2 variables, Roy’s largest root test statistic gives relatively more robust results and Wilks’ lambda test statistic for 3 variables. Also in the case of heterogeneous variance for 2 and 3 variables, Roy’s largest root test statistic gives robust results in the normal distribution. The test statistics used with MANOVA are affected by the violation of homogeneity of covariance matrices and normality assumptions particularly from unbalanced number of observations.

Some p-variate adaptations of the shapiro-wilk test of normality

Shapiro-Wilk test for multivariate skew-normality

Shapiro–Wilk test for skew normal distributions based on data transformations

A hypothesis test for independence of sets of variates in high dimensions

On testing the skew normal distribution by using Shapiro–Wilk test

A power comparison of various normality tests

Power analysis of several normality tests: A Monte Carlo simulation study

Shapiro–Wilk-type test of normality under nuisance regression and scale

Shrinkage-based regularization tests for high-dimensional data with application to gene set analysis

Comparison of Test Statistics of Nonnormal and Unbalanced Samples for Multivariate Analysis of Variance in terms of Type-I Error Rates

Testing for Structural Breaks – A New Self-Normalization Approach Based on the Adjusted Sample Range

Omnibus tests of multinormality based on skewness and kurtosis

Testing multivariate normality by testing independence

Sensitivity and specificity of normality tests and consequences on reference interval accuracy at small sample size: a computer-simulation study

Testing experimental data for univariate normality

Detection of Non-Normality in Data Sets and Comparison between Different Normality Tests

Comparing Ratios of the Mean to a Power of Variance in Two Samples Via Self-Normalized Test Statistics

Type I Error Rate and Power of Three Normality Tests

Towards a theory for testing statistical hypothesis: Multivariate mean with nuisance covariance matrix

Asymptotic Normality and Efficiency of Certain Nonparametric Test Statistics

Comparative evaluation of goodness of fit tests for normal distribution using simulation and empirical data