Abstract:Structural Equation Models (SEMs) are routinely used in the analysis of empirical data by researchers from different scientific fields such as psychologists or economists. In some fields, such as in ecology, SEMs have only started recently to attract attention and thanks to dedicated software packages the use of SEMs has steadily increased. Yet, common analysis practices in such fields that might be transposed from other statistical techniques such as model acceptance or rejection based on p-value screening might be poorly fitted for SEMs especially when these models are used to confirm or reject hypotheses. In this simulation study, SEMs were fitted via two commonly used R packages: lavaan and piecewiseSEM. Five different data-generation scenarios were explored: (i) random, (ii) exact, (iii) shuffled, (iv) underspecified and (v) overspecified. In addition, sample size and model complexity were also varied to explore their impact on various global and local model fitness indices. The results showed that not one single model index should be used to decide on model fitness but rather a combination of different model fitness indices is needed. The global chi-square test for lavaan or the Fisher's C statistic for piecewiseSEM were, in isolation, poor indicators of model fitness. In addition, the simulations showed that to achieve sufficient power to detect individual effects, adequate sample sizes are required. Finally, BIC showed good capacity to select models closer to the truth especially for more complex models. I provide, based on these results, a flowchart indicating how information from different metrics may be combined to reveal model strength and weaknesses. Researchers in scientific fields with little experience in SEMs, such as in ecology, should consider and accept these limitations.

Robustness of fit indices to outliers and leverage observations in structural equation modeling.

Evaluating Fit Indices for Multivariate t-Based Structural Equation Modeling with Data Contamination

COMPARISONS BETWEEN ROBUST REGRESSION APPROACHES IN THE PRESENCE OF OUTLIERS AND HIGH LEVERAGE POINTS

Evaluation of Test Statistics for Robust Structural Equation Modeling with Nonnormal Missing Data

Robust Structural Equation Modeling with Missing Data and Auxiliary Variables

Maximum Likelihood Estimation of Structural Equation Models for Continuous Data: Standard Errors and Goodness of Fit

Are Robust Standard Errors the Best Approach for Interval Estimation With Nonnormal Data in Structural Equation Modeling?

The Effect of Latent and Error Non-Normality on Measures of Fit in Structural Equation Modeling

The sensitivity of structural equation modeling with ordinal data to underlying non-normality and observed distributional forms.

Empirical Correction to the Likelihood Ratio Statistic for Structural Equation Modeling with Many Variables

The performance of unweighted least squares and regularized unweighted least squares in estimating factor loadings in structural equation modeling

A robust adaptive-to-model enhancement test for parametric single-index models

A Robust Adaptive Modified Maximum Likelihood Estimator for the Linear Regression Model

Structural model robustness checks in PLS-SEM

A Robust Adaptive-to-model Enhancement Test for Parametric Single-Index Models

Robust Estimation of Models for Longitudinal Data with Dropouts and Outliers

How robust are Structural Equation Models to model miss-specification? A simulation study

Multilevel Analysis of Mediation, Moderation, and Nonlinear Effects in Small Samples, Using Expected a Posteriori Estimates of Factor Scores

Scale-Invariance, Equivariance and Dependency of Structural Equation Models

Adapting fit indices for Bayesian structural equation modeling: Comparison to maximum likelihood.

Equivalence Testing Based Fit Index: Standardized Root Mean Squared Residual