SEMinR: Domain-Specific Language for Building, Estimating, and Visualizing Structural Equation Models in R

Soumya Ray,Nicholas Danks,André Calero Valdez

DOI: https://doi.org/10.2139/ssrn.3900621

2021-01-01

SSRN Electronic Journal

Abstract:Download This Paper Open PDF in Browser Add Paper to My Library Share: Permalink Using these links will ensure access to this page indefinitely Copy URL Copy DOI

What problem does this paper attempt to address?

The SEMinR Package

Joseph F. Hair,G. Tomas M. Hult,Christian M. Ringle,Marko Sarstedt,Nicholas P. Danks,Soumya Ray

DOI: https://doi.org/10.1007/978-3-030-80519-7_3

2021-01-01

Abstract:AbstractSEMinR is a software package developed for the R statistical environment (R Core Team, 2021). The package includes a user-friendly syntax for creating and estimating structural equation models using estimators such as partial least squares. In this chapter, we introduce the syntax to create, estimate, and report structural equation models using SEMinR. We demonstrate the four steps to specifying and estimating a structural equation model: (1) loading and cleaning the data, (2) specifying the measurement models, (3) specifying the structural model, and (4) estimating, bootstrapping, and summarizing the model. This chapter also describes how to export results and figures from R for professional, publication-quality reporting.
Structural Equation Modeling in HCI Research Using SEMinR.

André Calero Valdez,Lilian Kojan,Nicholas Patrick Danks,Soumya Ray

DOI: https://doi.org/10.1145/3544549.3574171

2023-01-01

Abstract:Structural equation models (SEMs) are statistical techniques that help to identify models of latent variables in survey data. This allows researchers to test both the quality of the measurement instrument—the survey—as well as the hypothesized relationships using a single model. Partial least squares structural equation modeling (PLS-SEM) is a subset of SEM that works well with small sample sizes and non-parametric data, which frequently occur in HCI research. In this course, we will provide a short introduction into SEMinR, an open-source library for the R language. SEMinR is an easy-to-use domain-specific language for defining, estimating, visualizing, and validating SEMs using the PLS method. SEMinR provides means for scientific reporting and can be used by academics and practitioners alike.
Structural Equation Modeling in the Context of Clinical Research

Zhongheng Zhang

DOI: https://doi.org/10.21037/atm.2016.09.25

IF: 3.616

2017-01-01

Annals of Translational Medicine

Abstract:Structural equation modeling (SEM) has been widely used in economics, sociology and behavioral science. However, its use in clinical medicine is quite limited, probably due to technical difficulties. Because SEM is particularly suitable for analysis of complex relationships among observed variables, it must have potential applications to clinical medicine. The article introduces basic ideas of SEM in the context of clinical medicine. A simulated dataset is employed to show how to do model specification, model fit, visualization and assessment of goodness-of-fit. The first example fits a SEM with continuous outcome variable using sem() function, and the second explores the binary outcome variable using lavaan() function.
Learning bayesian networks using domain knowledge: An empirical study

Kui Yu,Hao Wang,Min Yao

2008-01-01

Journal of Computational Information Systems

Abstract:Learning a Bayesian Network structure is still a challenging task in data mining. The Structural EM algorithm (SEM) can deal with the structure with missing data or hidden variables, but it usually performs poorly without prior knowledge. This paper presents an empirical study of domain knowledge impact on the SEM algorithm which indicates that with missing data, domain knowledge can provide great help in leaning Bayesian Networks, especially when there is rarely enough training data. Based on these observations, a KL-SEM (SEM algorithm with domain knowledge) algorithm is proposed, which incorporates domain knowledge into SEM. KL-SEM chooses a good prior network structure and the improved S_M step searches for the network structure directed by domain knowledge. Our experimental results show that KL-SEM not only enables accurate learning of the network structures, but also reduces the search space of the network. © 2008 Binary Information Press.
Structural Equation Modeling Using R/SAS: A Step-by-Step Approach with Real Data Analysis

Lifeng Lin

DOI: https://doi.org/10.1080/01621459.2024.2309339

IF: 4.369

2024-02-23

Journal of the American Statistical Association

Abstract:Structural equation modeling (SEM) is a comprehensive collection of methods for exploring relationships among observed and latent variables, and it has broad applications in various fields such as psychology, sociology, epidemiology, marketing, and business. In their recent book titled Structural Equation Modeling Using R/SAS: A Step-by-Step Approach with Real Data Analysis , Dr. Ding-Geng Chen and Dr. Yiu-Fai Yung provide a nice guide covering many topics on SEM and their applications. This book introduces statistical rationale and fundamental methods for SEM; more importantly, it showcases the methods using many real-world examples and focuses on their implementations with both the R and SAS software. As introduced in this book's preface, the literature has many books on SEMs, but most of them require a high level of mathematical background or depend on software packages that are expensive and not very accessible to researchers who need SEM tools. This book's practical approach with popular and accessible software tools like R and SAS is a significant advantage. With this feature, I think this book provides an excellent tool for a broad spectrum of readers, from beginners to those seeking advanced knowledge in SEM.

statistics & probability
Using SymPy (Symbolic Python) for Understanding Structural Equation Modeling

Joel S. Steele,Kevin J. Grimm

DOI: https://doi.org/10.1080/10705511.2024.2325122

2024-03-29

Structural Equation Modeling

Abstract:Structural Equation Modeling (SEM) continues to grow in popularity with numerous articles, books, courses, and workshops available to help researchers become proficient with SEM quickly. However, few resources are available to help users gain a deep understanding of the analytic steps involved in SEM, with even fewer providing reproducible syntax for those learning the technique. This work builds off of the original work by Ferron and Hess to provide computer syntax, written in python, for the specification, estimation, and numerical optimization steps necessary for SEM. The goal is to provide readers with many of the numerical and analytic details of SEM that may not be regularly taught in workshops and courses. This work extends the original demonstration by Ferron and Hess to incorporate the reticular action model notation for specification as well as the estimation of variable means. All of the code listed is provided in the appendix.
Estimating statistical power for structural equation models in developmental cognitive science: A tutorial in R

Elisa S. Buchberger,Chi T. Ngo,Aaron Peikert,Andreas M. Brandmaier,Markus Werkle-Bergner

DOI: https://doi.org/10.3758/s13428-024-02396-2

IF: 5.953

2024-05-30

Behavior Research Methods

Abstract:Determining the compositional structure and dimensionality of psychological constructs lies at the heart of many research questions in developmental science. Structural equation modeling (SEM) provides a versatile framework for formalizing and estimating the relationships among multiple latent constructs. While the flexibility of SEM can accommodate many complex assumptions on the underlying structure of psychological constructs, it makes a priori estimation of statistical power and required sample size challenging. This difficulty is magnified when comparing non-nested SEMs, which prevents the use of traditional likelihood-ratio tests. Sample size estimates for SEM model fit comparisons typically rely on generic rules of thumb. Such heuristics can be misleading because statistical power in SEM depends on a variety of model properties. Here, we demonstrate a Monte Carlo simulation approach for estimating a priori statistical power for model selection when comparing non-nested models in an SEM framework. We provide a step-by-step guide to this approach based on an example from our memory development research in children.

psychology, mathematical, experimental
Structural Equation Models as Computation Graphs

Erik-Jan van Kesteren,Daniel L. Oberski

DOI: https://doi.org/10.48550/arXiv.1905.04492

2019-10-10

Abstract:Structural equation modeling (SEM) is a popular tool in the social and behavioural sciences, where it is being applied to ever more complex data types. The high-dimensional data produced by modern sensors, brain images, or (epi)genetic measurements require variable selection using parameter penalization; experimental models combining disparate data sources benefit from regularization to obtain a stable result; and genomic SEM or network models lead to alternative objective functions. With each proposed extension, researchers currently have to completely reformulate SEM and its optimization algorithm -- a challenging and time-consuming task. In this paper, we consider each SEM as a computation graph, a flexible method of specifying objective functions borrowed from the field of deep learning. When combined with state-of-the-art optimizers, our computation graph approach can extend SEM without the need for bespoke software development. We show that both existing and novel SEM improvements follow naturally from our approach. To demonstrate, we discuss least absolute deviation estimation and penalized regression models. We also introduce spike-and-slab SEM, which may perform better when shrinkage of large factor loadings is not desired. By applying computation graphs to SEM, we hope to greatly accelerate the process of developing SEM techniques, paving the way for new applications. We provide an accompanying R package tensorsem.

Methodology,Computation
A Tutorial for Analyzing Structural Equation Modelling

Hashem Salarzadeh Jenatabadi

DOI: https://doi.org/10.48550/arXiv.1504.03430

2015-04-14

Abstract:This paper provides a tutorial discussion on analyzing structural equation modelling (SEM). SEM can be regarded as regression models with observed and unobserved indicators, have been extensively applied to practical and fundamental studies. We deliver an introduction to SEM method and a detailed description of how to deal with analyzing the data with this kind of modelling. The intended audience is statisticians/mathematicians/methodologists who either know about SEM or simple basic statistics especially in regression and linear/nonlinear modeling, and Ph.D. students in statistics, mathematics, management, psychology, and even computer science.

Methodology
An Open-source WYSIWYG Web Application for Drawing Path Diagrams of Structural Equation Models

Yujiao Mai,Ziqian Xu,Zhiyong Zhang,Ke-Hai Yuan

DOI: https://doi.org/10.1080/10705511.2022.2101460

2022-08-19

Structural Equation Modeling

Abstract:Structural equation modeling (SEM) is widely used in behavioral, social, and education research. Drawing publication-ready path diagrams for SEM is not a pleasant task with the existing software. The article introduces an open-source web-based graphical application, semdiag , for drawing WYSIWYG SEM path diagrams interactively. The application is an on-going project developed by the authors using JavaScript, and it can be used in major web browsers, both online and offline. Several examples are provided to demonstrate how to use the application.
SEM with simplicity and accuracy

Peter M Bentler

DOI: https://doi.org/10.1016/j.jcps.2010.03.002

Abstract:Professor Iacobucci has provided a useful introduction to the computer program LISREL, as well as to several technical topics in structural equation modeling (SEM). However, SEM has not been synonymous with LISREL for several decades, and focusing on LISREL's 13 Greek matrices and vectors is not the most intuitive way to learn SEM. It is possible today to do model specification via a path diagram without any need for filling in matrix elements. The simplest alternative is based on the Bentler-Weeks model, whose basic concepts are reviewed. Selected additional SEM topics are discussed, including some recent developments and their practical implications. New simulation results on model fit under null and alternative hypotheses are also presented that are consistent with statistical theory but in part seem to contradict those reported by Iacobucci.
regsem: Regularized Structural Equation Modeling

Ross Jacobucci

DOI: https://doi.org/10.48550/arXiv.1703.08489

2017-09-08

Abstract:The regsem package in R, an implementation of regularized structural equation modeling (RegSEM; Jacobucci, Grimm, and McArdle 2016), was recently developed with the goal of incorporating various forms of penalized likelihood estimation in a broad array of structural equations models. The forms of regularization include both the ridge (Hoerl and Kennard 1970) and the least absolute shrinkage and selection operator (lasso; Tibshirani 1996), along with sparser extensions. RegSEM is particularly useful for structural equation models that have a small parameter to sample size ratio, as the addition of penalties can reduce the complexity, thus reducing the bias of the parameter estimates. The paper covers the algorithmic details and an overview of the use of regsem with the application of both factor analysis and latent growth curve models.

Methodology
Robust Structural Equation Modeling with Missing Data and Auxiliary Variables

Ke-Hai Yuan,Zhiyong Zhang

DOI: https://doi.org/10.1007/s11336-012-9282-4

2012-01-01

Psychometrika

Abstract:The paper develops a two-stage robust procedure for structural equation modeling (SEM) and an R package rsem to facilitate the use of the procedure by applied researchers. In the first stage, M-estimates of the saturated mean vector and covariance matrix of all variables are obtained. Those corresponding to the substantive variables are then fitted to the structural model in the second stage. A sandwich-type covariance matrix is used to obtain consistent standard errors (SE) of the structural parameter estimates. Rescaled, adjusted as well as corrected and F-statistics are proposed for overall model evaluation. Using R and EQS, the R package rsem combines the two stages and generates all the test statistics and consistent SEs. Following the robust analysis, multiple model fit indices and standardized solutions are provided in the corresponding output of EQS. An example with open/closed book examination data illustrates the proper use of the package. The method is further applied to the analysis of a data set from the National Longitudinal Survey of Youth 1997 cohort, and results show that the developed procedure not only gives a better endorsement of the substantive models but also yields estimates with uniformly smaller standard errors than the normal-distribution-based maximum likelihood.
When and how to use set‐exploratory structural equation modelling to test structural models: A tutorial using the R package lavaan

Herb Marsh,Abdullah Alamer

DOI: https://doi.org/10.1111/bmsp.12336

2024-02-17

British Journal of Mathematical and Statistical Psychology

Abstract:Exploratory structural equation modelling (ESEM) is an alternative to the well‐known method of confirmatory factor analysis (CFA). ESEM is mainly used to assess the quality of measurement models of common factors but can be efficiently extended to test structural models. However, ESEM may not be the best option in some model specifications, especially when structural models are involved, because the full flexibility of ESEM could result in technical difficulties in model estimation. Thus, set‐ESEM was developed to accommodate the balance between full‐ESEM and CFA. In the present paper, we show examples where set‐ESEM should be used rather than full‐ESEM. Rather than relying on a simulation study, we provide two applied examples using real data that are included in the OSF repository. Additionally, we provide the code needed to run set‐ESEM in the free R package lavaan to make the paper practical. Set‐ESEM structural models outperform their CFA‐based counterparts in terms of goodness of fit and realistic factor correlation, and hence path coefficients in the two empirical examples. In several instances, effects that were non‐significant (i.e., attenuated) in the CFA‐based structural model become larger and significant in the set‐ESEM structural model, suggesting that set‐ESEM models may generate more accurate model parameters and, hence, lower Type II error rate.

psychology, experimental, mathematical,mathematics, interdisciplinary applications,statistics & probability
Structural Equation Modeling Diagnostics Using R Package semdiag and EQS

kehai yuan,zhiyong zhang

DOI: https://doi.org/10.1080/10705511.2012.713282

2012-01-01

Abstract:Yuan and Hayashi (2010) introduced 2 scatter plots for model and data diagnostics in structural equation modeling (SEM). However, the generation of the plots requires in-depth understanding of their underlying technical details. This article develops and introduces an R package semdiag for easily drawing the 2 plots. With a model specified in EQS syntax, one only needs to supply as few as 2 parameters to generate the 2 plots using the semdiag package. Two examples are provided to illustrate the use of the package. Multiple figures are used to explain the elements of data and model diagnostics. Advice on selecting proper estimation methods following the diagnostics is also given.
The application of structural equation model approach in epidemiological research]

Ting-zhong Yang,Ha-jian Ruan,Fu-zhong Li

DOI: https://doi.org/10.3760/j.issn:0254-6450.2005.04.017

2005-01-01

Abstract:To discuss application of structural equation model (SEM) approach in epidemiological research.A brief overview on major components of SEM, statistical assumptions underlying the use of SEM, and current software available to users and how SEM can be used were discussed through a practical epidemiological research project.Advantages of SEM comparing with conventional epidemiological approach were shown. SEM, having the nature of comprehensive thinking and analytic approach, not only exploring the association between factors and diseases but also among factors. It also served a confirmatory, rather than exploratory approach on data modeling, as well as having the capability of correcting estimates by separating measurement error from the equations, to provide modeling the latent variables.SEM approach could be used in epidemiological research as having some advantages comparing with conventional epidemiological approaches.
Beyond ANOVA: An Introduction to Structural Equation Models for Experimental Designs

Heiko Breitsohl

DOI: https://doi.org/10.1177/1094428118754988

IF: 8.247

2018-02-04

Organizational Research Methods

Abstract:Structural equation modeling (SEM) can offer useful features to researchers conducting experiments. Yet most researchers appear not to apply such models when analyzing their data, relying instead on more restrictive (and sometimes inappropriate) approaches, such as analysis of variance (ANOVA). This paper is aimed at introducing experimentalists to the modeling options available in SEM. I compare and contrast ANOVA with two SEM-based approaches, addressing general attributes; specific features, such as the relation to confirmatory factor analysis; and assumptions imposed under each approach. A corresponding decision tree offers additional guidance for selecting between approaches. I then describe a general procedure for building and testing models under the two SEM-based approaches, ranging from preparatory decisions to checking assumptions, to obtaining estimates and conducting hypothesis tests. In addition, I discuss options for latent variable scaling, reporting effect sizes disattenuated from measurement error, incorporating manipulation checks, and adjusting inferences for Type I error inflation. Finally, I offer an example based on a real study (with annotated code for Mplus and R), taking readers though the modeling process and illustrating some implications of modeling choices.

management,psychology, applied
Small Sample Solutions for Structural Equation Modeling

Yves Rosseel

DOI: https://doi.org/10.4324/9780429273872-19

2020-02-13

Abstract:Structural equation modeling (SEM) is a widely used statistical technique for studying relationships in multivariate data. Unfortunately, when the sample size is small, several problems may arise. Some problems relate to point estimation, whereas other problems relate to small sample inference. This chapter contains several potential solutions for point estimation, including penalized likelihood estimation, a method based on model-implied instrumental variables, two-step estimation, and factor score regression. This chapter also contains a brief discussion of inference, including several corrections for the chi-square test statistic, local fit statistics, and some suggestions to improve the quality of standard errors and confidence intervals.
Efficient Bayesian Structural Equation Modeling in Stan

Edgar C. Merkle,Ellen Fitzsimmons,James Uanhoro,Ben Goodrich

DOI: https://doi.org/10.18637/jss.v100.i06

IF: 6.992

2021-01-01

Journal of Statistical Software

Abstract:Structural equation models comprise a large class of popular statistical models, including factor analysis models, certain mixed models, and extensions thereof. Model estimation is complicated by the fact that we typically have multiple interdependent response variables and multiple latent variables (which may also be called random effects or hidden variables), often leading to slow and inefficient posterior sampling. In this paper, we describe and illustrate a general, efficient approach to Bayesian SEM estimation in Stan, contrasting it with previous implementations in R package blavaan (Merkle and Rosseel 2018). After describing the approaches in detail, we conduct a practical comparison under multiple scenarios. The comparisons show that the new approach is clearly better. We also discuss ways that the approach may be extended to other models that are of interest to psychometricians.

computer science, interdisciplinary applications,statistics & probability
A model selection approach to structural equation modelling: A critical evaluation and a road map for ecologists

Mario Garrido,Scott K. Hansen,Rami Yaari,Hadas Hawlena

DOI: https://doi.org/10.1111/2041-210x.13742

2021-11-06

Methods in Ecology and Evolution

Abstract:Structural equation modelling (SEM) can illuminate complex interaction networks of the sort found in ecology. However, selecting optimally complex, data‐supported SEM models and quantifying their uncertainty are difficult processes. To this end, we recommend a formal model selection approach (MSA) that uses information criteria. Using a suite of numerical simulations, we compare MSA‐SEM against two traditional methods. We find that MSA‐SEM exhibits superior, unbiased results under the suboptimal realistic conditions characteristic of ecological studies. We then provide a road map for MSA‐SEM and demonstrate its use via a case study. We illustrate the unique abilities of SEM to confirm a network structure within the realm of known causal pathways and delineate the boundaries within which MSA‐SEM should be applied.

SEMinR: Domain-Specific Language for Building, Estimating, and Visualizing Structural Equation Models in R

The SEMinR Package

Structural Equation Modeling in HCI Research Using SEMinR.

Structural Equation Modeling in the Context of Clinical Research

Learning bayesian networks using domain knowledge: An empirical study

Structural Equation Modeling Using R/SAS: A Step-by-Step Approach with Real Data Analysis

Using SymPy (Symbolic Python) for Understanding Structural Equation Modeling

Estimating statistical power for structural equation models in developmental cognitive science: A tutorial in R

Structural Equation Models as Computation Graphs

A Tutorial for Analyzing Structural Equation Modelling

An Open-source WYSIWYG Web Application for Drawing Path Diagrams of Structural Equation Models

SEM with simplicity and accuracy

regsem: Regularized Structural Equation Modeling

Robust Structural Equation Modeling with Missing Data and Auxiliary Variables

When and how to use set‐exploratory structural equation modelling to test structural models: A tutorial using the R package lavaan

Structural Equation Modeling Diagnostics Using R Package semdiag and EQS

The application of structural equation model approach in epidemiological research]

Beyond ANOVA: An Introduction to Structural Equation Models for Experimental Designs

Small Sample Solutions for Structural Equation Modeling

Efficient Bayesian Structural Equation Modeling in Stan

A model selection approach to structural equation modelling: A critical evaluation and a road map for ecologists