Abstract:The unconstrained product indicator (PI) approach is a simple and popular approach for modeling nonlinear effects among latent variables. This approach leaves the practitioner to choose the PIs to be included in the model, introducing arbitrariness into the modeling. In contrast to previous Monte Carlo studies, we evaluated the PI approach by 3 post hoc analyses applied to a real-world case adopted from a research effort in social psychology. The measurement design applied 3 and 4 indicators for the 2 latent 1st-order variables, leaving the researcher with a choice among more than 4,000 possible PI configurations. Sixty so-called matched-pair configurations that have been recommended in previous literature are of special interest. In the 1st post hoc analysis we estimated the interaction effect for all PI configurations, keeping the real-world sample fixed. The estimated interaction effect was substantially affected by the choice of PIs, also across matched-pair configurations. Subsequently, a post hoc Monte Carlo study was conducted, with varying sample sizes and data distributions. Convergence, bias, Type I error and power of the interaction test were investigated for each matched-pair configuration and the all-pairs configuration. Variation in estimates across matched-pair configurations for a typical sample was substantial. The choice of specific configuration significantly affected convergence and the interaction test's outcome. The all-pairs configuration performed overall better than the matched-pair configurations. A further advantage of the all-pairs over the matched-pairs approach is its unambiguity. The final study evaluates the all-pairs configuration for small sample sizes and compares it to the non-PI approach of latent moderated structural equations.

Testing Psychological Hypotheses Addressing Two Independent Variables and One Dependent Variable

Two-Stage Testing in a high dimensional setting

A Tutorial on Testing, Visualizing, and Probing an Interaction Involving a Multicategorical Variable in Linear Regression Analysis

Probing three-way interactions in moderated multiple regression: Development and application of a slope difference test.

Penalized Independence Rule for Testing High-Dimensional Hypotheses

Interpreting and Testing Interactions in Conditional Mixture Models

Mastering the Use of Control Variables: the Hierarchical Iterative Control (HIC) Approach

On the Ambiguity of Interaction and Nonlinear Main Effects in a Regime of Dependent Covariates

How Many Participants Do I Need to Test an Interaction? Conducting an Appropriate Power Analysis and Achieving Sufficient Power to Detect an Interaction

Are alternative variables in a set differently associated with a target variable? Statistical tests and practical advice for dealing with dependent correlations

One step at a time: A statistical approach for distinguishing mediators, confounders, and colliders using direction dependence analysis.

The Analysis of Repeated Measures Designs Involving Multiple Dependent Variables

Deep determinism and the assessment of mechanistic interaction between categorical and continuous variables

Information Selection and Utilization in Hypothesis Testing: A Comparison of Process-Tracing and Structural Analysis Techniques

Robustness of multiple testing procedures against dependence

The choice of product indicators in latent variable interaction models: Post hoc analyses.

A tutorial on using the paired t test for power calculations in repeated measures ANOVA with interactions

[An aligned rank test for a nonparametric analysis of the two-way interaction]

Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models

Testing Moderating Hypotheses in Limited Dependent Variable and Other Nonlinear Models

Effects of Latent Variable Nonnormality and Model Misspecification on Testing Structural Equation Modeling Interactions