Abstract:Purpose Researchers often stress the predictive goals of their partial least squares structural equation modeling (PLS-SEM) analyses. However, the method has long lacked a statistical test to compare different models in terms of their predictive accuracy and to establish whether a proposed model offers a significantly better out-of-sample predictive accuracy than a naïve benchmark. This paper aims to address this methodological research gap in predictive model assessment and selection in composite-based modeling. Design/methodology/approach Recent research has proposed the cross-validated predictive ability test (CVPAT) to compare theoretically established models. This paper proposes several extensions that broaden the scope of CVPAT and explains the key choices researchers must make when using them. A popular marketing model is used to illustrate the CVPAT extensions' use and to make recommendations for the interpretation and benchmarking of the results. Findings This research asserts that prediction-oriented model assessments and comparisons are essential for theory development and validation. It recommends that researchers routinely consider the application of CVPAT and its extensions when analyzing their theoretical models. Research limitations/implications The findings offer several avenues for future research to extend and strengthen prediction-oriented model assessment and comparison in PLS-SEM. Practical implications Guidelines are provided for applying CVPAT extensions and reporting the results to help researchers substantiate their models' predictive capabilities. Originality/value This research contributes to strengthening the predictive model validation practice in PLS-SEM, which is essential to derive managerial implications that are typically predictive in nature.

Assessing measurement model quality in PLS-SEM using confirmatory composite analysis

Evaluation of Formative Measurement Models

Predictive model assessment and selection in composite-based modeling using PLS-SEM: extensions and guidelines for using CVPAT

How to Specify, Estimate, and Validate Higher-Order Constructs in PLS-SEM

Mirror, mirror on the wall: a comparative evaluation of composite-based structural equation modeling methods

Evaluation of the Structural Model

The assessment of the performance of covariance-based structural equation modeling and partial least square path modeling

Confirmatory Factor Analysis (CFA), Exploratory Structural Equation Modeling (ESEM), and Set-ESEM: Optimal Balance Between Goodness of Fit and Parsimony

An Introduction to Structural Equation Modeling

Methods Showcase—Using PLSF-SEM in Business Communication Research

On the Behavior of Fit Indices for Adjudicating Between Exploratory Structural Equation and Confirmatory Factor Analysis Models

Comparison Between CB-SEM and PLS-SEM: Testing and Confirming the Maqasid Syariah Quality of Life Measurement Model

A comparative study on the performance of maximum likelihood, generalized least square, scale-free least square, partial least square and consistent partial least square estimators in structural equation modeling

Semi-Confirmatory Factor Analysis for High-Dimensional Data with Interconnected Community Structures

Best practices for your confirmatory factor analysis: A JASP and lavaan tutorial

Beyond a tandem analysis of SEM and PROCESS: Use of PLS-SEM for mediation analyses!

Structural model robustness checks in PLS-SEM

A brief review of partial least squares structural equation modeling (PLS-SEM) use in quality management studies

The shortcomings of equal weights estimation and the composite equivalence index in PLS-SEM

Rethinking some of the rethinking of partial least squares

Understanding Composite-Based Structural Equation Modeling Methods From the Perspective of Regression Component Analysis