Abstract:There are enduring misconceptions in the marketing and management literature about the potential biasing effects of Common Method Variance (CMV). One belief is that the biasing effect of CMV is of greater theoretical than practical importance; another belief is that if CMV is a potential problem, it can be easily identified with the Harman one-factor test. In this article, we show that both beliefs are ill founded and need correction. To demonstrate our key points with greater generality, we use analytical derivations rather than empirical simulations. First, we examine the effects of CMV on correlations between observed variables as a function of measure unreliability and the sign and size of the "true" trait correlation. We demonstrate that, for negative trait correlations, CMV leads to a substantial upward bias in observed correlations (i.e., observed correlations are less negative than the trait correlation), and under certain conditions observed correlations may even have the wrong sign (assuming that the method loadings are both positive or both negative). We also show that, for positive trait correlations, the downward bias due to measurement unreliability does not always mitigate the upward bias due to CMV (again assuming that the method loadings are either both positive or both negative). Importantly, our results indicate that the inflationary effect of CMV is larger at lower levels of (positive) trait correlations, whereas the deflationary effect of unreliability is larger at higher levels of trait correlations. Second, we demonstrate analytically the serious deficiencies of the popular Harman one-factor test for detecting common method variance and strongly recommend against its use in future research.

A primer on method effects on observed correlations with examples

Improving measurement-invariance assessments: correcting entrenched testing deficiencies

A metacognitive approach to understanding what marker variables measure

The biasing effect of common method variance: some clarifications

Where the Model Frequently Meets the Road: Combining Statistical, Formal, and Case Study Methods

Methodological Challenges in Causal Research on Racial and Ethnic Patterns of Cognitive Trajectories: Measurement, Selection, and Bias

Primacy of theory? Exploring perspectives on validity in conceptual psychometrics

A common factor underlying individual differences in confirmation bias

Using Generalizability Theory to Disattenuate Correlation Coefficients for Multiple Sources of Measurement Error

A Comparison of Confirmatory Factor Analysis and Network Models for Measurement Invariance Assessment When Indicator Residuals are Correlated

Method factor due to the use of reverse-keyed items: Is it simply a response style artifact?

Psychometric approaches for developing commensurate measures across independent studies: Traditional and new models.

A Monte Carlo Study of the Effects of Common Method Variance on Significance Testing and Parameter Bias in Hierarchical Linear Modeling

Factor analysis in the development and refinement of clinical assessment instruments.

Measurement Invariance and Differential Item Functioning in Latent Class Analysis With Stepwise Multiple Indicator Multiple Cause Modeling

Common method biases in behavioral research: A critical review of the literature and recommended remedies.

Advances in meta‐analysis: A unifying modelling framework with measurement error correction

On Detecting Systematic Measurement Error in Cross-Cultural Research: A Review and Critical Reflection on Equivalence and Invariance Tests

Extensions of Auxiliary Variable Approaches for the Investigation of Mediation, Moderation, and Conditional Effects in Mixture Models

The Problem of Measurement Model Misspecification in Behavioral and Organizational Research and Some Recommended Solutions.

A Latent Trait Model for Multivariate Longitudinal Data With Two Sources of Measurement Error