Abstract:Network psychometrics leverages pairwise Markov random fields to depict conditional dependencies among a set of psychological variables as undirected edge-weighted graphs. Researchers often intend to compare such psychometric networks across subpopulations, and recent methodological advances provide invariance tests of differences in subpopulation networks. What remains missing, though, is an analogue to an effect size measure that quantifies differences in psychometric networks. We address this gap by complementing recent advances for investigating whether psychometric networks differ with an intuitive similarity measure quantifying the extent to which networks differ. To this end, we build on graph-theoretic approaches and propose a similarity measure based on the Frobenius norm of differences in psychometric networks' weighted adjacency matrices. To assess this measure's utility for quantifying differences between psychometric networks, we study how it captures differences in subpopulation network models implied by both latent variable models and Gaussian graphical models. We show that a wide array of network differences translates intuitively into the proposed measure, while the same does not hold true for customary correlation-based comparisons. In a simulation study on finite-sample behavior, we show that the proposed measure yields trustworthy results when population networks differ and sample sizes are sufficiently large, but fails to identify exact similarity when population networks are the same. From these results, we derive a strong recommendation to only use the measure as a complement to a significant test for network similarity. We illustrate potential insights from quantifying psychometric network similarities through cross-country comparisons of human values networks. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

An egonet-based approach to effective weighted network comparison

Metrics for network comparison using egonet feature distribution

Characterizing Dissimilarity of Weighted Networks

A New Methodology for Generalizing Unweighted Network Measures

Comparing Networks from a Data Analysis Perspective

On Measuring Network Robustness for Weighted Networks

Dissimilarity-based Filtering and Compression of Complex Weighted Networks

On Efficient Network Similarity Measures.

A Comparative Analysis of New Graph Distance Measures and Graph Edit Distance

Weighted Networks of Scientific Communication: the Measurement and Topological Role of Weight

Consistently weighted measures for complex network topologies

Directed Network Comparison Using Motifs

Characterization and Modeling of weighted networks

A New Network Node Similarity Measure Method and Its Applications.

Quantification of network structural dissimilarities based on network embedding

Effective Link-Based Measure of Node Similarity on Information Networks

Graphlet-based measures are suitable for biological network comparison

A Comprehensive Comparison of Network Similarities for Link Prediction and Spurious Link Elimination

A graph theory based similarity metric enables comparison of subpopulation psychometric networks.

Measuring the Dissimilarity of Multiplex Networks: an Empirical Study of International Trade Networks

Optimal scales in weighted networks