Abstract:Many end-user evaluations of data visualization techniques have been run during the last decades. Their results are cornerstones to build efficient visualization systems. However, designing such an evaluation is always complex and time-consuming and may end in a lack of statistical evidence and reproducibility. We believe that modern and efficient computer vision techniques, such as deep convolutional neural networks (CNNs), may help visualization researchers to build and/or adjust their evaluation hypothesis. The basis of our idea is to train machine learning models on several visualization techniques to solve a specific task. Our assumption is that it is possible to compare the efficiency of visualization techniques based on the performance of their corresponding model. As current machine learning models are not able to strictly reflect human capabilities, including their imperfections, such results should be interpreted with caution. However, we think that using machine learning-based pre-evaluation, as a pre-process of standard user evaluations, should help researchers to perform a more exhaustive study of their design space. Thus, it should improve their final user evaluation by providing it better test cases. In this paper, we present the results of two experiments we have conducted to assess how correlated the performance of users and computer vision techniques can be. That study compares two mainstream graph visualization techniques: node-link (\NL) and adjacency-matrix (\MD) diagrams. Using two well-known deep convolutional neural networks, we partially reproduced user evaluations from Ghoniem \textit{et al.} and from Okoe \textit{et al.}. These experiments showed that some user evaluation results can be reproduced automatically.

TrammelGraph: Visual Graph Abstraction for Comparison

Trammel Map: Providing a Clear View of the Enterprise Social Network

TieVis: visual analytics of evolution of interpersonal ties

Comparative Evaluation of Bipartite, Node-Link, and Matrix-Based Network Representations

GEMvis: a visual analysis method for the comparison and refinement of graph embedding models

G-Tran: A High Performance Distributed Graph Database with a Decentralized Architecture

Comparing Nodes of Multivariate Graphs Through Dynamic Layout Adaptations

Alignment of Tractograms As Graph Matching

GMTR: Graph Matching Transformers

Egocomp: A Node-Link-based Technique for Visual Comparison of Ego-Networks.

A Truss-Based Framework for Graph Similarity Computation

Characterizing and Utilizing the Interplay Between Core and Truss Decompositions

Revealing effective classifiers through network comparison

EmbeddingVis: A Visual Analytics Approach to Comparative Network Embedding Inspection

Scalable Network Traffic Visualization By Structural Equivalence Grouping

CompTrails: comparing hypotheses across behavioral networks

Toward automatic comparison of visualization techniques: Application to graph visualization

NodeTrix: Hybrid Representation for Analyzing Social Networks

Tree++: Truncated Tree Based Graph Kernels

Rapid and Precise Topological Comparison with Merge Tree Neural Networks

A General Framework for Comparing Embedding Visualizations Across Class-Label Hierarchies