Abstract:SIMULATION, Ahead of Print. A stochastic network simulation is verified when its distribution of outputs is aligned with the ground truth, while tolerating deviations due to variability in real-world measurements and the randomness of a stochastic simulation. However, comparing distributions may yield false positives, as erroneous simulations may have the expected distribution yet present aberrations in low-level patterns. For instance, the number of sick individuals may present the right trend over time, but the wrong individuals were infected. We previously proposed an approach that transforms simulation traces into images verified by machine learning algorithms that account for low-level patterns. We demonstrated the viability of this approach when many simulation traces are compared with a large ground truth data set. However, ground truth data are often limited. For example, a publication may include few images of their simulation as illustrations; hence, teams that independently re-implement the model can only compare low-level patterns with few cases. In this paper, we examine whether our approach can be utilized with very small data sets (e.g., 5–10 images), as provided in publications. Depending on the network simulation model (e.g., rumor spread, cascading failure, and disease spread), we show that results obtained with little data can even surpass results obtained with moderate amounts of data at the cost of variability. Although a good accuracy is obtained in detecting several forms of errors, this paper is only a first step in the use of this technique for verification; hence, future works should assess the applicability of our approach to other types of network simulations.

Credibility evaluation of simulation for trusted network connection

Distributed Bayesian Network Trust Model in Virtual Network

Trust model of users' behavior in trustworthy internet

C2C Trust Evaluation Model Based on Social Network and Reputation

A Computational Trust Model in C2C E-Commerce Environment

Evaluation of Complex Network Model Based on Cloud Model

A trust model based on fuzzy set in peer-to-peer network

Experimental evaluation of a machine learning approach to improve the reproducibility of network simulations

Network Situation Assessment Method Based on Improved BP Neural Network

Evaluating Network Models: A Likelihood Analysis

A Trustworthiness Sequence Prediction Scheme Based on Neural Networks and Mathematical Calculations

A network security situation assessment model based on BP neural network optimized by D-S evidence theory

Methodology of Simulation Credibility Evluation for Complex Product Based on DS Evidence Theory

Simulation Credibility Assessment Methodology with FPGA-based Hardware-in-the-loop Platform

Research on User Trust Evaluation of Social E-commerce Platform Based on Artificial Neural Network

A dynamic trust evaluation model for internet computing

A Robust Model for Trust Evaluation during Interactions between Agents in a Sociable Environment

Reliability assessment of complex electromechanical systems: A network perspective

On credibility validation of the artificial urban rail transportation system

A Dynamic Trust Network Based Simulation Framework for Reputation-Based Service Selection

Improved Deep Belief Network and Model Interpretation Method for Power System Transient Stability Assessment