Abstract:Large-scale decentralized systems of autonomous agents interacting via asynchronous communication often experience the following self-healing dilemma: fault detection inherits network uncertainties making a remote faulty process indistinguishable from a slow process. In the case of a slow process without fault, fault correction is undesirable as it can trigger new faults that could be prevented with fault tolerance that is a more proactive system maintenance. But in the case of an actual faulty process, fault tolerance alone without eventually correcting persistent faults can make systems underperforming. Measuring, understanding and resolving such self-healing dilemmas is a timely challenge and critical requirement given the rise of distributed ledgers, edge computing, the Internet of Things in several energy, transport and health applications. This paper contributes a novel and general-purpose modeling of fault scenarios during system runtime. They are used to accurately measure and predict inconsistencies generated by the undesirable outcomes of fault correction and fault tolerance as the means to improve self-healing of large-scale decentralized systems at the design phase. A rigorous experimental methodology is designed that evaluates 696 experimental settings of different fault scales, fault profiles and fault detection thresholds in a prototyped decentralized network of 3000 nodes. Almost 9 million measurements of inconsistencies were collected in a network, where each node monitors the health status of another node, while both can defect. The prediction performance of the modeled fault scenarios is validated in a challenging application scenario of decentralized and dynamic in-network data aggregation using real-world data from a Smart Grid pilot project. Findings confirm the origin of inconsistencies at design phase.

Fault-Tolerant, but Paradoxical Path-Finding in Physical and Conceptual Systems

Dynamic Reliability Analysis Model for Fault-Tolerant Network Routing

The Faulty GPS Problem: Shortest Time Paths in Networks with Unreliable Directions

A Probabilistic Approach to Analysis of Reliability in n-D Meshes with Interconnect Router Failures

Navigability of interconnected networks under random failures

A Heuristic Pathfinding Algorithm for Dynamic Fault Tolerance in Manufacturing Networks

Practical counting of substitutive paths on a planar infrastructure network

Fault-Tolerant Routing in Planarly Constructed Fault Blocks

Self-healing Dilemmas in Distributed Systems: Fault Correction vs. Fault Tolerance

Topology Recoverability Prediction for Ad-Hoc Robot Networks: A Data-Driven Fault-Tolerant Approach

A Bayesian approach to breaking things: efficiently predicting and repairing failure modes via sampling

Path Planning under Time-Dependent Uncertainty

Dynamics of Functional Failures and Recovery in Complex Road Networks.

Modelling Cascading Failure of a CPS for Topological Resilience Enhancement

Decision-Theoretic Troubleshooting: A Framework for Repair and Experiment

Defect tolerance: fundamental limits and examples

A Novel Probabilistic Fault Detection Scheme with Adjustable Reliability Estimates

Probabilistic approaches to fault detection in networked discrete event systems

Message Passing for Analysis and Resilient Design of Self-Healing Interdependent Cyber-Physical Networks

Flexible Paths: A Path Planning Approach to Dynamic Navigation

An adaptive decision method using structure feature analysis on dynamic fault propagation model