Abstract:Decentralised learning has recently gained traction as an alternative to federated learning in which both data and coordination are distributed. To preserve the confidentiality of users' data, decentralised learning relies on differential privacy, multi-party computation, or both. However, running multiple privacy-preserving summations in sequence may allow adversaries to perform reconstruction attacks. Current reconstruction countermeasures either cannot trivially be adapted to the distributed setting, or add excessive amounts of noise. In this work, we first show that passive honest-but-curious adversaries can infer other users' private data after several privacy-preserving summations. For example, in subgraphs with 18 users, we show that only three passive honest-but-curious adversaries succeed at reconstructing private data 11.0% of the time, requiring an average of 8.8 summations per adversary. The success rate depends only on the adversaries' direct neighbourhood, and is independent of the size of the full network. We consider weak adversaries that do not control the graph topology, cannot exploit the summation's inner workings, and do not have auxiliary knowledge; and show that these adversaries can still infer private data. We analyse how reconstruction relates to topology and propose the first topology-based decentralised defence against reconstruction attacks. We show that reconstruction requires a number of adversaries linear in the length of the network's shortest cycle. Consequently, exact attacks over privacy-preserving summations are impossible in acyclic networks. Our work is a stepping stone for a formal theory of topology-based decentralised reconstruction defences. Such a theory would generalise our countermeasure beyond summation, define confidentiality in terms of entropy, and describe the interactions with (topology-aware) differential privacy.

Distributed Topology-preserving Collaboration Algorithm Against Inference Attack.

Topology-Preserving Second-Order Consensus: A Strategic Compensation Approach

Topology Inference for Multi-agent Cooperation under Unmeasurable Latent Input

Dynamic Topology Inference via External Observation for Multi-Robot Formation Control

Inference Attack in Distributed Optimization via Interpolation and Manipulation

On Topology Inference for Networked Dynamical Systems: Principles and Performances.

Topology-Preserving Motion Coordination for Multi-Robot Systems in Adversarial Environments

Transient Bipartite Synchronization for Cooperative-Antagonistic Multiagent Systems with Switching Topologies

Algebraic Connectivity Control and Maintenance in Multi-Agent Networks under Attack

Moving Obstacle Avoidance And Topology Recovery For Multi-Agent Systems

Preserving Topology of Network Systems: Metric, Analysis, and Optimal Design

Privacy-preserving Resilient Consensus for Multi-agent Systems in a General Topology Structure

Topology Inference for Networked Dynamical Systems - A Causality and Correlation Perspective.

A Distributed Sequential Algorithm for Collaborative Intrusion Detection Networks

Topology Inference on Partially Observable Mobile Robotic Networks under Formation Control

Algorithm for the Inference of a Dynamic Topology

Topology Inference for Consensus-based Cooperation under Time-invariant Latent Input.

A Localized K-connectivity Topology Control Algorithm in Multi-Agent Networks

An Online Topology Control Method for Multi-Agent Systems: Distributed Topology Reconfiguration

A Convergence-preserving Data Integrity Attack on Distributed Optimization Using Local Information

Topology-Based Reconstruction Prevention for Decentralised Learning