Abstract:This paper considers the problem of Byzantine fault-tolerance in distributed multi-agent optimization. In this problem, each agent has a local cost function, and in the fault-free case, the goal is to design a distributed algorithm that allows all the agents to find a minimum point of all the agents' aggregate cost function. We consider a scenario where some agents might be Byzantine faulty that renders the original goal of computing a minimum point of all the agents' aggregate cost vacuous. A more reasonable objective for an algorithm in this scenario is to allow all the non-faulty agents to compute the minimum point of only the non-faulty agents' aggregate cost. Prior work shows that if there are up to $f$ (out of $n$) Byzantine agents then a minimum point of the non-faulty agents' aggregate cost can be computed exactly if and only if the non-faulty agents' costs satisfy a certain redundancy property called $2f$-redundancy. However, $2f$-redundancy is an ideal property that can be satisfied only in systems free from noise or uncertainties, which can make the goal of exact fault-tolerance unachievable in some applications. Thus, we introduce the notion of $(f,\epsilon)$-resilience, a generalization of exact fault-tolerance wherein the objective is to find an approximate minimum point of the non-faulty aggregate cost, with $\epsilon$ accuracy. This approximate fault-tolerance can be achieved under a weaker condition that is easier to satisfy in practice, compared to $2f$-redundancy. We obtain necessary and sufficient conditions for achieving $(f,\epsilon)$-resilience characterizing the correlation between relaxation in redundancy and approximation in resilience. In case when the agents' cost functions are differentiable, we obtain conditions for $(f,\epsilon)$-resilience of the distributed gradient-descent method when equipped with robust gradient aggregation.

A Fault-Tolerant Distributed Termination Method for Distributed Optimization Algorithms

Counterexamples and Amendments to the Termination and Optimality of ADOPT-based Algorithms

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Distributed Stochastic Algorithm for Global Optimization in Networked System

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

Optimally Managing the Impacts of Convergence Tolerance for Distributed Optimal Power Flow

Distributed robust optimization for multi-agent systems with guaranteed finite-time convergence

Distributed Robust Optimization in Networked System.

Distributed Algorithm for a Finite Time Horizon Resource Allocation over a Directed Network

Approximate Byzantine Fault-Tolerance in Distributed Optimization

Byzantine-Resilient Distributed Optimization of Multi-Dimensional Functions

Convergence Guarantees of a Distributed Network Equivalence Algorithm for Distribution-OPF

Distributed Optimization with Asynchronous Computation and Event-triggered Communication

Fully Distributed Alternating Direction Method of Multipliers in Digraphs via Finite-Time Termination Mechanisms

A Survey on Fault-tolerance in Distributed Optimization and Machine Learning

Measures of Fault Tolerance in Distributed Simulated Annealing

Byzantine Fault-Tolerance in Peer-to-Peer Distributed Gradient-Descent

A Distributed Optimization Algorithm over Markov Switching Topology under Adversarial Attack

Distributed fixed-point algorithms for dynamic convex optimization over decentralized and unbalanced wireless networks

Distributed Approach for DC Optimal Power Flow Calculations

A Continuous-Time Algorithm for Distributed Optimization With Nonuniform Time-Delay Under Switching and Unbalanced Digraphs