Abstract:Distributed optimization enables networked agents to cooperatively solve a global optimization problem even with each participating agent only having access to a local partial view of the objective function. Despite making significant inroads, most existing results on distributed optimization rely on noise-free information sharing among the agents, which is problematic when communication channels are noisy, messages are coarsely quantized, or shared information are obscured by additive noise for the purpose of achieving differential privacy. The problem of information-sharing noise is particularly pronounced in the state-of-the-art gradient-tracking based distributed optimization algorithms, in that information-sharing noise will accumulate with iterations on the gradient-tracking estimate of these algorithms, and the ensuing variance will even grow unbounded when the noise is persistent. This paper proposes a new gradient-tracking based distributed optimization approach that can avoid information-sharing noise from accumulating in the gradient estimation. The approach is applicable even when the {inter-agent interaction is} time-varying, which is key to enable the incorporation of a decaying factor in inter-agent interaction to gradually eliminate the influence of information-sharing noise. In fact, we rigorously prove that the proposed approach can ensure the almost sure convergence of all agents to the same optimal solution even in the presence of persistent information-sharing noise. The approach is applicable to general directed graphs. It is also capable of ensuring the almost sure convergence of all agents to an optimal solution when the gradients are noisy, which is common in machine learning applications. Numerical simulations confirm the effectiveness of the proposed approach.

The Informational Approach to Global Optimization in presence of very noisy evaluation results. Application to the optimization of renewable energy integration strategies

A Direct Coupled Solution Methodology for Efficient Robust Optimizations of Inverse Problems under Uncertainty

Information-Theoretic Safe Bayesian Optimization

Robust Optimization Using a Methodology Based on Cross Entropy Methods

A discrete Consensus-Based Global Optimization Method with Noisy Objective Function

Information entropy, continuous improvement, and US energy performance: a novel stochastic-entropic analysis for ideal solutions (SEA-IS)

Optimization via Statistical Emulation and Uncertainty Quantification: Hosting Capacity Analysis of Distribution Networks

Gradient-tracking based Distributed Optimization with Guaranteed Optimality under Noisy Information Sharing

Joint Entropy Search for Maximally-Informed Bayesian Optimization

A machine learning and distributionally robust optimization framework for strategic energy planning under uncertainty

Multi-information source constrained Bayesian optimization

Monotone Improvement of Information-Geometric Optimization Algorithms with a Surrogate Function

Full-low evaluation methods for derivative-free optimization

A Hybrid Algorithm Based on Bayesian Optimization and Interior Point OPTimizer for Optimal Operation of Energy Conversion Systems

Feedback-Based Optimization with Sub-Weibull Gradient Errors and Intermittent Updates

Non‐parametric measure approximations for constrained multi‐objective optimisation under uncertainty

$\{\text{PF}\}^2$ES: Parallel Feasible Pareto Frontier Entropy Search for Multi-Objective Bayesian Optimization

Developing a strategy based on weighted mean of vectors (INFO) optimizer for optimal power flow considering uncertainty of renewable energy generation

Improving robustness in strategic energy planning: A novel decision support method to deal with epistemic uncertainties

Personalized Optimization with User's Feedback

Optimization with Access to Auxiliary Information