Abstract:We consider an $n$ agents distributed optimization problem with imperfect information characterized in a parametric sense, where the unknown parameter can be solved by a distinct distributed parameter learning problem. Though each agent only has access to its local parameter learning and computational problem, they mean to collaboratively minimize the average of their local cost functions. To address the special optimization problem, we propose a coupled distributed stochastic approximation algorithm, in which every agent updates the current beliefs of its unknown parameter and decision variable by stochastic approximation method; and then averages the beliefs and decision variables of its neighbors over network in consensus protocol. Our interest lies in the convergence analysis of this algorithm. We quantitatively characterize the factors that affect the algorithm performance, and prove that the mean-squared error of the decision variable is bounded by $\mathcal{O}(\frac{1}{nk})+\mathcal{O}\left(\frac{1}{\sqrt{n}(1-\rho_w)}\right)\frac{1}{k^{1.5}}+\mathcal{O}\big(\frac{1}{(1-\rho_w)^2} \big)\frac{1}{k^2}$, where $k$ is the iteration count and $(1-\rho_w)$ is the spectral gap of the network weighted adjacency matrix. It reveals that the network connectivity characterized by $(1-\rho_w)$ only influences the high order of convergence rate, while the domain rate still acts the same as the centralized algorithm. In addition, we analyze that the transient iteration needed for reaching its dominant rate $\mathcal{O}(\frac{1}{nk})$ is $\mathcal{O}(\frac{n}{(1-\rho_w)^2})$. Numerical experiments are carried out to demonstrate the theoretical results by taking different CPUs as agents, which is more applicable to real-world distributed scenarios.

Distributed Resource Allocation Over Random Networks Based on Stochastic Approximation

A Distributed Algorithm for Resource Allocation Over Dynamic Digraphs.

An Exponentially Convergent Distributed Algorithm for Resource Allocation Problem

A Distributed Algorithm for Resource Allocation in Smart Grid

An Expanded Distributed Algorithm for Dynamic Resource Allocation over Strongly Connected Topologies

Communication-Efficient Distributed Strategy for Reactive Power Optimisation Considering the Uncertainty of Renewable Generation

A distributed algorithm with less communication for resource allocation problem

Distributed Optimization For Resource Allocation With Event-Triggered Communication Under Directed Topology

A Distributed Algorithm With Event-Triggered Communication For Resource Allocation Problem

Disturbance-resilient Distributed Resource Allocation over Stochastic Networks using Uncoordinated Stepsizes

Distributed Algorithm for a Finite Time Horizon Resource Allocation over a Directed Network

Distributed Stochastic Algorithm for Global Optimization in Networked System

Distributed Stochastic Optimization With Unbounded Subgradients Over Randomly Time-Varying Networks

Asymptotic Properties of Primal-Dual Algorithm for Distributed Stochastic Optimization Over Random Networks

Distributed Algorithm for Nonsmooth Resource Allocation Problems With Nonlinear Constraints and Its Application to Smart Grids

Rate Analysis of Coupled Distributed Stochastic Approximation for Misspecified Optimization

An Asynchronous Gradient Descent Based Method for Distributed Resource Allocation with Bounded Variables

Generalized Second-Order Neurodynamic Approach for Distributed Optimal Allocation

Distributed Heterogeneous Multi-Agent Optimization with Stochastic Sub-Gradient

A Dual Splitting Algorithm For Distributed Resource Allocation Problems

A fully distributed approach to resource allocation problem under directed and switching topologies