Abstract:We consider problems where agents in a network seek a common quantity, measured independently and periodically by each agent through a local time-varying process. Numerous solvers addressing such problems have been developed in the past, featuring various adaptations of the local processing and the consensus step. However, existing solvers still lack support for advanced techniques, such as superiorization and over-the-air function computation (OTA-C). To address this limitation, we introduce a comprehensive framework for the analysis of distributed algorithms by characterizing them using the quasi-Fejér type algorithms and an extensive communication model. Under weak assumptions, we prove almost sure convergence of the algorithm to a common estimate for all agents. Moreover, we develop a specific class of algorithms within this framework to tackle distributed optimization problems with time-varying objectives, and, assuming that a time-invariant solution exists, prove its convergence to a solution. We also present a novel OTA-C protocol for consensus step in large decentralized networks, reducing communication overhead and enhancing network autonomy as compared to the existing protocols. The effectiveness of the algorithm, featuring superiorization and OTA-C, is demonstrated in a real-world application of distributed supervised learning over time-varying wireless networks, highlighting its low-latency and energy-efficiency compared to standard approaches.

Solving least-squares problems in directed networks: A distributed approach

Distributed Least Squares Solver for Network Linear Equations.

Distributed Algorithms for Solving a Least Squares Solution of Linear Algebraic Equations

Distributed algorithms for the least square solution of linear equations

Distributed Finite-time Least Squares Solver for Network Linear Equations.

Distributed least square solution method to linear algebraic equations over multiagent networks

A Distributed Algorithm for Resource Allocation Over Dynamic Digraphs.

Distributed Constrained Nonlinear Least-Squares Estimation Algorithm Over Unbalanced Directed Networks

Network flows that solve least squares for linear equations

Distributed Algorithms for Linear Equations Over General Directed Networks

A Networked Parallel Algorithm for Solving Linear Algebraic Equations

Scalable Distributed Least Square Algorithms for Large-Scale Linear Equations Via an Optimization Approach

Scalable Distributed Least Squares Algorithm for Linear Algebraic Equations via Scheduling

Distributed algorithms of solving linear matrix equations via double-layered networks

Distributed Sparse Total Least-Squares over Networks

Scalable, Distributed Algorithms for Solving Linear Equations via Double-Layered Networks

Distributed Algorithm for a Finite Time Horizon Resource Allocation over a Directed Network

Distributed Sparse Recursive Least-Squares over Networks

A Resilient Distributed Algorithm for Solving Linear Equations

An Expanded Distributed Algorithm for Dynamic Resource Allocation over Strongly Connected Topologies

Distributed fixed-point algorithms for dynamic convex optimization over decentralized and unbalanced wireless networks