Abstract:Due to the expanding scope of machine learning (ML) to the fields of sensor networking, cooperative robotics and many other multi-agent systems, distributed deployment of inference algorithms has received a lot of attention. These algorithms involve collaboratively learning unknown parameters from dispersed data collected by multiple agents. There are two competing aspects in such algorithms, namely, intra-agent computation and inter-agent communication. Traditionally, algorithms are designed to perform both synchronously. However, certain circumstances need frugal use of communication channels as they are either unreliable, time-consuming, or resource-expensive. In this paper, we propose gossip-based asynchronous communication to leverage fast computations and reduce communication overhead simultaneously. We analyze the effects of multiple (local) intra-agent computations by the active agents between successive inter-agent communications. For local computations, Bayesian sampling via unadjusted Langevin algorithm (ULA) MCMC is utilized. The communication is assumed to be over a connected graph (e.g., as in decentralized learning), however, the results can be extended to coordinated communication where there is a central server (e.g., federated learning). We theoretically quantify the convergence rates in the process. To demonstrate the efficacy of the proposed algorithm, we present simulations on a toy problem as well as on real world data sets to train ML models to perform classification tasks. We observe faster initial convergence and improved performance accuracy, especially in the low data range. We achieve on average 78% and over 90% classification accuracy respectively on the Gamma Telescope and mHealth data sets from the UCI ML repository.

Distributed Bayesian Learning in Multiagent Systems: Improving Our Understanding of Its Capabilities and Limitations

Observer-Based Multiagent Deep Reinforcement Learning: A Fully Distributed Training Scheme

Distributed Learning from Interactions in Social Networks

Social Learning with Bayesian Agents and Random Decision Making

Bayesian Social Learning in Linear Networks of Agents with Random Behavior

Bayesian social learning with decision making in multiple rounds

Asynchronous Local Computations in Distributed Bayesian Learning

Distributed Bayesian Online Learning for Cooperative Manipulation

Asynchronous Bayesian Learning over a Network

Distributed Bayesian Estimation of Linear Models With Unknown Observation Covariances.

Interaction-Based Distributed Learning in Cyber-Physical and Social Networks

Bayesian learning in a network with multi-hypothesis decision exchanges

A Bayesian Multiagent Trust Model for Social Networks.

Evolution of Social Belief in Multiagent Systems

Non-cooperative Multi-agent Systems with Exploring Agents

Distributed Neural Learning Algorithms for Multiagent Reinforcement Learning

Distributed Non-Bayesian Learning for Games with Incomplete Information

Opinion Dynamics in Multi-Agent Systems with Binary Decision Exchanges

Context-Aware Bayesian Network Actor-Critic Methods for Cooperative Multi-Agent Reinforcement Learning

Robust Multi-Agent Reinforcement Learning Via Bayesian Distributional Value Estimation

Distributed Learning with Adversarial Agents Under Relaxed Network Condition