Abstract:With the fourth industrial revolution, the construction of the Internet of Things (IoT) has developed vigorously, and machine learning is also widely used in IoT management and data processing. Given the existence of massive distributed and private datasets generated by a large number of IoT devices, centralized machine learning is unsatisfactory. Therefore, federated learning (FL), as a distributed learning method, becomes a promising solution. In FL, clients can train models by transferring model parameters to the aggregation server while keeping private data locally. However, FL still relies on a central server, which has questionable reliability. The single point of failure and limited communication resources also hinder the application of FL in the IoT. In this paper, we propose a voting consensus based decentralized federated learning method (VCDFL) by incorporating the leader-candidate-follower hierarchical management method and the consensus based leader election mechanism to solve the single point of failure and exclude outlier models for accelerating convergence during aggregation. Then, we propose a joint decision method to exchange decision information rather than model transfer between clients to further protect privacy and reduce communication overhead while ensuring accuracy. Furthermore, we mathematically derive the probability of successfully electing a leader, the communication efficiency and the joint decision accuracy. We conduct our method in an image recognition scenario. The results show that our joint decision mechanism promotes the accuracy of both system and local decision-making. Meanwhile, the proposed scheme greatly reduces communication costs compared to benchmark learning methods.

Consensus Learning for Distributed Fuzzy Neural Network in Big Data Environment

Consensus under Bounded Noise in Discrete Network Systems: an Algorithm with Fast Convergence and High Accuracy.

Federated Learning of Models Pre-Trained on Different Features with Consensus Graphs

Neural-Network-Based Fully Distributed Adaptive Consensus for a Class of Uncertain Multiagent Systems

A DNN-Ensemble Method for Error Reduction and Training Data Selection in DNN Based Modeling

Fully Distributed Adaptive Finite-Time Consensus for Uncertain Nonlinear Multiagent Systems.

Decentralized Federated Learning with Markov Chain Based Consensus for Industrial IoT Networks

Design and Analysis of a Novel Distributed Gradient Neural Network for Solving Consensus Problems in a Predefined Time

Hierarchically Federated Learning in Wireless Networks: D2D Consensus and Inter-Cell Aggregation

Federated Fuzzy Neural Network with Evolutionary Rule Learning

Federated Learning Beyond the Star: Local D2D Model Consensus with Global Cluster Sampling

Distributed learning consensus control based on neural networks for heterogeneous nonlinear multiagent systems

Neural Network Based Distributed Consensus Control for Heterogeneous Multi-agent Systems.

Distributed Adaptive Neural Network Consensus for a Class of Uncertain Nonaffine Nonlinear Multi-Agent Systems

Voting Consensus Based Decentralized Federated Learning

Federated Learning via Consensus Mechanism on Heterogeneous Data: A New Perspective on Convergence

Batch-Based Learning Consensus of Multiagent Systems with Faded Neighborhood Information.

Consensus learning: A novel decentralised ensemble learning paradigm

A Distributed Computation Model Based on Federated Learning Integrates Heterogeneous Models and Consortium Blockchain for Solving Time-Varying Problems

Fully Distributed Adaptive NN-Based Consensus Protocol for Nonlinear MASs: an Attack-Free Approach.

Distributed Learning in Heterogeneous Environment: federated learning with adaptive aggregation and computation reduction