Abstract:Federated learning is one of the most appealing alternatives to the standard centralized learning paradigm, allowing a heterogeneous set of devices to train a machine learning model without sharing their raw data. However, it requires a central server to coordinate the learning process, thus introducing potential scalability and security issues. In the literature, server-less federated learning approaches like gossip federated learning and blockchain-enabled federated learning have been proposed to mitigate these issues. In this work, we propose a complete overview of these three techniques proposing a comparison according to an integral set of performance indicators, including model accuracy, time complexity, communication overhead, convergence time, and energy consumption. An extensive simulation campaign permits to draw a quantitative analysis considering both feedforward and convolutional neural network models. Results show that gossip federated learning and standard federated solution are able to reach a similar level of accuracy, and their energy consumption is influenced by the machine learning model adopted, the software library, and the hardware used. Differently, blockchain-enabled federated learning represents a viable solution for implementing decentralized learning with a higher level of security, at the cost of an extra energy usage and data sharing. Finally, we identify open issues on the two decentralized federated learning implementations and provide insights on potential extensions and possible research directions in this new research field.

Decentralized Federated Learning: A Segmented Gossip Approach

Decentralized Federated Learning under Communication Delays.

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

Graph Federated Learning Based on the Decentralized Framework

A Graph Neural Network Based Decentralized Learning Scheme

BACombo-Bandwidth-Aware Decentralized Federated Learning

When Decentralized Optimization Meets Federated Learning

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

The Cost of Training Machine Learning Models over Distributed Data Sources

DeFed: A Principled Decentralized and Privacy-Preserving Federated Learning Algorithm

Decentralised Federated Learning with Adaptive Partial Gradient Aggregation

DeFed: A Principled Decentralized and Privacy-Preserving Federated Learning Algorithm.

GossipFL: A Decentralized Federated Learning Framework with Sparsified and Adaptive Communication

Privacy-Preserving and Reliable Decentralized Federated Learning

Learn Electronic Health Records by Fully Decentralized Federated Learning

A Blockchain Based Decentralized Gradient Aggregation Design for Federated Learning

Semi-Decentralized Federated Edge Learning with Data and Device Heterogeneity

Semi-Decentralized Federated Edge Learning for Fast Convergence on Non-IID Data

Decentralized Over-the-Air Federated Learning by Second-Order Optimization Method

Heterogeneous Federated Learning via Grouped Sequential-to-Parallel Training

Hierarchical Communication in Decentralized and Cross-Silo Federated Learning