Abstract:Federated Learning (FL) aims to establish a shared model across decentralized clients under the privacy-preserving constraint. Each client learns an independent model with local data, and only model's updates are communicated. However, since the FL model typically employs computation-intensive neural networks, major challenges in Federated Learning are (i) significant computation overhead for local training; (ii) massive communication overhead arises from the model updates; (iii) notable performance degradation caused by the non-IID scenario. In this work, we propose HyperFeel, an efficient framework for federated learning based on Hyper-Dimensional Computing (HDC), that can significantly improve communication/storage efficiency over existing works with nearly no performance degradation. Unlike current solutions that employ neural networks as the learning models, HyperFeel introduces a simple yet effective computing paradigm using hyperdimensional vectors to encode and represent data. It performs concise and highly parallel operations for encryption, computation, and communication, taking advantage of the lightweight feature representation of hyperdimensional vectors. To further enhance HyperFeel performance, we propose a two-fold optimization scheme combining the characteristics of encoding and updating in hyper-dimensional computing. On one hand, we design a personalized update strategy for client models based on HDC, which achieves better accuracy on non-IID data. On the other hand, we extend the framework from horizontal FL to vertical FL based on a shared encoding mechanism. Comprehensive experimental results demonstrate that our method consistently outperforms the stateof-the-art FL models. HyperFeel achieves 26x storage reduction and up to 81x communication reduction over FedAvg, with minimal accuracy drops on FEMNIST and Synthetic.

HyperFeel: an Efficient Federated Learning Framework Using Hyperdimensional Computing

On Hyperdimensional Computing-based Federated Learning: A Case Study.

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

Hyperdimensional Computing Empowered Federated Foundation Model over Wireless Networks for Metaverse

HyperFedNet: Communication-Efficient Personalized Federated Learning Via Hypernetwork

HQsFL: A Novel Training Strategy for Constructing High-performance and Quantum-safe Federated Learning

HyperFed: Hyperbolic Prototypes Exploration with Consistent Aggregation for Non-IID Data in Federated Learning

Efficient Model Compression for Hierarchical Federated Learning

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Privacy-Preserving Federated Learning with Differentially Private Hyperdimensional Computing

A Communication-Efficient Hierarchical Federated Learning Framework via Shaping Data Distribution at Edge

Resource-Efficient Federated Hyperdimensional Computing

HSFL: an Efficient Split Federated Learning Framework Via Hierarchical Organization.

Dynamic and Fast Convergence for Federated Learning Via Optimized Hyperparameters

Privacy Vs. Efficiency: Achieving Both Through Adaptive Hierarchical Federated Learning

Sparse Federated Learning with Hierarchical Personalization Models.

Memory-adaptive Depth-wise Heterogenous Federated Learning

Optimizing Hierarchical Federated Learning: A Reinforcement Learning Approach

EHFL: Efficient Horizontal Federated Learning with Privacy Protection and Verifiable Aggregation

HDHRFL: A Hierarchical Robust Federated Learning Framework for Dual-Heterogeneous and Noisy Clients

Hierarchical and Decentralised Federated Learning