Abstract:The core of federated learning (FL) is to transfer data diversity and distribution knowledge of cross-client domains. Although adopted by most FL methods, model-sharing-based communication has limitations such as unstable optimization and lack of reasonable explanation. In this paper, we propose an innovative approach that exploits a highly abstract local compact representation (LCR) as a communication carrier, paving a new feasible path for FL. LCR is not only more intuitive for multiclient joint training but also insensitive to local privacy, particularly in computer vision tasks. The proposed LCR communication-based FL framework aims to improve performance, mitigate negative transfer, and enhance optimization stability. First, based on the domain adaptation theorem, in-depth theoretical proofs guarantee the contribution of representation communication from other domains, which may lead to a tighter generalization error bound of the local domain. Second, inspired by metric learning, a federated version of the triplet (FedTriplet) loss and distribution similarity reweighting aggregation are proposed to fully digest LCR from other clients and realize the LCRC-based FL framework with better explanations. Cross-client FedTriplet transferring redresses the category boundaries in local latent space, resisting overfitting. The modified Wasserstein distance is employed for reweighting aggregation to overcome the negative transfer problem caused by non-i.i.d. factors. Finally, extensive experiments on MNIST/EMNIST and successful iris recognition applications demonstrate that the proposed LCRC framework is superior in terms of accuracy compared to mainstream model-sharing-based FL methods. The visualization results also show significant improvements in the distinguishability of the representation distribution.

Federated Learning Communication-Efficiency Framework Via Corset Construction.

FLCP: federated learning framework with communication-efficient and privacy-preserving

Communication-Efficient Federated Learning in Channel Constrained Internet of Things

Efficient Model Compression for Hierarchical Federated Learning

Asynchronous Federated Learning over Wireless Communication Networks.

Communication-Efficient Model Aggregation with Layer Divergence Feedback in Federated Learning

Communication-Efficient Federated Learning with Adaptive Compression under Dynamic Bandwidth

Conquering the Communication Constraints to Enable Large Pre-Trained Models in Federated Learning

Efficient and Less Centralized Federated Learning

Federated Learning over Wireless IoT Networks with Optimized Communication and Resources

Efficient Model Compression via Global Sparsification for Over-the-Air Federated Learning.

A Communication Efficient Vertical Federated Learning Framework.

Towards Client Driven Federated Learning

Federated Local Compact Representation Communication: Framework and Application

A Communication-Efficient Hierarchical Federated Learning Framework via Shaping Data Distribution at Edge

Communication Efficient Federated Learning With Heterogeneous Structured Client Models

Computation and Communication Efficient Federated Learning With Adaptive Model Pruning

Federated Learning via Indirect Server-Client Communications

A Joint Learning and Communications Framework for Federated Learning over Wireless Networks

FedDCT: A Dynamic Cross-Tier Federated Learning Framework in Wireless Networks

Communication-Efficient Federated Learning over Capacity-Limited Wireless Networks