Abstract:Federated learning benefits from cross-training strategies, which enables models to train on data from distinct sources to improve the generalization capability. However, the data heterogeneity between sources may lead models to gradually forget previously acquired knowledge when undergoing cross-training to adapt to new tasks or data sources. We argue that integrating personalized and global knowledge to gather information from multiple perspectives could potentially improve performance. To achieve this goal, this paper presents a novel approach that enhances federated learning through a cross-training scheme incorporating multi-view information. Specifically, the proposed method, termed FedCT, includes three main modules, where the consistency-aware knowledge broadcasting module aims to optimize model assignment strategies, which enhances collaborative advantages between clients and achieves an efficient federated learning process. The multi-view knowledge-guided representation learning module leverages fused prototypical knowledge from both global and local views to enhance the preservation of local knowledge before and after model exchange, as well as to ensure consistency between local and global knowledge. The mixup-based feature augmentation module aggregates rich information to further increase the diversity of feature spaces, which enables the model to better discriminate complex samples. Extensive experiments were conducted on four datasets in terms of performance comparison, ablation study, in-depth analysis and case study. The results demonstrated that FedCT alleviates knowledge forgetting from both local and global views, which enables it outperform state-of-the-art methods.

Efficient Federated Multi-view Learning

An Efficient Federated Multi-view Fuzzy C-Means Clustering Method

Bridging Gaps: Federated Multi-View Clustering in Heterogeneous Hybrid Views

HFedMTL: Hierarchical Federated Multi-Task Learning

FedMVT: Semi-supervised Vertical Federated Learning with MultiView Training.

Federated Deep Multi-View Clustering with Global Self-Supervision

Cross-Training with Multi-View Knowledge Fusion for Heterogenous Federated Learning

Federated Multi-view Learning for Private Medical Data Integration and Analysis

Active-Passive Federated Learning for Vertically Partitioned Multi-view Data

Joint Learning of Latent Similarity and Local Embedding for Multi-View Clustering

Multi-Model Federated Learning

Variational Federated Multi-Task Learning

FedCross: Towards Accurate Federated Learning via Multi-Model Cross-Aggregation

Federated Incomplete Multi-View Clustering with Heterogeneous Graph Neural Networks

Federated Learning Meets Multi-objective Optimization

Federated Multi-Task Learning under a Mixture of Distributions

Multimodal Federated Learning

FedCVT: Semi-supervised Vertical Federated Learning with Cross-view Training

Federated cross-view e-commerce recommendation based on feature rescaling

Multi-Dimensional Fair Federated Learning

MI-VFDNN: an Efficient Vertical Federated Deep Neural Network with Multi-layer Interaction