Abstract:E-health allows smart devices and medical institutions to collaboratively collect patients' data, which is trained by Artificial Intelligence (AI) technologies to help doctors make diagnosis. By allowing multiple devices to train models collaboratively, federated learning is a promising solution to address the communication and privacy issues in e-health. However, applying federated learning in e-health faces many challenges. First, medical data is both horizontally and vertically partitioned. Since single Horizontal Federated Learning (HFL) or Vertical Federated Learning (VFL) techniques cannot deal with both types of data partitioning, directly applying them may consume excessive communication cost due to transmitting a part of raw data when requiring high modeling accuracy. Second, a naive combination of HFL and VFL has limitations including low training efficiency, unsound convergence analysis, and lack of parameter tuning strategies. In this paper, we provide a thorough study on an effective integration of HFL and VFL, to achieve communication efficiency and overcome the above limitations when data is both horizontally and vertically partitioned. Specifically, we propose a hybrid federated learning framework with one intermediate result exchange and two aggregation phases. Based on this framework, we develop a Hybrid Stochastic Gradient Descent (HSGD) algorithm to train models. Then, we theoretically analyze the convergence upper bound of the proposed algorithm. Using the convergence results, we design adaptive strategies to adjust the training parameters and shrink the size of transmitted data. Experimental results validate that the proposed HSGD algorithm can achieve the desired accuracy while reducing communication cost, and they also verify the effectiveness of the adaptive strategies.

Hybrid learning based on Fisher linear discriminant

Adaptive Quasiconformal Kernel Fisher Discriminant Analysis Via Weighted Maximum Margin Criterion

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

Approximately optimal domain adaptation with Fisher's Linear Discriminant

Federated Virtual Learning on Heterogeneous Data with Local-global Distillation

A Hybrid Self-Supervised Learning Framework for Vertical Federated Learning

Hybrid learning framework for web information retrieval

Fisher Information-based Efficient Curriculum Federated Learning with Large Language Models

Accelerating Hybrid Federated Learning Convergence under Partial Participation

Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning

Communication-Efficient Hybrid Federated Learning for E-health with Horizontal and Vertical Data Partitioning

Dataset Distillation-based Hybrid Federated Learning on Non-IID Data

Federated Mutual Learning: a Collaborative Machine Learning Method for Heterogeneous Data, Models, and Objectives

Effective and Efficient Federated Tree Learning on Hybrid Data

HSFL: an Efficient Split Federated Learning Framework Via Hierarchical Organization.

Local Fisher Discriminant Analysis with Locally Linear Embedding Affinity Matrix

FedFisher: Leveraging Fisher Information for One-Shot Federated Learning

A New Locally Linear KNN Method with an Improved Marginal Fisher Analysis for Image Classification

Completely Heterogeneous Federated Learning

Accelerating Federated Learning by Selecting Beneficial Herd of Local Gradients