Abstract:Real-time machine learning (ML) has recently attracted significant interest due to its potential to support instantaneous learning, adaptation, and decision making in a wide range of application domains, including self-driving vehicles, intelligent transportation, and industry automation. In this paper, we investigate real-time ML in a federated edge intelligence (FEI) system, an edge computing system that implements federated learning (FL) solutions based on data samples collected and uploaded from decentralized data networks, e.g., Internet-of-Things (IoT) and/or wireless sensor networks. FEI systems often exhibit heterogenous communication and computational resource distribution, as well as non-i.i.d. data samples arrived at different edge servers, resulting in long model training time and inefficient resource utilization. Motivated by this fact, we propose a time-sensitive federated learning (TS-FL) framework to minimize the overall run-time for collaboratively training a shared ML model with desirable accuracy. Training acceleration solutions for both TS-FL with synchronous coordination (TS-FL-SC) and asynchronous coordination (TS-FL-ASC) are investigated. To address the straggler effect in TS-FL-SC, we develop an analytical solution to characterize the impact of selecting different subsets of edge servers on the overall model training time. A server dropping-based solution is proposed to allow some slow-performance edge servers to be removed from participating in the model training if their impact on the resulting model accuracy is limited. A joint optimization algorithm is proposed to minimize the overall time consumption of model training by selecting participating edge servers, the local epoch number (the number of model training iterations per coordination), and the data batch size (the number of data samples for each model training iteration). Motivated by the fact that data samples at the slowest edge server may exhibit special characteristics that cannot be removed from model training, we develop an analytical expression to characterize the impact of both staleness effect of asynchronous coordination and straggler effect of FL on the time consumption of TS-FL-ASC. We propose a load forwarding-based solution that allows a slow edge server to offload part of its training samples to trusted edge servers with higher processing capability. We develop a hardware prototype to evaluate the model training time of a heterogeneous FEI system. Experimental results show that our proposed TS-FL-SC and TS-FL-ASC can provide up to 63% and 28% of reduction, in the overall model training time, respectively, compared with traditional FL solutions.

Cloud-Edge Test-Time Adaptation for Cross-Domain Online Machinery Fault Diagnosis via Customized Contrastive Learning

Fault Diagnosis of Blast Furnace Based on Incomplete Multi-Source Domain Adaptation with Feature Fusion

Cloud-edge collaborative transfer fault diagnosis of rotating machinery via federated fine-tuning and target self-adaptation

MLFA: Toward Realistic Test Time Adaptive Object Detection by Multi-Level Feature Alignment

A deep targeted transfer network with clustering pseudo-label learning for fault diagnosis across different Machines

Deep Contrastive Transfer Learning for Rotating Machinery Fault Diagnosis

Efficient federated learning for fault diagnosis in industrial cloud-edge computing

Cross-Task Fault Diagnosis Based on Deep Domain Adaptation with Local Feature Learning.

Domain Adaptation-based Edge Computing for Cross-Conditions Fault Diagnosis

Deep Targeted Transfer Learning Along Designable Adaptation Trajectory for Fault Diagnosis Across Different Machines

Time-varying Online Transfer Learning for Intelligent Bearing Fault Diagnosis with Incomplete Unlabeled Target Data

Domain Adaptation for Intelligent Fault Diagnosis under Different Working Conditions

Alignment subdomain-based deep convolutional transfer learning for machinery fault diagnosis under different working conditions

Learn Then Adapt: A Novel Test-Time Adaptation Method for Cross-Domain Fault Diagnosis of Rolling Bearings

Time-sensitive Learning for Heterogeneous Federated Edge Intelligence

Augmentation-based discriminative meta-learning for cross-machine few-shot fault diagnosis

Domain Discrepancy-guided Contrastive Feature Learning for Few-shot Industrial Fault Diagnosis under Variable Working Conditions

ECLM: Efficient Edge-Cloud Collaborative Learning with Continuous Environment Adaptation

Cross-Machine Fault Diagnosis with Semi-Supervised Discriminative Adversarial Domain Adaptation

EdgeFD: An Edge-Friendly Drift-Aware Fault Diagnosis System for Industrial IoT

Joint adaptive transfer learning network for cross-domain fault diagnosis based on multi-layer feature fusion