Abstract:The microservices architecture is extensively utilized in cloud-based application development, characterized by the construction of applications through a series of functionally independent, small, autonomous services. This architectural approach is renowned for its attributes such as high cohesion, availability, low coupling, and exceptional scalability. The detection of runtime system point anomalies in microservices architectures is crucial for enhancing the Quality of Service(QoS). Furthermore, identifying the classes of detected anomalies is critical in practical applications. However, given the highly dynamic nature of microservices systems as a distributed computing architecture, conducting real-time system anomaly detection on distributed independent microservices poses a challenging task. To address these challenges, we propose the System Anomaly Detection and Multi-Classification based on Multi-Task Feature Fusion Federated Learning (SADMC-MT-FF-FL) framework. Initially, we introduce a distributed learning framework based on Multi-task Federated Learning (MT-FL) to construct multi-classification anomaly detection models for each microservice. Secondly, to identify complex system anomaly patterns and features during the runtime of microservices, we develop a feature extractor based on External Attention Mechanism and Multi-channel Residual Structure (EA-MRS). Finally, we design a Local–Global Feature-based Parallel Knowledge Transfer (LGF-PKT) framework, utilizing parallel knowledge transfer to parallelize weight updates for local and global features. To validate the effectiveness of our approach, we conducted comprehensive comparative experiments on the microservices benchmark platforms Sock-Shop and Train-Ticket. The experimental results on anomaly detection for multiclassification systems demonstrate that SADMC-MT-FF-FL outperforms the best baseline method by 28.3% and 27.8% for Macro F1 and Micro F1 on Train-Ticket, and by 8.8% and 8.6% on Sock-Shop, respectively. Additionally, we conducted comparison experiments on three public datasets, SWaT, SMD, and SKAB. The F1 scores were 0.5% higher than those of the centralized methods on SMD, respectively, 6% and 2.8% higher than those of the federated learning based method on SWaT and SKAB. Source codes are available at: https://github.com/icc-lab-xhu1/SADMC-MT-FF-FL.

Privacy-preserving MTS anomaly detection for network devices through federated learning

Efficient Multivariate Time Series Anomaly Detection Through Transfer Learning for Large-Scale Web Services

Privacy-preserving Anomaly Detection in Cloud Manufacturing via Federated Transformer

Anomaly Detection through Unsupervised Federated Learning

Deep Federated Anomaly Detection for Multivariate Time Series Data

PeFAD: A Parameter-Efficient Federated Framework for Time Series Anomaly Detection

Privacy-Preserving Financial Anomaly Detection via Federated Learning & Multi-Party Computation

FADngs: Federated Learning for Anomaly Detection.

Deep Anomaly Detection for Time-Series Data in Industrial IoT: A Communication-Efficient On-Device Federated Learning Approach

Network Anomaly Detection Using Federated Learning

Model and Feature Aggregation Based Federated Learning for Multi-sensor Time Series Trend Following.

FedAvg-P: Performance-Based Hierarchical Federated Learning-Based Anomaly Detection System Aggregation Strategy for Advanced Metering Infrastructure

Toward data efficient anomaly detection in heterogeneous edge-cloud environments using clustered federated learning

Personalized Federated Learning for Goods Classification in Wireless Sensor-Assisted Smart Warehouses

Unsupervised anomalies detection in IIoT edge devices networks using federated learning

Privacy-Preserving Federated Learning over Vertically and Horizontally Partitioned Data for Financial Anomaly Detection

Achieving Privacy-Preserving Cross-Silo Anomaly Detection Using Federated XGBoost

FL-MGVN: Federated learning for anomaly detection using mixed gaussian variational self-encoding network

A federated learning privacy framework for missing data inference in environmental crowd sensing

APFed: Adaptive personalized federated learning for intrusion detection in maritime meteorological sensor networks

Multi-task federated learning-based system anomaly detection and multi-classification for microservices architecture