Abstract:The microservices architecture is extensively utilized in cloud-based application development, characterized by the construction of applications through a series of functionally independent, small, autonomous services. This architectural approach is renowned for its attributes such as high cohesion, availability, low coupling, and exceptional scalability. The detection of runtime system point anomalies in microservices architectures is crucial for enhancing the Quality of Service(QoS). Furthermore, identifying the classes of detected anomalies is critical in practical applications. However, given the highly dynamic nature of microservices systems as a distributed computing architecture, conducting real-time system anomaly detection on distributed independent microservices poses a challenging task. To address these challenges, we propose the System Anomaly Detection and Multi-Classification based on Multi-Task Feature Fusion Federated Learning (SADMC-MT-FF-FL) framework. Initially, we introduce a distributed learning framework based on Multi-task Federated Learning (MT-FL) to construct multi-classification anomaly detection models for each microservice. Secondly, to identify complex system anomaly patterns and features during the runtime of microservices, we develop a feature extractor based on External Attention Mechanism and Multi-channel Residual Structure (EA-MRS). Finally, we design a Local–Global Feature-based Parallel Knowledge Transfer (LGF-PKT) framework, utilizing parallel knowledge transfer to parallelize weight updates for local and global features. To validate the effectiveness of our approach, we conducted comprehensive comparative experiments on the microservices benchmark platforms Sock-Shop and Train-Ticket. The experimental results on anomaly detection for multiclassification systems demonstrate that SADMC-MT-FF-FL outperforms the best baseline method by 28.3% and 27.8% for Macro F1 and Micro F1 on Train-Ticket, and by 8.8% and 8.6% on Sock-Shop, respectively. Additionally, we conducted comparison experiments on three public datasets, SWaT, SMD, and SKAB. The F1 scores were 0.5% higher than those of the centralized methods on SMD, respectively, 6% and 2.8% higher than those of the federated learning based method on SWaT and SKAB. Source codes are available at: https://github.com/icc-lab-xhu1/SADMC-MT-FF-FL.

A Fault Diagnosis Method for Microservices Based on Multi-Factor Self-Adaptive Heartbeat Detection Algorithm

Fault Diagnosis for Test Alarms in Microservices Through Multi-source Data

Approach to Anomaly Detection in Microservice System with Multi-Source Data Streams

Diagnosing Performance Issues in Microservices with Heterogeneous Data Source

MS-Rank: Multi-Metric and Self-Adaptive Root Cause Diagnosis for Microservice Applications

Failure Diagnosis in Microservice Systems: A Comprehensive Survey and Analysis

Self-Adaptive Root Cause Diagnosis for Large-Scale Microservice Architecture

AutoMAP: Diagnose Your Microservice-based Web Applications Automatically.

Self-adaptive Failure Detector for Peer-to-Peer Distributed System Considering the Link Faults

An effective parallel convolutional anomaly multi-classification model for fault diagnosis in microservice system

Research on Microservice Anomaly Detection Technology Based on Conditional Random Field

Developing Self-Adaptive Microservice Systems: Challenges and Directions

Multi-task federated learning-based system anomaly detection and multi-classification for microservices architecture

Robust Failure Diagnosis of Microservice System through Multimodal Data

Multilayered Fault Detection and Localization With Transformer for Microservice Systems

Fault Localization for Microservice Applications with System Logs and Monitoring Metrics

Anomaly Detection and Diagnosis for Container-based Microservices with Performance Monitoring

Self-Diagnosis for Detecting System Failures in Large-Scale Wireless Sensor Networks.

An Anomaly Detection Algorithm for Microservice Architecture Based on Robust Principal Component Analysis

No More Data Silos: Unified Microservice Failure Diagnosis with Temporal Knowledge Graph

Fault Analysis and Debugging of Microservice Systems: Industrial Survey, Benchmark System, and Empirical Study