Abstract:The microservices architecture is extensively utilized in cloud-based application development, characterized by the construction of applications through a series of functionally independent, small, autonomous services. This architectural approach is renowned for its attributes such as high cohesion, availability, low coupling, and exceptional scalability. The detection of runtime system point anomalies in microservices architectures is crucial for enhancing the Quality of Service(QoS). Furthermore, identifying the classes of detected anomalies is critical in practical applications. However, given the highly dynamic nature of microservices systems as a distributed computing architecture, conducting real-time system anomaly detection on distributed independent microservices poses a challenging task. To address these challenges, we propose the System Anomaly Detection and Multi-Classification based on Multi-Task Feature Fusion Federated Learning (SADMC-MT-FF-FL) framework. Initially, we introduce a distributed learning framework based on Multi-task Federated Learning (MT-FL) to construct multi-classification anomaly detection models for each microservice. Secondly, to identify complex system anomaly patterns and features during the runtime of microservices, we develop a feature extractor based on External Attention Mechanism and Multi-channel Residual Structure (EA-MRS). Finally, we design a Local–Global Feature-based Parallel Knowledge Transfer (LGF-PKT) framework, utilizing parallel knowledge transfer to parallelize weight updates for local and global features. To validate the effectiveness of our approach, we conducted comprehensive comparative experiments on the microservices benchmark platforms Sock-Shop and Train-Ticket. The experimental results on anomaly detection for multiclassification systems demonstrate that SADMC-MT-FF-FL outperforms the best baseline method by 28.3% and 27.8% for Macro F1 and Micro F1 on Train-Ticket, and by 8.8% and 8.6% on Sock-Shop, respectively. Additionally, we conducted comparison experiments on three public datasets, SWaT, SMD, and SKAB. The F1 scores were 0.5% higher than those of the centralized methods on SMD, respectively, 6% and 2.8% higher than those of the federated learning based method on SWaT and SKAB. Source codes are available at: https://github.com/icc-lab-xhu1/SADMC-MT-FF-FL.

Multilayered Fault Detection and Localization With Transformer for Microservice Systems

A Novel Multi-Scale Neural Transformation Graph Method for Micro-Service System Fault Multi-Classification

MTG_CD: Multi-scale Learnable Transformation Graph for Fault Classification and Diagnosis in Microservices

An effective parallel convolutional anomaly multi-classification model for fault diagnosis in microservice system

Fault Localization for Microservice Applications with System Logs and Monitoring Metrics

Fault Diagnosis for Test Alarms in Microservices Through Multi-source Data

Multi-task federated learning-based system anomaly detection and multi-classification for microservices architecture

Fault Detection from A Large Perspective with Transformers

ModelCoder: A Fault Model based Automatic Root Cause Localization Framework for Microservice Systems

Robust Failure Diagnosis of Microservice System through Multimodal Data

Adaptive Diagnosis for Transformer With Unknown Faults Based on Antenna-Augmented RFID Sensor and Deep Learning

Localizing Failure Root Causes in a Microservice through Causality Inference

LiteFormer: A Lightweight and Efficient Transformer for Rotating Machine Fault Diagnosis

MicroHECL: High-Efficient Root Cause Localization in Large-Scale Microservice Systems

A novel multi-scale network intrusion detection model with transformer

Microservice Anomaly Detection Based on Tracing Data Using Semi-supervised Learning

No More Data Silos: Unified Microservice Failure Diagnosis with Temporal Knowledge Graph

Efficiently Localizing System Anomalies for Cloud Infrastructures: a Novel Dynamic Graph Transformer Based Parallel Framework

Self-Adaptive Root Cause Diagnosis for Large-Scale Microservice Architecture

An Improved Method for Detecting Crane Wheel–Rail Faults Based on YOLOv8 and the Swin Transformer

Few-Shot Cross-System Anomaly Trace Classification for Microservice-based systems