Abstract:With the widespread use of cloud-native architecture, increasing web applications (apps) choose to build on microservices. Simultaneously, troubleshooting becomes full of challenges owing to the high dynamics and complexity of anomaly propagation. Existing diagnostic methods rely heavily on monitoring metrics collected from the kernel side of microservice systems. Without a comprehensive monitoring infrastructure, application owners and even cloud operators cannot resort to these kernel-space solutions. This paper summarizes several insights on operating a top commercial cloud platform. Then, for the first time, we put forward the idea of user-space diagnosis for microservice kernel failures. To this end, we develop a crowdsourcing solution - DyCause, to resolve the asymmetric diagnostic information problem. DyCause deploys on the application side in a distributed manner. Through lightweight API log sharing, apps collect the operational status of kernel services collaboratively and initiate diagnosis on demand. Deploying DyCause is fast and lightweight as we do not have any architectural and functional requirements for the kernel. To reveal more accurate correlations from asymmetric diagnostic information, we design a novel statistical algorithm that can efficiently discover the time-varying causalities between services. This algorithm also helps us build the temporal order of the anomaly propagation. Therefore, by using DyCause, we can obtain more in-depth and interpretable diagnostic clues with limited indicators. We apply and evaluate DyCause on both a simulated test-bed and a real-world cloud system. Experimental results verify that DyCause running in the user-space outperforms several state-of-the-art algorithms running in the kernel on accuracy. Besides, DyCause shows superior advantages in terms of algorithmic efficiency and data sensitivity. Simply put, DyCause produces a significantly better result than other baselines when analyzing much fewer or sparser metrics. To conclude, DyCause is faster to act, deeper in analysis, and easier to deploy.

DyCause: Crowdsourcing to Diagnose Microservice Kernel Failure

Faster, Deeper, Easier: Crowdsourcing Diagnosis of Microservice Kernel Failure from User Space

G-Cause: Parameter-free Global Diagnosis for Hyperscale Web Service Infrastructures

MicroHECL: High-Efficient Root Cause Localization in Large-Scale Microservice Systems

Look Deep into the Microservice System Anomaly Through Very Sparse Logs

Self-Adaptive Root Cause Diagnosis for Large-Scale Microservice Architecture

Localizing Failure Root Causes in a Microservice through Causality Inference

CauseInfer: Automated End-to-End Performance Diagnosis with Hierarchical Causality Graph in Cloud Environment

Root Cause Localization for Microservice Systems in Cloud-edge Collaborative Environments

An effective parallel convolutional anomaly multi-classification model for fault diagnosis in microservice system

AutoMAP: Diagnose Your Microservice-based Web Applications Automatically.

Root-Cause Metric Location for Microservice Systems Via Log Anomaly Detection

No More Data Silos: Unified Microservice Failure Diagnosis with Temporal Knowledge Graph

Failure Diagnosis in Microservice Systems: A Comprehensive Survey and Analysis

A Causality Mining and Knowledge Graph Based Method of Root Cause Diagnosis for Performance Anomaly in Cloud Applications

Robust Failure Diagnosis of Microservice System through Multimodal Data

Root Cause Analysis for Microservice System based on Causal Inference: How Far Are We?

Diagnosing Performance Issues in Microservices with Heterogeneous Data Source

Anomaly Detection and Failure Root Cause Analysis in (Micro)Service-Based Cloud Applications: A Survey

MS-Rank: Multi-Metric and Self-Adaptive Root Cause Diagnosis for Microservice Applications

Fault Diagnosis for Test Alarms in Microservices Through Multi-source Data