Abstract:Logs are imperative in the maintenance of online service systems, which often encompass important information for effective failure mitigation. While existing anomaly detection methodologies facilitate the identification of anomalous logs within extensive runtime data, manual investigation of log messages by engineers remains essential to comprehend faults, which is labor-intensive and error-prone. Upon examining the log-based troubleshooting practices at CloudA, we find that engineers typically prioritize two categories of log information for diagnosis. These include fault-indicating descriptions, which record abnormal system events, and fault-indicating parameters, which specify the associated entities. Motivated by this finding, we propose an approach to automatically extract such faultindicating information from logs for fault diagnosis, named LoFI. LoFI comprises two key stages. In the first stage, LoFI performs coarse-grained filtering to collect logs related to the faults based on semantic similarity. In the second stage, LoFI leverages a pre-trained language model with a novel prompt-based tuning method to extract fine-grained information of interest from the collected logs. We evaluate LoFI on logs collected from Apache Spark and an industrial dataset from CloudA. The experimental results demonstrate that LoFI outperforms all baseline methods by a significant margin, achieving an absolute improvement of 25.8~37.9 in F1 over the best baseline method, ChatGPT. This highlights the effectiveness of LoFI in recognizing fault-indicating information. Furthermore, the successful deployment of LoFI at CloudA and user studies validate the utility of our method. The code and data are available at <a class="link-external link-https" href="https://github.com/Jun-jie-Huang/LoFI" rel="external noopener nofollow">this https URL</a>.

Machine Deserves Better Logging: A Log Enhancement Approach for Automatic Fault Diagnosis

Brief Announcement: Automatic Log Enhancement for Fault Diagnosis.

AutoLog: facing log redundancy and insufficiency

Fault Diagnosis Method Based on Improved Deep Boltzmann Machines

Automated Defects Detection and Fix in Logging Statement

Uilog: Improving Log-Based Fault Diagnosis by Log Analysis

Improving Log-Based Fault Diagnosis by Log Classification.

SMARTLOG: Place Error Log Statement by Deep Understanding of Log Intention

Intention-aware Log Automation

Demystifying and Extracting Fault-indicating Information from Logs for Failure Diagnosis

Survey on Log Research of Large Scale Software System

Learning to log: helping developers make informed logging decisions

Augmenting Log-based Anomaly Detection Models to Reduce False Anomalies with Human Feedback

NotOnlyLog: Mining Patch-Log Associations from Software Evolution History to Enhance Failure Diagnosis Capability

A Survey on Automated Log Analysis for Reliability Engineering

Feedback-Aware Anomaly Detection Through Logs for Large-Scale Software Systems

Improving Log-Based Anomaly Detection with Component-Aware Analysis

Two-stage Attention Network for Fault Diagnosis and Retrieval of Fault Logs

An Intelligent Fault Diagnosis Method Using Unsupervised Feature Learning Towards Mechanical Big Data

Intelligent Fault-Diagnosis System for Acoustic Logging Tool Based on Multi-Technology Fusion

Logtracker