Abstract:Automated log analysis is crucial in modern software-intensive systems for facilitating program comprehension throughout software maintenance and engineering life cycles. Existing methods perform tasks such as log parsing and log anomaly detection by providing a single prediction value without interpretation. However, given the increasing volume of system events, the limited interpretability of analysis results hinders analysts' comprehension of program status and their ability to take appropriate actions. Moreover, these methods require substantial in-domain training data, and their performance declines sharply (by up to 62.5%) in online scenarios involving unseen logs from new domains, a common occurrence due to rapid software updates. In this paper, we propose LogPrompt, a novel interpretable log analysis approach for online scenarios. LogPrompt employs large language models (LLMs) to perform online log analysis tasks via a suite of advanced prompt strategies tailored for log tasks, which enhances LLMs' performance by up to 380.7% compared with simple prompts. Experiments on nine publicly available evaluation datasets across two tasks demonstrate that LogPrompt, despite requiring no in-domain training, outperforms existing approaches trained on thousands of logs by up to 55.9%. We also conduct a human evaluation of LogPrompt's interpretability, with six practitioners possessing over 10 years of experience, who highly rated the generated content in terms of usefulness and readability (averagely 4.42/5). LogPrompt also exhibits remarkable compatibility with open-source and smaller-scale LLMs, making it flexible for practical deployment. Code of LogPrompt is available at <a class="link-external link-https" href="https://github.com/lunyiliu/LogPrompt" rel="external noopener nofollow">this https URL</a>.

Large language models and unsupervised feature learning: implications for log analysis

LogLLM: Log-based Anomaly Detection Using Large Language Models

Benchmarking Large Language Models for Log Analysis, Security, and Interpretation

Adapting Large Language Models to Log Analysis with Interpretable Domain Knowledge

High-precision Online Log Parsing with Large Language Models

LLMeLog: an Approach for Anomaly Detection Based on LLM-enriched Log Events

Large Language Models for Forecasting and Anomaly Detection: A Systematic Literature Review

Using Large Language Models for Interpreting Autonomous Robots Behaviors

LLMParser: An Exploratory Study on Using Large Language Models for Log Parsing

Anomaly Detection on Unstable Logs with GPT Models

LogEval: A Comprehensive Benchmark Suite for Large Language Models In Log Analysis

LogParser-LLM: Advancing Efficient Log Parsing with Large Language Models

Anomaly Detection Model for Log Based on LSTM Network and Variational Autoencoder

A LSTM-Based Anomaly Detection Model for Log Analysis

Revisited Large Language Model for Time Series Analysis through Modality Alignment

Exploring Large Language Models for Feature Selection: A Data-centric Perspective

Interpretable Online Log Analysis Using Large Language Models with Prompt Strategies

Biglog: Unsupervised Large-scale Pre-training for a Unified Log Representation

Studying and Benchmarking Large Language Models For Log Level Suggestion

Deep Learning for Anomaly Detection in Log Data: A Survey