Advances and Challenges in Log Analysis

Adam Oliner,Archana Ganapathi,Wei Xu

DOI: https://doi.org/10.1145/2076450.2076466

IF: 22.7

2012-01-01

Communications of the ACM

Abstract:Logs contain a wealth of information to help manage systems.

What problem does this paper attempt to address?

Online Log Data Analysis With Efficient Machine Learning: A Review

Florian Skopik,Max Landauer,Markus Wurzenberger

DOI: https://doi.org/10.1109/msec.2021.3113275

2021-01-01

Abstract:Logs are incrementally produced textual data that reflect events and their impact on technical systems. Their efficient analysis is key for operational cybersecurity. We investigate approaches beyond applying simple regular expressions and provide insights into novel machine learning mechanisms for parsing and analyzing log data for online anomaly detection.

computer science, information systems, software engineering
A Survey on Automated Log Analysis for Reliability Engineering

Shilin He,Pinjia He,Zhuangbin Chen,Tianyi Yang,Yuxin Su,Michael R. Lyu

DOI: https://doi.org/10.1145/3460345

IF: 16.6

2021-07-01

ACM Computing Surveys

Abstract:Logs are semi-structured text generated by logging statements in software source code. In recent decades, software logs have become imperative in the reliability assurance mechanism of many software systems, because they are often the only data available that record software runtime information. As modern software is evolving into a large scale, the volume of logs has increased rapidly. To enable effective and efficient usage of modern software logs in reliability engineering, a number of studies have been conducted on automated log analysis. This survey presents a detailed overview of automated log analysis research, including how to automate and assist the writing of logging statements, how to compress logs, how to parse logs into structured event templates, and how to employ logs to detect anomalies, predict failures, and facilitate diagnosis. Additionally, we survey work that releases open-source toolkits and datasets. Based on the discussion of the recent advances, we present several promising future directions toward real-world and next-generation automated log analysis.

computer science, theory & methods
Landscape of Automated Log Analysis: A Systematic Literature Review and Mapping Study

Łukasz Korzeniowski,Krzysztof Goczyła,Lukasz Korzeniowski,Krzysztof Goczyla

DOI: https://doi.org/10.1109/access.2022.3152549

IF: 3.9

2022-01-01

IEEE Access

Abstract:Logging is a common practice in software engineering to provide insights into working systems. The main uses of log files have always been failure identification and root cause analysis. In recent years, novel applications of logging have emerged that benefit from automated analysis of log files, for example, real-time monitoring of system health, understanding users' behavior, and extracting domain knowledge. Although nearly every software system produces log files, the biggest challenge in log analysis is the lack of a common standard for both the content and format of log data. This paper provides a systematic review of recent literature (covering the period between 2000 and June 2021, concentrating primarily on the last five years of this period) related to automated log analysis. Our contribution is three-fold: we present an overview of various research areas in the field; we identify different types of log files that are used in research, and we systematize the content of log files. We believe that this paper serves as a valuable starting point for new researchers in the field, as well as an interesting overview for those looking for other ways of utilizing log information.

computer science, information systems,telecommunications,engineering, electrical & electronic
Finding Needles in the Haystack: Harnessing Syslogs for Data Center Management

Chen Liang,Theophilus Benson,Partha Kanuparthy,Yihua He

DOI: https://doi.org/10.48550/arXiv.1605.06150

2016-05-20

Abstract:Network device syslogs are ubiquitous and abundant in modern data centers with most large data centers producing millions of messages per day. Yet, the operational information reflected in syslogs and their implications on diagnosis or management tasks are poorly understood. Prevalent approaches to understanding syslogs focus on simple correlation and abnormality detection and are often limited to detection providing little insight towards diagnosis and resolution. Towards improving data center operations, we propose and implement Log-Prophet, a system that applies a toolbox of statistical techniques and domain-specific models to mine detailed diagnoses. Log-Prophet infers causal relationships between syslog lines and constructs succinct but valuable problem graphs, summarizing root causes and their locality, including cascading problems. We validate Log-Prophet using problem tickets and through operator interviews. To demonstrate the strength of Log-Prophet, we perform an initial longitudinal study of a large online service provider's data center. Our study demonstrates that Log-Prophet significantly reduces the number of alerts while highlighting interesting operational issues.

Networking and Internet Architecture
On Vulnerability and Security Log analysis: A Systematic Literature Review on Recent Trends

Brooklynn Stone,T. Cerný,Connor Woodahl,Karel Frajták,Miroslav Bures,Pavel Tisnovsky,John E. Raffety,J. Svacina,Dongwan Shin

DOI: https://doi.org/10.1145/3400286.3418261

2020-10-13

Abstract:Log analysis is a technique of deriving knowledge from log files containing records of events in a computer system. A common application of log analysis is to derive critical information about a system's security issues and intrusions, which subsequently leads to being able to identify and potentially stop intruders attacking the system. However, many systems produce a high volume of log data with high frequency, posing serious challenges in analysis. This paper contributes with a systematic literature review and discusses current trends, advancements, and future directions in log security analysis within the past decade. We summarized current research strategies with respect to technology approaches from 34 current publications. We identified limitations that poses challenges to future research and opened discussion on issues towards logging mechanism in the software systems. Findings of this study are relevant for software systems as well as software parts of the Internet of Things (IoT) systems.

Computer Science,Engineering
LogAssist: Assisting Log Analysis Through Log Summarization

Steven Locke,Heng Li,Tse-Hsun Peter Chen,Weiyi Shang,Wei Liu

DOI: https://doi.org/10.1109/tse.2021.3083715

IF: 7.4

2021-01-01

IEEE Transactions on Software Engineering

Abstract:Logs contain valuable information about the runtime behaviors of software systems. Thus, practitioners rely on logs for various tasks such as debugging, system comprehension, and anomaly detection. However, logs are difficult to analyze due to their unstructured nature and large size. In this paper, we propose a novel approach called LogAssist that assists practitioners with log analysis. LogAssist provides an organized and concise view of logs by first grouping logs into event sequences (i.e., workflows), which better illustrate the system runtime execution paths. Then, LogAssist compresses the log events in workflows by hiding consecutive events and applying n-gram modeling to identify common event sequences. We evaluated LogAssist on logs generated by one enterprise and two open source systems. We find that LogAssist can reduce the number of log events that practitioners need to investigate by up to 99 percent. Through a user study with 19 participants, we find that LogAssist can assist practitioners by reducing the time required for log analysis tasks by an average of 40 percent. The participants also rated LogAssist an average of 4.53 out of 5 for improving their experiences of performing log analysis. Finally, we document our experiences and lessons learned from developing and adopting LogAssist in practice. We believe that LogAssist and our reported experiences may lay the basis for future analysis and interactive exploration on logs.

engineering, electrical & electronic,computer science, software engineering
Machine Deserves Better Logging: A Log Enhancement Approach for Automatic Fault Diagnosis

Tong Jia,Ying Li,Chengbo Zhang,Wensheng Xia,Jie Jiang,Yuhong Liu

DOI: https://doi.org/10.1109/issrew.2018.00-22

2018-01-01

Abstract:When systems fail, log data is often the most important information source for fault diagnosis. However, the performance of automatic fault diagnosis is limited by the ad-hoc nature of logs. The key problem is that existing developer-written logs are designed for humans rather than machines to automatically detect system anomalies. To improve the quality of logs for fault diagnosis, we propose a novel log enhancement approach which automatically identifies logging points that reflect anomalous behavior during system fault. We evaluate our approach on three popular software systems AcmeAir, HDFS and TensorFlow. Results show that it can significantly improve fault diagnosis accuracy by 50% on average compared to the developers' manually placed logging points.
Log‐based anomaly detection for distributed systems: State of the art, industry experience, and open issues

Xinjie Wei,Jie Wang,Chang‐ai Sun,Dave Towey,Shoufeng Zhang,Wanqing Zuo,Yiming Yu,Ruoyi Ruan,Guyang Song

DOI: https://doi.org/10.1002/smr.2650

2024-02-09

Journal of Software Evolution and Process

Abstract:A log‐based anomaly‐detection framework that identifies and highlights log‐grouping and feature‐pattern mining steps. A systematic review of state‐of‐the‐art log‐grouping and feature‐pattern mining techniques. An industry experience using Ray, Hadoop, and BlueGene/L reveals the gaps between theory and industrial settings, pointing out several open issues based on these gaps. Distributed systems have been widely used in many safety‐critical areas. Any abnormalities (e.g., service interruption or service quality degradation) could lead to application crashes or decrease user satisfaction. These things may cause serious economic losses. Among the various quality assurance approaches for distributed systems, log‐based anomaly detection (LAD) has become a popular research topic. Its popularity relates to system logs being able to record and reveal important run‐time information. This paper presents a general LAD framework for distributed systems. Log grouping and feature‐pattern mining are two crucial LAD components that impact on the anomaly‐detection effectiveness. We also present a systematic survey of techniques in these two directions; propose classification frameworks for log grouping and feature patterns; and summarize four log‐grouping techniques and five feature patterns (which refer to invariant relationships among logs that can be used for anomaly detection). To evaluate their applicability, we report on the findings when applying existing techniques to Ray, a popular industrial distributed system. Based on these findings, several open issues are identified, which provide potential guidance for future research and development.

computer science, software engineering
System Log Parsing: A Survey

Tianzhu Zhang,Han Qiu,Gabriele Castellano,Myriana Rifai,Chung Shue Chen,Fabio Pianese

DOI: https://doi.org/10.1109/tkde.2022.3222417

IF: 9.235

2023-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Modern information and communication systems have become increasingly challenging to manage. The ubiquitous system logs contain plentiful information and are thus widely exploited as an alternative source for system management. As log files usually encompass large amounts of raw data, manually analyzing them is laborious and error-prone. Consequently, many research endeavors have been devoted to automatic log analysis. However, these works typically expect structured input and struggle with the heterogeneous nature of raw system logs. Log parsing closes this gap by converting the unstructured system logs to structured records. Many parsers were proposed during the last decades to accommodate various log analysis applications. However, due to the ample solution space and lack of systematic evaluation, it is not easy for practitioners to find ready-made solutions that fit their needs. This paper aims to provide a comprehensive survey on log parsing. We begin with an exhaustive taxonomy of existing log parsers. Then we empirically analyze the critical performance and operational features for 17 open-source solutions both quantitatively and qualitatively, and whenever applicable discuss the merits of alternative approaches. We also elaborate on future challenges and discuss the relevant research directions. We envision this survey as a helpful resource for system administrators and domain experts to choose the most desirable open-source solution or implement new ones based on application-specific requirements.

computer science, information systems, artificial intelligence,engineering, electrical & electronic
A Graphical Representation for Identifier Structure in Logs

Ariel Rabkin,Wei Xu,Avani Wildani,Armando Fox,David A. Patterson,Randy H. Katz

2010-01-01

Abstract:Application console logs are a ubiquitous tool for diagnosing system failures and anomalies. While several techniques exist to interpret logs, describing and assessing log quality remains relatively unexplored. In this paper, we describe an abstract graphical representation of console logs called the identifier graph and a visualization based on this representation. Our representation breaks logs into message types and identifier fields and shows the interrelation between the two. We describe two applications of this visualization. We apply it to Hadoop logs from two different deployments, showing that we capture important properties of Hadoop's logging as well as relevant differences between the two sites. We also apply our technique to logs from two other systems under development. We show that our representation helps highlight flaws in the underlying application logging.
Log-based software monitoring: a systematic mapping study

Jeanderson Cândido,Maurício Aniche,Arie van Deursen

DOI: https://doi.org/10.7717/peerj-cs.489

2021-05-06

PeerJ Computer Science

Abstract:Modern software development and operations rely on monitoring to understand how systems behave in production. The data provided by application logs and runtime environment are essential to detect and diagnose undesired behavior and improve system reliability. However, despite the rich ecosystem around industry-ready log solutions, monitoring complex systems and getting insights from log data remains a challenge. Researchers and practitioners have been actively working to address several challenges related to logs, e.g., how to effectively provide better tooling support for logging decisions to developers, how to effectively process and store log data, and how to extract insights from log data. A holistic view of the research effort on logging practices and automated log analysis is key to provide directions and disseminate the state-of-the-art for technology transfer. In this paper, we study 108 papers (72 research track papers, 24 journals, and 12 industry track papers) from different communities (e.g., machine learning, software engineering, and systems) and structure the research field in light of the life-cycle of log data. Our analysis shows that (1) logging is challenging not only in open-source projects but also in industry, (2) machine learning is a promising approach to enable a contextual analysis of source code for log recommendation but further investigation is required to assess the usability of those tools in practice, (3) few studies approached efficient persistence of log data, and (4) there are open opportunities to analyze application logs and to evaluate state-of-the-art log analysis techniques in a DevOps context.

computer science, information systems, artificial intelligence, theory & methods
Did We Miss Something Important? Studying and Exploring Variable-Aware Log Abstraction

Zhenhao Li,Chuan Luo,Tse-Hsun Chen,Weiyi Shang,Shilin He,Qingwei Lin,Dongmei Zhang

2023-04-22

Abstract:Due to the sheer size of software logs, developers rely on automated techniques for log analysis. One of the first and most important steps of automated log analysis is log abstraction, which parses the raw logs into a structured format. Prior log abstraction techniques aim to identify and abstract all the dynamic variables in logs and output a static log template for automated log analysis. However, these abstracted dynamic variables may also contain important information that is useful to different tasks in log analysis. In this paper, we investigate the characteristics of dynamic variables and their importance in practice, and explore the potential of a variable-aware log abstraction technique. Through manual investigations and surveys with practitioners, we find that different categories of dynamic variables record various information that can be important depending on the given tasks, the distinction of dynamic variables in log abstraction can further assist in log analysis. We then propose a deep learning based log abstraction approach, named VALB, which can identify different categories of dynamic variables and preserve the value of specified categories of dynamic variables along with the log templates (i.e., variable-aware log abstraction). Through the evaluation on a widely used log abstraction benchmark, we find that VALB outperforms other state-of-the-art log abstraction techniques on general log abstraction (i.e., when abstracting all the dynamic variables) and also achieves a high variable-aware log abstraction accuracy that further identifies the category of the dynamic variables. Our study highlights the potential of leveraging the important information recorded in the dynamic variables to further improve the process of log analysis.

Software Engineering
A Survey On Log Research Of AIOps: Methods and Trends

Jiang Zhaoxue,Li Tong,Zhang Zhenguo,Ge Jingguo,You Junling,Li Liangxiong

DOI: https://doi.org/10.1007/s11036-021-01832-3

2021-12-01

Mobile Networks and Applications

Abstract:With the development of Artificial Intelligence (AI), Internet of Things (IoT), cloud computing, new-generation mobile communication, etc., digital transformation is changing the technical architecture of IT systems. It brings more requirements for performance and reliability. The traditional human-dependent development and maintenance methods are overwhelmed, and need to transform to Artificial Intelligence for IT Operations (AIOps). As one of the most useful data resources in IT system, the log plays an important role in AIOps. There are many research on enhancing log quality, analyzing log structure, understanding system behavior, helping users to mine the effective information in logs. Based on the characteristics of logs and different strategies, this paper reviews and categorizes the existing works around the three key processes in the log processing framework of log enhancement, log parsing, and log analysis in academia, and establishes evaluation indicators for comparison and summary. Finally, we discussed the potential directions and future development trends.

computer science, information systems,telecommunications, hardware & architecture
AWSOM-LP: An Effective Log Parsing Technique Using Pattern Recognition and Frequency Analysis

Issam Sedki,Abdelwahab Hamou-Lhadj,Otmane Ait-Mohamed

DOI: https://doi.org/10.48550/arXiv.2110.15473

2021-10-29

Software Engineering

Abstract:Logs provide users with useful insights to help with a variety of development and operations tasks. The problem is that logs are often unstructured, making their analysis a complex task. This is mainly due to the lack of guidelines and best practices for logging, combined with a large number of logging libraries at the disposal of software developers. There exist studies that aim to parse automatically large logs. The main objective is to extract templates from samples of log data that are used to recognize future logs. In this paper, we propose AWSOM-LP, a powerful log parsing and abstraction tool, which is highly accurate, stable, and efficient. AWSOM-LP is built on the idea of applying pattern recognition and frequency analysis. First, log events are organized into patterns using a simple text processing method. Frequency analysis is then applied locally to instances of the same group to identify static and dynamic content of log events. When applied to 16 log datasets of the the LogPai project, AWSOM-LP achieves an average grouping accuracy of 93.5%, which outperforms the accuracy of five leading log parsing tools namely, Logram, Lenma, Drain, IPLoM and AEL. Additionally, AWSOM-LP can generate more than 80% of the final log templates from 10% to 50% of the entire log dataset and can parse up to a million log events in an average time of 5 minutes. AWSOM-LP is available online as an open source. It can be used by practitioners and researchers to parse effectively and efficiently large log files so as to support log analysis tasks.
Deep Neural Network Based Log Analysis

Barış Bulut,Hasan Burak Ketmen

DOI: https://doi.org/10.1109/SIU53274.2021.9477836

2021-06-09

Abstract:Today, the logs of the services running on virtual and real servers provide us with data from which statistical inferences can be made about the service itself and the ecosystem it is in, if it is analyzed. The usage purposes of the tools used in DevOps, the content of the logs they produce, the way they are stored and the frequency of reproduction may vary. Creating metrics by analyzing logs and taking necessary actions on metrics can potentially increase productivity when the hurdles such as fragmentation of unstructured data, processing of data and processing of data are overcome. In this study, it is shown that the logs can be modeled as a natural language sequence in order that the necessary actions be taken, and it is possible to classify the process logs of Jenkins, which is one of the services used in DevOps, by using the Bidirectional Long Short-Term Memory method, with high accuracy and Cohen's Kappa score.

Computer Science
FLAP: An End-to-End Event Log Analysis Platform for System Management

Tao Li,Yexi Jiang,Chunqiu Zeng,Bin Xia,Zheng Liu,Wubai Zhou,Xiaolong Zhu,Wentao Wang,Liang Zhang,Jun Wu,Li Xue,Dewei Bao

DOI: https://doi.org/10.1145/3097983.3098022

2017-01-01

Abstract:Many systems, such as distributed operating systems, complex networks, and high throughput web-based applications, are continuously generating large volume of event logs. These logs contain useful information to help system administrators to understand the system running status and to pinpoint the system failures. Generally, due to the scale and complexity of modern systems, the generated logs are beyond the analytic power of human beings. Therefore, it is imperative to develop a comprehensive log analysis system to support effective system management. Although a number of log mining techniques have been proposed to address specific log analysis use cases, few research and industrial efforts have been paid on providing integrated systems with an end-to-end solution to facilitate the log analysis routines. In this paper, we design and implement an integrated system, called FIU Log Analysis Platform (a.k.a. FLAP), that aims to facilitate the data analytics for system event logs. FLAP provides an end-to-end solution that utilizes advanced data mining techniques to assist log analysts to conveniently, timely, and accurately conduct event log knowledge discovery, system status investigation, and system failure diagnosis. Specifically, in FLAP, state-of-the-art template learning techniques are used to extract useful information from unstructured raw logs; advanced data transformation techniques are proposed and leveraged for event transformation and storage; effective event pattern mining, event summarization, event querying, and failure prediction techniques are designed and integrated for log analytics; and user-friendly interfaces are utilized to present the informative analysis results intuitively and vividly. Since 2016, FLAP has been used by Huawei Technologies Co. Ltd for internal event log analysis, and has provided effective support in its system operation and workflow optimization.
An Intelligent Framework for Log Anomaly Detection Based on Log Template Extraction

Lei Pan,Huichang Zhu

DOI: https://doi.org/10.4018/jcit.330145

2023-09-12

Journal of Cases on Information Technology

Abstract:Log anomaly detection holds great significance in computer systems and network security. A large amount of log data is generated in the background of various information systems and equipment, so automated methods are required to identify abnormal behavior that may indicate security threats or system malfunctions. The traditional anomaly detection methods usually rely on manual statistical discovery, or match by regular expression which are complex and time-consuming. To prevent system failures, minimize troubleshooting time, and reduce service interruptions, a log template-based anomaly detection method has been proposed in this context. This approach leverages log template extraction, log clustering, and classification technology to timely detect abnormal events within the information system. The effectiveness of this method has been thoroughly tested and compared against traditional log anomaly detection systems. The results demonstrate improvements in log analysis depth, event recognition accuracy, and overall efficiency.

English Else
LogAI: A Library for Log Analytics and Intelligence

Qian Cheng,Amrita Saha,Wenzhuo Yang,Chenghao Liu,Doyen Sahoo,Steven Hoi

DOI: https://doi.org/10.48550/arXiv.2301.13415

IF: 14.4

2023-01-31

Artificial Intelligence

Abstract:Software and System logs record runtime information about processes executing within a system. These logs have become the most critical and ubiquitous forms of observability data that help developers understand system behavior, monitor system health and resolve issues. However, the volume of logs generated can be humongous (of the order of petabytes per day) especially for complex distributed systems, such as cloud, search engine, social media, etc. This has propelled a lot of research on developing AI-based log based analytics and intelligence solutions that can process huge volume of raw logs and generate insights. In order to enable users to perform multiple types of AI-based log analysis tasks in a uniform manner, we introduce LogAI (https://github.com/salesforce/logai), a one-stop open source library for log analytics and intelligence. LogAI supports tasks such as log summarization, log clustering and log anomaly detection. It adopts the OpenTelemetry data model, to enable compatibility with different log management platforms. LogAI provides a unified model interface and provides popular time-series, statistical learning and deep learning models. Alongside this, LogAI also provides an out-of-the-box GUI for users to conduct interactive analysis. With LogAI, we can also easily benchmark popular deep learning algorithms for log anomaly detection without putting in redundant effort to process the logs. We have opensourced LogAI to cater to a wide range of applications benefiting both academic research and industrial prototyping.
Brief Announcement: Automatic Log Enhancement for Fault Diagnosis.

Tong Jia,Ying Li,Zhonghai Wu

DOI: https://doi.org/10.1145/3212734.3212784

2018-01-01

Abstract:When systems fail, logs are frequently the only evidence available for underlying fault diagnosis. Consequently, the quality of logs-how well system faults can be reflected by these log messages, is of significant importance. To improve the quality of logs, we propose a novel log enhancement approach which automatically identifies logging points that reflect anomalous behavior during system fault time. We further evaluate our approach with three popular open source projects. Results show that it can significantly improve over 50% accuracy of automatic fault diagnosis on average.
An Empirical Investigation of Practical Log Anomaly Detection for Online Service Systems.

Nengwen Zhao,Honglin Wang,Zeyan Li,Xiao Peng,Gang Wang,Zhu Pan,Yong Wu,Zhen Feng,Xidao Wen,Wenchi Zhang,Kaixin Sui,Dan Pei

DOI: https://doi.org/10.1145/3468264.3473933

2021-01-01

Abstract:Log data is an essential and valuable resource of online service systems, which records detailed information of system running status and user behavior. Log anomaly detection is vital for service reliability engineering, which has been extensively studied. However, we find that existing approaches suffer from several limitations when deploying them into practice, including 1) inability to deal with various logs and complex log abnormal patterns; 2) poor interpretability; 3) lack of domain knowledge. To help understand these practical challenges and investigate the practical performance of existing work quantitatively, we conduct the first empirical study and an experimental study based on large-scale real-world data. We find that logs with rich information indeed exhibit diverse abnormal patterns (e.g., keywords, template count, template sequence, variable value, and variable distribution). However, existing approaches fail to tackle such complex abnormal patterns, producing unsatisfactory performance. Motivated by obtained findings, we propose a generic log anomaly detection system named LogAD based on ensemble learning, which integrates multiple anomaly detection approaches and domain knowledge, so as to handle complex situations in practice. About the effectiveness of LogAD, the average F1-score achieves 0.83, outperforming all baselines. Besides, we also share some success cases and lessons learned during our study. To our best knowledge, we are the first to investigate practical log anomaly detection in the real world deeply. Our work is helpful for practitioners and researchers to apply log anomaly detection to practice to enhance service reliability.

Advances and Challenges in Log Analysis

Online Log Data Analysis With Efficient Machine Learning: A Review

A Survey on Automated Log Analysis for Reliability Engineering

Landscape of Automated Log Analysis: A Systematic Literature Review and Mapping Study

Finding Needles in the Haystack: Harnessing Syslogs for Data Center Management

On Vulnerability and Security Log analysis: A Systematic Literature Review on Recent Trends

LogAssist: Assisting Log Analysis Through Log Summarization

Machine Deserves Better Logging: A Log Enhancement Approach for Automatic Fault Diagnosis

Log‐based anomaly detection for distributed systems: State of the art, industry experience, and open issues

System Log Parsing: A Survey

A Graphical Representation for Identifier Structure in Logs

Log-based software monitoring: a systematic mapping study

Did We Miss Something Important? Studying and Exploring Variable-Aware Log Abstraction

A Survey On Log Research Of AIOps: Methods and Trends

AWSOM-LP: An Effective Log Parsing Technique Using Pattern Recognition and Frequency Analysis

Deep Neural Network Based Log Analysis

FLAP: An End-to-End Event Log Analysis Platform for System Management

An Intelligent Framework for Log Anomaly Detection Based on Log Template Extraction

LogAI: A Library for Log Analytics and Intelligence

Brief Announcement: Automatic Log Enhancement for Fault Diagnosis.

An Empirical Investigation of Practical Log Anomaly Detection for Online Service Systems.