Abstract:Log data is a valuable resource for understanding system status. Log recording running status for a computer system is commonly used to identify performance issues and malfunctions. Sequential anomaly detection of logs is crucial for building a secure and stable system and is beneficial for the discovery, location, and analysis of system failures. In this paper, we propose a new log sequential anomaly detection method based on natural language processing techniques by the Population Based Training (PBT) algorithm, which can make full use of semantic information in log templates to analyze log sequences. The Part-of-Speech (PoS) weight mechanism is first employed to improve the digital representation quality of the log template in the feature extraction. And then, TextCNN is used to extract noteworthy information in log template vectors. In the sequence log anomaly detection stage, the combination of TextCNN and LSTM neural network can improve the accuracy of log sequential anomaly detection. On the other hand, the proposed method jointly trains the parameters of the PoS weight mechanism and the parameters of the anomaly detection neural network model through the PBT algorithm, which accelerates the model convergence speed and improves the accuracy of the log sequential anomaly detection. Our model has been tested on four data sets and compared with two state-of-the-art models to prove the effectiveness of our model. The experimental results show that, compared with other log anomaly detection methods, the proposed method performs well.

Log Anomaly Detection method based on BERT model optimization

Natural Language Processing-based Model for Log Anomaly Detection

LAnoBERT: System Log Anomaly Detection based on BERT Masked Language Model

An Anomaly Detection Approach of Part-of-Speech Log Sequence Via Population Based Training

LogBERT: Log Anomaly Detection via BERT

Research on Log Anomaly Detection Based on Sentence-BERT

BERT-Log: Anomaly Detection for System Logs Based on Pre-trained Language Model

Leveraging Large Language Models and BERT for Log Parsing and Anomaly Detection

LLMeLog: an Approach for Anomaly Detection Based on LLM-enriched Log Events

LogBD: A Log Anomaly Detection Method Based on Pretrained Models and Domain Adaptation

CLDTLog: System Log Anomaly Detection Method Based on Contrastive Learning and Dual Objective Tasks

BertHTLG: Graph-Based Microservice Anomaly Detection Through Sentence-Bert Enhancement.

SemLog: A Semantics-based Approach for Anomaly Detection in Big Data System Logs

LogPS: A Robust Log Sequential Anomaly Detection Approach Based on Natural Language Processing

LogLLM: Log-based Anomaly Detection Using Large Language Models

Improving Log-Based Anomaly Detection by Pre-Training Hierarchical Transformers

LogST: Log Semi-supervised Anomaly Detection Based on Sentence-BERT

Log-based Anomaly Detection Without Log Parsing

Robust and Transferable Anomaly Detection in Log Data using Pre-Trained Language Models

Log Sequence Anomaly Detection Method Based on Contrastive Adversarial Training and Dual Feature Extraction

Semi-supervised log anomaly detection based on bidirectional temporal convolution network