Abstract:Log data is a valuable resource for understanding system status. Log recording running status for a computer system is commonly used to identify performance issues and malfunctions. Sequential anomaly detection of logs is crucial for building a secure and stable system and is beneficial for the discovery, location, and analysis of system failures. In this paper, we propose a new log sequential anomaly detection method based on natural language processing techniques by the Population Based Training (PBT) algorithm, which can make full use of semantic information in log templates to analyze log sequences. The Part-of-Speech (PoS) weight mechanism is first employed to improve the digital representation quality of the log template in the feature extraction. And then, TextCNN is used to extract noteworthy information in log template vectors. In the sequence log anomaly detection stage, the combination of TextCNN and LSTM neural network can improve the accuracy of log sequential anomaly detection. On the other hand, the proposed method jointly trains the parameters of the PoS weight mechanism and the parameters of the anomaly detection neural network model through the PBT algorithm, which accelerates the model convergence speed and improves the accuracy of the log sequential anomaly detection. Our model has been tested on four data sets and compared with two state-of-the-art models to prove the effectiveness of our model. The experimental results show that, compared with other log anomaly detection methods, the proposed method performs well.

CLDTLog: System Log Anomaly Detection Method Based on Contrastive Learning and Dual Objective Tasks

BERT-Log: Anomaly Detection for System Logs Based on Pre-trained Language Model

Log Anomaly Detection method based on BERT model optimization

Log Sequence Anomaly Detection Method Based on Contrastive Adversarial Training and Dual Feature Extraction

Leveraging Large Language Models and BERT for Log Parsing and Anomaly Detection

LogBD: A Log Anomaly Detection Method Based on Pretrained Models and Domain Adaptation

LLMeLog: an Approach for Anomaly Detection Based on LLM-enriched Log Events

BertHTLG: Graph-Based Microservice Anomaly Detection Through Sentence-Bert Enhancement.

LAnoBERT: System Log Anomaly Detection based on BERT Masked Language Model

Semi-supervised log anomaly detection based on bidirectional temporal convolution network

An Anomaly Detection Approach of Part-of-Speech Log Sequence Via Population Based Training

SemLog: A Semantics-based Approach for Anomaly Detection in Big Data System Logs

LogBERT: Log Anomaly Detection via BERT

DualAttlog: Context aware dual attention networks for log-based anomaly detection

LogCAE: an Approach for Log-based Anomaly Detection with Active Learning and Contrastive Learning

Natural Language Processing-based Model for Log Anomaly Detection

LogCSS: Log anomaly detection based on BERT-CNN with context-semantics-statistics features

Research on Log Anomaly Detection Based on Sentence-BERT

LogLLM: Log-based Anomaly Detection Using Large Language Models

MetaLog: Generalizable Cross-System Anomaly Detection from Logs with Meta-Learning.

ETCNLog: A System Log Anomaly Detection Method Based on Efficient Channel Attention and Temporal Convolutional Network