Abstract:Developers usually depend on inserting logging statements into the source code to collect system runtime information. Such logged information is valuable for software maintenance. A logging statement usually prints one or more variables to record vital system status. However, due to the lack of rigorous logging guidance and the requirement of domain-specific knowledge, it is not easy for developers to make proper decisions about which variables to log. To address this need, in this work, we propose an approach to recommend logging variables for developers during development by learning from existing logging statements. Different from other prediction tasks in software engineering, this task has two challenges: 1) Dynamic labels - different logging statements have different sets of accessible variables, which means in this task, the set of possible labels of each sample is not the same. 2) Out-of-vocabulary words - identifiers' names are not limited to natural language words and the test set usually contains a number of program tokens which are out of the vocabulary built from the training set and cannot be appropriately mapped to word embeddings. To deal with the first challenge, we convert this task into a representation learning problem instead of a multi-label classification problem. Given a code snippet which lacks a logging statement, our approach first leverages a neural network with an RNN (recurrent neural network) layer and a self-attention layer to learn the proper representation of each program token, and then predicts whether each token should be logged through a unified binary classifier based on the learned representation. To handle the second challenge, we propose a novel method to map program tokens into word embeddings by making use of the pre-trained word embeddings of natural language tokens. We evaluate our approach on 9 large and high-quality Java projects. Our evaluation results show that the average MAP of our approach is over 0.84, outperforming random guess and an information-retrieval-based method by large margins.

A Robust Log Classification Approach Based on Natural Language Processing

Knowledge-based Document Embedding for Cross-Domain Text Classification

PoSBert: Log Classification Via Modified Bert Based on Part-of-Speech Weight

Which Variables Should I Log?

Natural Language Processing-based Model for Log Anomaly Detection

An Anomaly Detection Approach of Part-of-Speech Log Sequence Via Population Based Training

LogClass: Anomalous Log Identification and Classification with Partial Labels

High-precision Online Log Parsing with Large Language Models

LogPS: A Robust Log Sequential Anomaly Detection Approach Based on Natural Language Processing

LogCSS: Log anomaly detection based on BERT-CNN with context-semantics-statistics features

Log Anomaly Detection method based on BERT model optimization

LogParse: Making Log Parsing Adaptive Through Word Classification.

Leveraging Large Language Models and BERT for Log Parsing and Anomaly Detection

Biglog: Unsupervised Large-scale Pre-training for a Unified Log Representation

DLLog: An Online Log Parsing Approach for Large-Scale System

Enhancing Robust Text Classification via Category Description

Robust and Transferable Anomaly Detection in Log Data using Pre-Trained Language Models

SemLog: A Semantics-based Approach for Anomaly Detection in Big Data System Logs

Towards robust log parsing using self-supervised learning for system security analysis

BERT-Log: Anomaly Detection for System Logs Based on Pre-trained Language Model

Robust Log-Based Anomaly Detection on Unstable Log Data