Abstract:Developers usually depend on inserting logging statements into the source code to collect system runtime information. Such logged information is valuable for software maintenance. A logging statement usually prints one or more variables to record vital system status. However, due to the lack of rigorous logging guidance and the requirement of domain-specific knowledge, it is not easy for developers to make proper decisions about which variables to log. To address this need, in this work, we propose an approach to recommend logging variables for developers during development by learning from existing logging statements. Different from other prediction tasks in software engineering, this task has two challenges: 1) Dynamic labels - different logging statements have different sets of accessible variables, which means in this task, the set of possible labels of each sample is not the same. 2) Out-of-vocabulary words - identifiers' names are not limited to natural language words and the test set usually contains a number of program tokens which are out of the vocabulary built from the training set and cannot be appropriately mapped to word embeddings. To deal with the first challenge, we convert this task into a representation learning problem instead of a multi-label classification problem. Given a code snippet which lacks a logging statement, our approach first leverages a neural network with an RNN (recurrent neural network) layer and a self-attention layer to learn the proper representation of each program token, and then predicts whether each token should be logged through a unified binary classifier based on the learned representation. To handle the second challenge, we propose a novel method to map program tokens into word embeddings by making use of the pre-trained word embeddings of natural language tokens. We evaluate our approach on 9 large and high-quality Java projects. Our evaluation results show that the average MAP of our approach is over 0.84, outperforming random guess and an information-retrieval-based method by large margins.

SMARTLOG: Place Error Log Statement by Deep Understanding of Log Intention

Which Variables Should I Log?

Machine Deserves Better Logging: A Log Enhancement Approach for Automatic Fault Diagnosis

Automated Defects Detection and Fix in Logging Statement

Can You Capture Information As You Intend To? A Case Study on Logging Practice in Industry

Brief Announcement: Automatic Log Enhancement for Fault Diagnosis.

Demystifying and Extracting Fault-indicating Information from Logs for Failure Diagnosis

LogAssist: Assisting Log Analysis Through Log Summarization

FastLog: An End-to-End Method to Efficiently Generate and Insert Logging Statements

Where Do Developers Log? an Empirical Study on Logging Practices in Industry

JLLAR: A Logging Recommendation Plug-in Tool for Java

LogLM: From Task-based to Instruction-based Automated Log Analysis

Data-Driven Approach for Log Instruction Quality Assessment

IPLog: An Efficient Log Parsing Method Based on Few-Shot Learning

Leveraging Log Instructions in Log-based Anomaly Detection

An Exploratory Study of Log Placement Recommendation in an Enterprise System

A Survey on Automated Log Analysis for Reliability Engineering

AutoLog: A Log Sequence Synthesis Framework for Anomaly Detection

Lemur: Log Parsing with Entropy Sampling and Chain-of-Thought Merging

Did We Miss Something Important? Studying and Exploring Variable-Aware Log Abstraction

Exploring the Effectiveness of LLMs in Automated Logging Generation: An Empirical Study