Abstract:Comments are valuable resources for the development, comprehension and maintenance of software. However, while changing code, developers sometimes neglect the evolution of the corresponding comments, resulting in obsolete comments. Such obsolete comments can mislead developers and introduce bugs in the future, and are therefore detrimental. We notice that by detecting and updating obsolete comments in time with code changes, obsolete comments can be effectively reduced and even avoided. We refer to this task as Just-In-Time (JIT) Obsolete Comment Detection and Update. In this work, we propose a two-stage framework named CUP$^\mathrm{2}$2 ( Two -stage C omment UP dater) to automate this task. CUP $^\mathrm{2}$ consists two components, i.e., an O bsolete C omment D etector named OCD and a C omment UP dater named CUP , each of which relies on a distinct neural network model to perform detection (updates). Specifically, given a code change and a corresponding comment, CUP $^\mathrm{2}$ first leverages OCD to predict whether this comment should be updated. If the answer is yes, CUP will be used to generate the new version of the comment automatically. To evaluate CUP $^\mathrm{2}$ , we build a large-scale dataset with over 4 million code-comment change samples. Our dataset focuses on method-level code changes and updates on method header comments considering the importance and widespread use of such comments. Evaluation results show that 1) both OCD and CUP outperform their baselines by significant margins, and 2) CUP $^\mathrm{2}$ performs better than a rule-based baseline. Specifically, the comments generated by CUP $^\mathrm{2}$ are identical to the ground truth for 41.8% of the samples that are predicted to be positive by OCD. We believe CUP $^\mathrm{2}$ can help developers detect obsolete comments, better understand where and how to update obsolete comments and reduce their edits on obsolete comment updates.

C2S: Translating Natural Language Comments to Formal Program Specifications

Automating Just-In-Time Comment Updating

Enchanting Program Specification Synthesis by Large Language Models using Static Analysis and Program Verification

Just-In-Time Obsolete Comment Detection and Update.

CPC: Automatically Classifying and Propagating Natural Language Comments via Program Analysis

From Code to Natural Language: Type-Aware Sketch-Based Seq2Seq Learning

SpecGen: Automated Generation of Formal Program Specifications via Large Language Models

A methodology for high-level software specification construction.

Inferring Specifications for Resources from Natural Language API Documentation

Inferring Method Specifications from Natural Language API Descriptions

L2S: A Framework for Synthesizing the Most Probable Program under a Specification

An Intelligent Assistant for Converting City Requirements to Formal Specification

Impact of Large Language Models on Generating Software Specifications

Generating c code from LOGS specifications

Large Language Models Based Automatic Synthesis of Software Specifications

Explainable Program Synthesis by Localizing Specifications

Low-level Comments auto-generation for Solidity Smart Contracts

CodeAttention: Translating Source Code to Comments by Exploiting the Code Constructs

CitySpec: An Intelligent Assistant System for Requirement Specification in Smart Cities

Trustworthy Formal Natural Language Specifications

Automated Generation of LTL Specifications for Smart Home IoT Using Natural Language