Abstract:AbstractCode summarization aims at generating a code comment given a block of source code and it is normally performed by training machine learning algorithms on existing code block-comment pairs. Code comments in practice have different intentions. For example, some code comments might explain how the methods work, while others explain why some methods are written. Previous works have shown that a relationship exists between a code block and the category of a comment associated with it. In this article, we aim to investigate to which extent we can exploit this relationship to improve code summarization performance. We first classify comments into six intention categories and manually label 20,000 code-comment pairs. These categories include “what,” “why,” “how-to-use,” “how-it-is-done,” “property,” and “others.” Based on this dataset, we conduct an experiment to investigate the performance of different state-of-the-art code summarization approaches on the categories. We find that the performance of different code summarization approaches varies substantially across the categories. Moreover, the category for which a code summarization model performs the best is different for the different models. In particular, no models perform the best for “why” and “property” comments among the six categories. We design a composite approach to demonstrate that comment category prediction can boost code summarization to reach better results. The approach leverages classified code-category labeled data to train a classifier to infer categories. Then it selects the most suitable models for inferred categories and outputs the composite results. Our composite approach outperforms other approaches that do not consider comment categories and obtains a relative improvement of 8.57% and 16.34% in terms of ROUGE-L and BLEU-4 score, respectively.

Improved Code Summarization via a Graph Neural Network

Automatic Source Code Summarization with Graph Attention Networks

Bi-LSTM-Based Neural Source Code Summarization

Function Call Graph Context Encoding for Neural Source Code Summarization

Why My Code Summarization Model Does Not Work

A Neural Model for Generating Natural Language Summaries of Program Subroutines

Why My Code Summarization Model Does Not Work: Code Comment Improvement with Category Prediction

Improving Code Summarization by Combining Deep Learning and Empirical Knowledge (S).

Effective Approaches to Combining Lexical and Syntactical Information for Code Summarization

Retrieval-based Neural Source Code Summarization

Automatic Document Summarization Via Deep Neural Networks

GA-SCS: Graph-Augmented Source Code Summarization

Automatic Source Code Summarization with Extended Tree-LSTM

Improving Automatic Source Code Summarization Via Deep Reinforcement Learning

CoCoSum: Contextual Code Summarization with Multi-Relational Graph Neural Network

Summarizing Source Code with Hierarchical Code Representation

CodeSum: Translate Program Language to Natural Language

Neural Code Summarization: How Far Are We?

DG-Trans: Automatic Code Summarization Via Dynamic Graph Attention-based Transformer

Learning a Holistic and Comprehensive Code Representation for Code Summarization.

Statement-based Memory for Neural Source Code Summarization