Abstract:Code summarization is to provide a high-level comment for a code snippet that typically describes the function and intent of the given code. Recent years have seen the successful application of data-driven code summarization. To improve the performance of the model, numerous approaches use abstract syntax trees (ASTs) to represent the structural information of the code, which is considered by most researchers to be the main factor that distinguishes code from natural language. Then, such data-driven methods are trained on large-scale labeled datasets to obtain a model with strong generalization capabilities that can be applied to new examples. Nevertheless, we argue that state-of-the-art approaches suffer from two key weaknesses: (1) inefficient encoding of ASTs; (2) reliance on a large labeled corpus for model training. As a result, such drawbacks lead to (1) oversized model, slow training, information loss and instability; (2) inability to be applied to programming languages with only a small amount of labeled data. In light of these weaknesses, we propose PassSum, a code summarization approach that addresses the aforementioned weaknesses via (1) a novel input representation which contains an efficient AST encoding method; (2) introducing three pretraining objectives and pretraining our model with a large amount of (easy-to-obtain) unlabeled data under the guidance of self-supervised learning. Experimental results on code summarization for Java, Python, and Ruby methods demonstrate the superiority of PassSum to state-of-the-art methods. Further experiments demonstrate that the input representation we use has both temporal and spatial advantages in addition to performance leadership. In addition, pretraining is also shown to make the model more generalizable with less labeled data, and also to speed up the convergence of the model during training. Our contributions are as follows. We propose a novel input representation containing an efficient AST encoding method with syntactical information and an additional input part with lexical information. To improve the robust performance of PassSum, we propose to pretrain PassSum using three pretraining objectives on a large amount of unlabeled dataset. We empirically show that PassSum outperforms state-of-the-art code summarizers and demonstrate the time and space efficiency of the input representation used by PassSum. image

Conditional Dyck-CFL Reachability Analysis for Complete and Efficient Library Summarization.

Summary-Based Context-Sensitive Data-Dependence Analysis in Presence of Callbacks

Fast and precise points-to analysis with incremental CFL-reachability summarisation: preliminary experience

Analyzing Math Library Functions Via Summarization

An Extractive-and-Abstractive Framework for Source Code Summarization.

LibAlchemy: A Two-Layer Persistent Summary Design for Taming Third-Party Libraries in Static Bug-Finding Systems

Optimize Context-Sensitive Andersen-style Points-to Analysis by Method Summarization and Cycle-Elimination

A Novel ILP Framework for Summarizing Content with High Lexical Variety.

Pearl: A Multi-Derivation Approach to Efficient CFL-Reachability Solving

IDEAL: Leveraging Infinite and Dynamic Characterizations of Large Language Models for Query-focused Summarization

The CIST Summarization System at TAC 2010.

PassSum: Leveraging Paths of Abstract Syntax Trees and Self‐supervision for Code Summarization

CP-BCS: Binary Code Summarization Guided by Control Flow Graph and Pseudo Code

Interactive Abstract Interpretation with Demanded Summarization

LoopSCC: Towards Summarizing Multi-branch Loops within Determinate Cycles

Effective Approaches to Combining Lexical and Syntactical Information for Code Summarization

Summarizing Source Code with Transferred API Knowledge

Context-aware Code Summary Generation

Information-Theoretic Distillation for Reference-less Summarization

Learning a Holistic and Comprehensive Code Representation for Code Summarization.

Evaluating Code Summarization with Improved Correlation with Human Assessment.