Abstract:Context: Code summarization refers to a task that automatically generates a natural language description of a code snippet to facilitate code comprehension. Existing methods have achieved satisfactory results by incorporating information retrieval into generative deep-learning models for reusing summaries of existing code. However, most of these existing methods employed non-learnable generic retrieval methods for content-based retrieval, resulting in a lack of diversity in the retrieved results during training, thereby making the model over-reliant on retrieved results and reducing the generative model’s ability to generalize to unknown samples. Objective: To address this issue, this paper introduces CMR-Sum: a novel Cross-Modal Retrieval-enhanced code Summarization framework based on joint learning for generation and retrieval tasks, where both two tasks are allowed to be optimized simultaneously. Method: Specifically, we use a cross-modal retrieval module to dynamically alter retrieval results during training, which enhances the diversity of the retrieved results and maintains a relative balance between the two tasks. Furthermore, in the summary generation phase, we employ a cross-attention mechanism to generate code summaries based on the alignment between retrieved and generated summaries. We conducted experiments on three real-world datasets, comparing the performance of our method with baseline models. Additionally, we performed extensive qualitative analysis. Result: Results from qualitative and quantitative experiments indicate that our approach effectively enhances the performance of code summarization. Our method outperforms both the generation-based and the retrieval-enhanced baselines. Further ablation experiments demonstrate the effectiveness of each component of our method. Results from sensitivity analysis experiments suggest that our approach achieves good performance without requiring extensive hyper-parameter search. Conclusion: The direction of utilizing retrieval-enhanced generation tasks shows great potential. It is essential to increase the diversity of retrieval results during the training process, which is crucial for improving the generality and the performance of the model.

Leveraging In-and-Cross Project Pseudo-Summaries for Project-Specific Code Summarization

Why My Code Summarization Model Does Not Work

Why My Code Summarization Model Does Not Work: Code Comment Improvement with Category Prediction

Contextual Information Enhanced Source Code Summarization

Low-Resources Project-Specific Code Summarization

Project-Specific Code Summarization with In-Context Learning

Iipcs: Intent-Based In-Context Learning for Project-Specific Code Summarization

ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarization

Cross-Modal Retrieval-Enhanced Code Summarization Based on Joint Learning for Retrieval and Generation

Effective Approaches to Combining Lexical and Syntactical Information for Code Summarization

On the Evaluation of Neural Code Summarization

The Unexpected Blocking of Code Understanding in AI-Based Code Summarization: Observations and Concerns from a Study on Cross-Project Learning Performance

Neural Code Summarization: How Far Are We?

Improving Code Summarization by Combining Deep Learning and Empirical Knowledge (S).

Interpretation-based Code Summarization.

Active Learning for Low-Resource Project-Specific Code Summarization

Automatic Code Summarization Using Abbreviation Expansion and Subword Segmentation

Learning to Generate Structured Code Summaries From Hybrid Code Context

Learning a Holistic and Comprehensive Code Representation for Code Summarization.

EditSum: A Retrieve-and-Edit Framework for Source Code Summarization