Abstract:Context: Code summarization refers to a task that automatically generates a natural language description of a code snippet to facilitate code comprehension. Existing methods have achieved satisfactory results by incorporating information retrieval into generative deep-learning models for reusing summaries of existing code. However, most of these existing methods employed non-learnable generic retrieval methods for content-based retrieval, resulting in a lack of diversity in the retrieved results during training, thereby making the model over-reliant on retrieved results and reducing the generative model’s ability to generalize to unknown samples. Objective: To address this issue, this paper introduces CMR-Sum: a novel Cross-Modal Retrieval-enhanced code Summarization framework based on joint learning for generation and retrieval tasks, where both two tasks are allowed to be optimized simultaneously. Method: Specifically, we use a cross-modal retrieval module to dynamically alter retrieval results during training, which enhances the diversity of the retrieved results and maintains a relative balance between the two tasks. Furthermore, in the summary generation phase, we employ a cross-attention mechanism to generate code summaries based on the alignment between retrieved and generated summaries. We conducted experiments on three real-world datasets, comparing the performance of our method with baseline models. Additionally, we performed extensive qualitative analysis. Result: Results from qualitative and quantitative experiments indicate that our approach effectively enhances the performance of code summarization. Our method outperforms both the generation-based and the retrieval-enhanced baselines. Further ablation experiments demonstrate the effectiveness of each component of our method. Results from sensitivity analysis experiments suggest that our approach achieves good performance without requiring extensive hyper-parameter search. Conclusion: The direction of utilizing retrieval-enhanced generation tasks shows great potential. It is essential to increase the diversity of retrieval results during the training process, which is crucial for improving the generality and the performance of the model.

Multi-path Based Self-adaptive Cross-lingual Summarization.

Cross-Lingual Abstractive Summarization with Limited Parallel Resources.

Multisumm: Towards A Unified Model For Multi-Lingual Abstractive Summarization

Cross-language Document Summarization Via Extraction and Ranking of Multiple Summaries

Multi-Target Cross-Lingual Summarization: a novel task and a language-neutral approach

Jointly Learning to Align and Summarize for Neural Cross-Lingual Summarization

Attend, Translate and Summarize: An Efficient Method for Neural Cross-Lingual Summarization

Unified Training for Cross-Lingual Abstractive Summarization by Aligning Parallel Machine Translation Pairs

A Variational Hierarchical Model for Neural Cross-Lingual Summarization

Cross-Language Generative Automatic Summarization Based on Attention Mechanism.

Abstractive Cross-Language Summarization via Translation Model Enhanced Predicate Argument Structure Fusing

Towards Unifying Multi-Lingual and Cross-Lingual Summarization

SimCSum: Joint Learning of Simplification and Cross-lingual Summarization for Cross-lingual Science Journalism

Oversea Cross-Lingual Summarization Service in Multilanguage Pre-Trained Model Through Knowledge Distillation

Using Bilingual Information for Cross-Language Document Summarization

Zero-Shot Cross-Lingual Abstractive Sentence Summarization Through Teaching Generation and Attention

SEASum: Syntax-Enriched Abstractive Summarization

Cross-Modal Retrieval-Enhanced Code Summarization Based on Joint Learning for Retrieval and Generation

Abstractive Sentence Summarization with Guidance of Selective Multimodal Reference.

Align vision-language semantics by multi-task learning for multi-modal summarization

A Survey on Cross-Lingual Summarization