Abstract:(Source) code summarization aims to automatically generate succinct natural language summaries for given code snippets. Such summaries play a significant role in promoting developers to understand and maintain code. Inspired by neural machine translation, deep learning-based code summarization techniques widely adopt an encoder-decoder framework, where the encoder transforms given code snippets into context vectors, and the decoder decodes context vectors into summaries. Recently, large-scale pre-trained models for source code (e.g., CodeBERT and UniXcoder) are equipped with encoders capable of producing general context vectors and have achieved substantial improvements on the code summarization task. However, although they are usually trained mainly on code-focused tasks and can capture general code features, they still fall short in capturing specific features that need to be summarized. In a nutshell, they fail to learn the alignment between code snippets and summaries (code-summary alignment for short). In this paper, we propose a novel approach to improve code summarization based on summary-focused tasks. Specifically, we exploit a multi-task learning paradigm to train the encoder on three summary-focused tasks to enhance its ability to learn code-summary alignment, including unidirectional language modeling (ULM), masked language modeling (MLM), and action word prediction (AWP). Unlike pre-trained models that mainly predict masked tokens in code snippets, we design ULM and MLM to predict masked words in summaries. Intuitively, predicting words based on given code snippets would help learn the code-summary alignment. In addition, existing work shows that AWP affects the prediction of the entire summary. Therefore, we further introduce the domain-specific task AWP to enhance the ability of the encoder to learn the alignment between action words and code snippets. We evaluate the effectiveness of our approach, called Esale, by conducting extensive experiments on four datasets, including two widely used datasets JCSD and PCSD, a cross-project Java dataset CPJD, and a multilingual language dataset CodeSearchNet. Experimental results show that Esale significantly outperforms state-of-the-art baselines in all three widely used metrics, including BLEU, METEOR, and ROUGE-L. Moreover, the human evaluation proves that the summaries generated by Esale are more informative and closer to the ground-truth summaries.

Probing Bilingual Guidance for Cross-Lingual Summarization.

Revisiting Cross-Lingual Summarization: A Corpus-based Study and A New Benchmark with Improved Annotation

Unified Training for Cross-Lingual Abstractive Summarization by Aligning Parallel Machine Translation Pairs

ClueGraphSum: Let Key Clues Guide the Cross-Lingual Abstractive Summarization

Understanding Translationese in Cross-Lingual Summarization

Using Bilingual Information for Cross-Language Document Summarization

Cross-language Document Summarization Via Extraction and Ranking of Multiple Summaries

Think Carefully and Check Again! Meta-Generation Unlocking LLMs for Low-Resource Cross-Lingual Summarization

Zero-Shot Cross-Lingual Summarization via Large Language Models

A Survey on Cross-Lingual Summarization

Long-Document Cross-Lingual Summarization

NCLS: Neural Cross-Lingual Summarization

GSum: A General Framework for Guided Neural Abstractive Summarization

Zero-Shot Cross-Lingual Abstractive Sentence Summarization Through Teaching Generation and Attention

Multisumm: Towards A Unified Model For Multi-Lingual Abstractive Summarization

Improving Abstractive Dialogue Summarization with Speaker-Aware Supervised Contrastive Learning.

Cross-lingual Cross-temporal Summarization: Dataset, Models, Evaluation

A Multilingual Study of Compressive Cross-Language Text Summarization

Leveraging Entailment Judgements in Cross-Lingual Summarisation

Esale: Enhancing Code-Summary Alignment Learning for Source Code Summarization

Towards Unifying Multi-Lingual and Cross-Lingual Summarization