Abstract: Document summarization condenses a long document into a short version with salient information and accurate semantic descriptions. The main issue is how to make the output summary semantically consistent with the input document. To reach this goal, recently, researchers have focused on supervised end-to-end hybrid approaches, which contain an extractor module and abstractor module. Among them, the extractor identifies the salient sentences from the input document, and the abstractor generates a summary from the salient sentences. This model successfully keeps the consistency between the generated summary and the reference summary via various strategies (e.g., reinforcement learning). There are two semantic gaps when training the hybrid model (one is between document and extracted sentences, and the other is between extracted sentences and summary). However, they are not explicitly considered in the existing methods, which usually results in a semantic bias of summary. To mitigate the above issue, in this paper, a new \textbf{r}einforcing s\textbf{e}mantic-\textbf{sy}mmetry learning \textbf{m}odel is proposed for document summarization (\textbf{ReSyM}). ReSyM introduces a semantic-consistency reward in the extractor to bridge the first gap. A semantic dual-reward is designed to bridge the second gap in the abstractor. The whole document summarization process is implemented via reinforcement learning with a hybrid reward mechanism (combining the above two rewards). Moreover, a comprehensive sentence representation learning method is presented to sufficiently capture the information from the original document. A series of experiments have been conducted on two wildly used benchmark datasets CNN/Daily Mail and BigPatent. The results have shown the superiority of ReSyM by comparing it with the state-of-the-art baselines in terms of various evaluation metrics.

Learning to Extract Coherent Summary Via Deep Reinforcement Learning.

A Model of Coherence Based on Distributed Sentence Representation.

Text Coherence Analysis Based on Deep Neural Network.

Automatic Document Summarization Via Deep Neural Networks

Enhancing Coherence of Extractive Summarization with Multitask Learning

Towards Enhancing Coherence in Extractive Summarization: Dataset and Experiments with LLMs

Coherent Narrative Summarization with A Cognitive Model

Searching for Effective Neural Extractive Summarization: What Works and What's Next

Deep learning-based extractive text summarization with word-level attention mechanism

Mind The Facts: Knowledge-Boosted Coherent Abstractive Text Summarization

Modeling Coherence for Discourse Neural Machine Translation

SummaRuNNer: A Recurrent Neural Network Based Sequence Model for Extractive Summarization of Documents

Abstractive Summarization Improved by WordNet-based Extractive Sentences

Reinforcing Semantic-Symmetry for Document Summarization

Fast Abstractive Summarization with Reinforce-Selected Sentence Rewriting

DeepChannel: Salience Estimation by Contrastive Learning for Extractive Document Summarization

Neural Document Summarization by Jointly Learning to Score and Select Sentences

Abstractive text summarization model combining a hierarchical attention mechanism and multiobjective reinforcement learning

Reinforced Extractive Summarization with Question-Focused Rewards

Copy or Rewrite: Hybrid Summarization with Hierarchical Reinforcement Learning.

ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarization