Abstract:Text summarization has been a significant challenge in the Nature Process Language (NLP) field. The approach of dealing with text summarization can be roughly divided into two main paradigms: extractive and abstractive manner. The former allows capturing the most representative snippets in a document while the latter generates a summary by understanding the latent meaning in a material with a language generation model. Recently, studies found that jointly employing the extractive and abstractive summarization models can take advantage of their complementary advantages, creating both concise and informative summaries. However, the reinforced summarization models mainly depend on the ROUGE-based reward, which only has the ability to quantify the extent of wordmatching rather than semantic-matching between document and summary. Meanwhile, documents are usually collected with redundant or noisy information due to the existence of repeated or irrelevant information in real-world applications. Therefore, only depending on ROUGE-based reward to optimize the reinforced summarization models may lead to biased summary generation. In this paper, we propose a novel deep Hybrid Summarization with semantic weighting Reward and latent structure Detector (HySRD). Specifically, HySRD introduces a new reward mechanism that simultaneously takes advantage of semantic and syntactic information among documents and summaries. To effectively model the accuracy semantics, a latent structure detector is designed to incorporate the high-level latent structures in the sentence representation for information selection. Extensive experiments have been conducted on two well-known benchmark datasets CNN/Daily Mail (short input document) and BigPatent (long input document). The automatic evaluation shows that our approach significantly outperforms the state-of-the-art of hybrid summarization models.

Balancing Lexical and Semantic Quality in Abstractive Summarization

BRIO: Bringing Order to Abstractive Summarization

Abstractive Summarization Improved by WordNet-based Extractive Sentences

SEASum: Syntax-Enriched Abstractive Summarization

Dual-Level Contrastive Learning for Improving Conciseness of Summarization

Summary-Sentence Level Hierarchical Supervision for Re-Ranking Model of Two-Stage Abstractive Summarization Framework

Element-aware Summarization with Large Language Models: Expert-aligned Evaluation and Chain-of-Thought Method

A Unified Model for Extractive and Abstractive Summarization using Inconsistency Loss

Fast Abstractive Summarization with Reinforce-Selected Sentence Rewriting

An Abstractive Summarization Model Based on Joint-Attention Mechanism and a Priori Knowledge

Resilient Abstractive Summarization Model with Adaptively Weighted Training Loss

RefSum: Refactoring Neural Summarization.

Hybrid Summarization with Semantic Weighting Reward and Latent Structure Detector

Copy or Rewrite: Hybrid Summarization with Hierarchical Reinforcement Learning.

Abstractive Social Media Text Summarization Using Selective Reinforced Seq2Seq Attention Model.

Monotonic Alignments for Summarization

A New Approach to Overgenerating and Scoring Abstractive Summaries

A Unified Summarization Model with Semantic Guide and Keyword Coverage Mechanism

Improving Sequence-to-Sequence Models for Abstractive Text Summarization Using Meta Heuristic Approaches

Sentence salience contrastive learning for abstractive text summarization

DCDSum: An interpretable extractive summarization framework based on contrastive learning method