Abstract:Abstract Nowadays, most research conducted in the field of abstractive text summarization focuses on neural-based models alone, without considering their combination with knowledge-based approaches that could further enhance their efficiency. In this direction, this work presents a novel framework that combines sequence-to-sequence neural-based text summarization along with structure and semantic-based methodologies. The proposed framework is capable of dealing with the problem of out-of-vocabulary or rare words, improving the performance of the deep learning models. The overall methodology is based on a well-defined theoretical model of knowledge-based content generalization and deep learning predictions for generating abstractive summaries. The framework is composed of three key elements: (i) a pre-processing task, (ii) a machine learning methodology, and (iii) a post-processing task. The pre-processing task is a knowledge-based approach, based on ontological knowledge resources, word sense disambiguation, and named entity recognition, along with content generalization, that transforms ordinary text into a generalized form. A deep learning model of attentive encoder-decoder architecture, which is expanded to enable a coping and coverage mechanism, as well as reinforcement learning and transformer-based architectures, is trained on a generalized version of text-summary pairs, learning to predict summaries in a generalized form. The post-processing task utilizes knowledge resources, word embeddings, word sense disambiguation, and heuristic algorithms based on text similarity methods in order to transform the generalized version of a predicted summary to a final, human-readable form. An extensive experimental procedure on three popular data sets evaluates key aspects of the proposed framework, while the obtained results exhibit promising performance, validating the robustness of the proposed approach.

ExtraPhrase: Efficient Data Augmentation for Abstractive Summarization

Mitigating Data Scarceness through Data Synthesis, Augmentation and Curriculum for Abstractive Summarization

SEASum: Syntax-Enriched Abstractive Summarization

ASM: Augmentation-based Semantic Mechanism on Abstractive Summarization

Data Augmentation for Abstractive Query-Focused Multi-Document Summarization

Abstractive Summarization for Low Resource Data using Domain Transfer and Data Synthesis

A Scenario-Generic Neural Machine Translation Data Augmentation Method

Meta-Transfer Learning for Low-Resource Abstractive Summarization

Abstractive Summarization as Augmentation for Document-Level Event Detection

Syntax-Aware Data Augmentation for Neural Machine Translation

A Syntax-Augmented and Headline-Aware Neural Text Summarization Method

Fast Abstractive Summarization with Reinforce-Selected Sentence Rewriting

Abstractive Text Summarization: Enhancing Sequence-to-Sequence Models Using Word Sense Disambiguation and Semantic Content Generalization

Improving data augmentation for low resource speech-to-text translation with diverse paraphrasing

Improving the Robustness of Summarization Systems with Dual Augmentation

Leverage Unlabeled Data for Abstractive Speech Summarization with Self-Supervised Learning and Back-Summarization

Data Augmentation under Scarce Condition for Neural Machine Translation

See, Hear, Read: Leveraging Multimodality with Guided Attention for Abstractive Text Summarization

Data Augmentation with Large Language Models for Vietnamese Abstractive Text Summarization

Unsupervised Abstractive Summarization Via Sentence Rewriting

Abstractive Summarization Improved by WordNet-based Extractive Sentences