Abstract:Sequence to sequence (Seq2Seq) learning has recently been used for abstractive and extractive summarization. In current study, Seq2Seq models have been used for eBay product description summarization. We propose a novel Document-Context based Seq2Seq models using RNNs for abstractive and extractive summarizations. Intuitively, this is similar to humans reading the title, abstract or any other contextual information before reading the document. This gives humans a high-level idea of what the document is about. We use this idea and propose that Seq2Seq models should be started with contextual information at the first time-step of the input to obtain better summaries. In this manner, the output summaries are more document centric, than being generic, overcoming one of the major hurdles of using generative models. We generate document-context from user-behavior and seller provided information. We train and evaluate our models on human-extracted-golden-summaries. The document-contextual Seq2Seq models outperform standard Seq2Seq models. Moreover, generating human extracted summaries is prohibitively expensive to scale, we therefore propose a semi-supervised technique for extracting approximate summaries and using it for training Seq2Seq models at scale. Semi-supervised models are evaluated against human extracted summaries and are found to be of similar efficacy. We provide side by side comparison for abstractive and extractive summarizers (contextual and non-contextual) on same evaluation dataset. Overall, we provide methodologies to use and evaluate the proposed techniques for large document summarization. Furthermore, we found these techniques to be highly effective, which is not the case with existing techniques.

On the Helpfulness of Document Context to Sentence Simplification.

Document-Level Text Simplification - Dataset, Criteria and Baseline.

A Constrained Sequence-to-Sequence Neural Model for Sentence Simplification.

Exploiting Summarization Data to Help Text Simplification

Neural Sentence Simplification with Semantic Dependency Information

Improving the Transformer Translation Model with Document-Level Context

Unsupervised Sentence Simplification via Dependency Parsing

Empower Your Model with Longer and Better Context Comprehension

Unsupervised Lexical Simplification with Context Augmentation

Towards Making the Most of Context in Neural Machine Translation

A New Dataset and Empirical Study for Sentence Simplification in Chinese

Improving sentence simplification model with ordered neurons network

SASS: Data and Methods for Subject Aware Sentence Simplification

Text Simplification for Comprehension-based Question-Answering

Social Context Summarization

Context-sensitive Semantic Smoothing for the Language Modeling Approach to Genomic IR

Context-Preserving Text Simplification

Evaluating Document Simplification: On the Importance of Separately Assessing Simplicity and Meaning Preservation

Evaluating LLMs for Targeted Concept Simplification for Domain-Specific Texts

Abstractive and Extractive Text Summarization using Document Context Vector and Recurrent Neural Networks

Cognitive Simplification Operations Improve Text Simplification