Abstract:Text summarization is a downstream natural language processing (NLP) task that challenges the understanding and generation capabilities of language models. Considerable progress has been made in automatically summarizing short texts, such as news articles, often leading to satisfactory results. However, summarizing long documents remains a major challenge. This is due to the complex contextual information in the text and the lack of open-source benchmarking datasets and evaluation frameworks that can be used to develop and test model performance. In this work, we use ChatGPT, the latest breakthrough in the field of large language models (LLMs), together with the extractive summarization model C2F-FAR (Coarse-to-Fine Facet-Aware Ranking) to propose a hybrid extraction and summarization pipeline for long documents such as business articles and books. We work with the world-renowned company getAbstract AG and leverage their expertise and experience in professional book summarization. A practical study has shown that machine-generated summaries can perform at least as well as human-written summaries when evaluated using current automated evaluation metrics. However, a closer examination of the texts generated by ChatGPT through human evaluations has shown that there are still critical issues in terms of text coherence, faithfulness, and style. Overall, our results show that the use of ChatGPT is a very promising but not yet mature approach for summarizing long documents and can at best serve as an inspiration for human editors. We anticipate that our work will inform NLP researchers about the extent to which ChatGPT's capabilities for summarizing long documents overlap with practitioners' needs. Further work is needed to test the proposed hybrid summarization pipeline, in particular involving GPT-4, and to propose a new evaluation framework tailored to the task of summarizing long documents.

Efficient Two-stage Approach for Long Document Summarization

Automatic Document Summarization Via Deep Neural Networks

Leveraging Salience Analysis and Sparse Attention for Long Document Summarization

A Novel LLM-based Two-stage Summarization Approach for Long Dialogues

Automatic Summarization of Long Documents

Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documents

Hybrid Long Document Summarization using C2F-FAR and ChatGPT: A Practical Study

A New Approach to Overgenerating and Scoring Abstractive Summaries

Fast Abstractive Summarization with Reinforce-Selected Sentence Rewriting

Abstractive method-based Text Summarization using Bidirectional Long Short-Term Memory and Pointer Generator Mode

Improving Multi-Stage Long Document Summarization with Enhanced Coarse Summarizer

Assessment of Transformer-Based Encoder-Decoder Model for Human-Like Summarization

Long Document Summarization with Top-down and Bottom-up Inference

Abstractive Summarization Improved by WordNet-based Extractive Sentences

Topic-Aware Abstractive Text Summarization

Reinforced Abstractive Summarization with Adaptive Length Controlling

A Two-Stage Long Text Summarization Method Based on Discourse Structure

Modeling Endorsement for Multi-Document Abstractive Summarization

Scaling Up Summarization: Leveraging Large Language Models for Long Text Extractive Summarization

Summaformers @ LaySumm 20, LongSumm 20

Summarizing long regulatory documents with a multi-step pipeline