Abstract:In recent times, extracting valuable information from large text is making significant progress. Especially in the current era of social media, people expect quick bites of information. Automatic text summarization seeks to tackle this by slimming large texts down into more manageable summaries. This important research area can aid in decision-making by digging out salient content from large text. With the progress in deep learning models, significant work in language models has emerged. The encoder-decoder framework in deep learning has become the central approach for automatic text summarization. This work leverages transformer-based BART model for human-like summarization which is an open-ended problem with many challenges. On training and fine-tuning the encoder-decoder model, it is tested with diverse sample articles and the quality of summaries of diverse samples is assessed based on human evaluation parameters. Further, the finetuned model performance is compared with the baseline pretrained model based on evaluation metrics like ROUGE score and BERTScore. Additionally, domain adaptation of the model is required for improved performance of abstractive summarization of dialogues between interlocutors. On investigating, the above popular evaluation metrics are found to be insensitive to factual errors. Further investigation of the summaries generated by finetuned model is done using the contemporary evaluation metrics of factual consistency like WeCheck and SummaC. Empirical results on BBC News articles highlight that the gold standard summaries written by humans are more factually consistent by 17% than the abstractive summaries generated by finetuned model.

Controlling Output Length in Neural Encoder-Decoders

Learning to Decode for Future Success

Controlling the Output Length of Neural Machine Translation

Length-controllable Abstractive Summarization by Guiding with Summary Prototype

A Simple, Fast Diverse Decoding Algorithm for Neural Generation

A Decoding Algorithm for Length-Control Summarization Based on Directed Acyclic Transformers

Summarization with Precise Length Control

Controlling Decoding for More Abstractive Summaries with Copy-Based Networks

Assessment of Transformer-Based Encoder-Decoder Model for Human-Like Summarization

Learning to Encode Text As Human-Readable Summaries Using Generative Adversarial Networks.

Middle-Out Decoding

Selective Encoding for Abstractive Sentence Summarization

Closed-Book Training to Improve Summarization Encoder Memory

On the Properties of Neural Machine Translation: Encoder-Decoder Approaches

Knowing When to Stop: Evaluation and Verification of Conformity to Output-size Specifications

Length bias in Encoder Decoder Models and a Case for Global Conditioning

Reinforced Abstractive Summarization with Adaptive Length Controlling

Prompt-Based Length Controlled Generation with Reinforcement Learning

Global Encoding for Abstractive Summarization

Generating Summaries with Controllable Readability Levels

Bidirectional Attentional Encoder-Decoder Model and Bidirectional Beam Search for Abstractive Summarization