Abstract:In recent times, extracting valuable information from large text is making significant progress. Especially in the current era of social media, people expect quick bites of information. Automatic text summarization seeks to tackle this by slimming large texts down into more manageable summaries. This important research area can aid in decision-making by digging out salient content from large text. With the progress in deep learning models, significant work in language models has emerged. The encoder-decoder framework in deep learning has become the central approach for automatic text summarization. This work leverages transformer-based BART model for human-like summarization which is an open-ended problem with many challenges. On training and fine-tuning the encoder-decoder model, it is tested with diverse sample articles and the quality of summaries of diverse samples is assessed based on human evaluation parameters. Further, the finetuned model performance is compared with the baseline pretrained model based on evaluation metrics like ROUGE score and BERTScore. Additionally, domain adaptation of the model is required for improved performance of abstractive summarization of dialogues between interlocutors. On investigating, the above popular evaluation metrics are found to be insensitive to factual errors. Further investigation of the summaries generated by finetuned model is done using the contemporary evaluation metrics of factual consistency like WeCheck and SummaC. Empirical results on BBC News articles highlight that the gold standard summaries written by humans are more factually consistent by 17% than the abstractive summaries generated by finetuned model.

VieSum: How Robust Are Transformer-based Models on Vietnamese Summarization?

Efficient Adaptation of Pretrained Transformers for Abstractive Summarization

Data Augmentation with Large Language Models for Vietnamese Abstractive Text Summarization

ViT5: Pretrained Text-to-Text Transformer for Vietnamese Language Generation

Deep Learning Models for Automatic Summarization

On Extractive and Abstractive Neural Document Summarization with Transformer Language Models

BERT-VBD: Vietnamese Multi-Document Summarization Framework

Summaformers @ LaySumm 20, LongSumm 20

Overview of the VLSP 2022 -- Abmusu Shared Task: A Data Challenge for Vietnamese Abstractive Multi-document Summarization

Curriculum-Guided Abstractive Summarization

Assessment of Transformer-Based Encoder-Decoder Model for Human-Like Summarization

Interpretable extractive text summarization with meta-learning and BI-LSTM: A study of meta learning and explainability techniques

Video Summarization Generation Model Based on Transformer and Deep Reinforcement Learning

Transformer Based Implementation for Automatic Book Summarization

Hie-Transformer: A Hierarchical Hybrid Transformer For Abstractive Article Summarization

Challenges in Domain-Specific Abstractive Summarization and How to Overcome them

SummVis: Interactive Visual Analysis of Models, Data, and Evaluation for Text Summarization

A study of extractive summarization of long documents incorporating local topic and hierarchical information

Discrete Diffusion Language Model for Long Text Summarization

Understanding Code Semantics: An Evaluation of Transformer Models in Summarization

Rethinking Transformer-based Multi-document Summarization: An Empirical Investigation