Abstract:In the era of social networks, the rapid growth of data mining in information retrieval and natural language processing makes automatic text summarization necessary. Currently, pretrained word embedding and sequence to sequence models can be effectively adapted in social network summarization to extract significant information with strong encoding capability. However, how to tackle the long text dependence and utilize the latent topic mapping has become an increasingly crucial challenge for these models. In this article, we propose a topic-aware extractive and abstractive summarization model named T-BERTSum, based on Bidirectional Encoder Representations from Transformers (BERTs). This is an improvement over previous models, in which the proposed approach can simultaneously infer topics and generate summarization from social texts. First, the encoded latent topic representation, through the neural topic model (NTM), is matched with the embedded representation of BERT, to guide the generation with the topic. Second, the long-term dependencies are learned through the transformer network to jointly explore topic inference and text summarization in an end-to-end manner. Third, the long short-term memory (LSTM) network layers are stacked on the extractive model to capture sequence timing information, and the effective information is further filtered on the abstractive model through a gated network. In addition, a two-stage extractive–abstractive model is constructed to share the information. Compared with the previous work, the proposed model T-BERTSum focuses on pretrained external knowledge and topic mining to capture more accurate contextual representations. Experimental results on the CNN/Daily mail and XSum datasets demonstrate that our proposed model achieves new state-of-the-art results while generating consistent topics compared with the most advanced method.

AttSum: A Deep Attention-Based Summarization Model for Bug Report Title Generation

Stay Professional and Efficient

Unsupervised Deep Bug Report Summarization

Modelling the ‘hurried’ bug report reading process to summarize bug reports

How to cherry pick the bug report for better summarization?

KeyTitle: towards better bug report title generation by keywords planning

Improving Automated Bug Triaging with Specialized Topic Model.

Bug Report Summarization using Believability Score and Text Ranking

Are Duplicates Really Harmful? an Empirical Study on Bug Report Summarization Techniques

A Syntax-Augmented and Headline-Aware Neural Text Summarization Method

Enhancing Bug Report Summaries Through Knowledge-Specific and Contrastive Learning Pre-Training

Improving Code Summarization Through Automated Quality Assurance

What Have We Achieved on Text Summarization?

HITS-based attentional neural model for abstractive summarization

LLMs as Evaluators: A Novel Approach to Evaluate Bug Report Summarization

Enhancements of Attention-Based Bidirectional LSTM for Hybrid Automatic Text Summarization

T-BERTSum: Topic-Aware Text Summarization Based on BERT

Topic-Aware Abstractive Text Summarization

SummScore: A Comprehensive Evaluation Metric for Summary Quality Based on Cross-Encoder

Abstractive method-based Text Summarization using Bidirectional Long Short-Term Memory and Pointer Generator Mode

AttSum: Joint Learning of Focusing and Summarization with Neural Attention.