Abstractive Social Media Text Summarization Using Selective Reinforced Seq2Seq Attention Model.

Zeyu Liang,Junping Du,Chaoyang Li
DOI: https://doi.org/10.1016/j.neucom.2020.04.137
IF: 6
2020-01-01
Neurocomputing
Abstract:The Abstractive text summarization aims to generate a brief version of a given sentence while attempting to express its main meaning. Although some models based on the sequence-to-sequence framework have achieved remarkable results recently, there are still many problems that cannot be ignored. In this paper, we propose a selective reinforced sequence-to-sequence (i.e. Seq2Seq) attention model for abstractive social media text summarization. We add a selective gate after the encoder module for better filtering out invalid information. Specifically, we combine the cross-entropy and reinforcement learning policy for optimizing the ROUGE score directly. Evaluations on a famous social media dataset (i.e. LCSTS) demonstrate that our model outperforms most of famous baseline models, and the proposed model is 2.6%, 2.1% and 2.5% higher than the basic Seq2Seq attention model on the F1 score of ROUGE-1, ROUGE-2, and ROUGE-L, respectively. (C) 2020 Published by Elsevier B.V.
What problem does this paper attempt to address?