Abstract:Text summarization (TS) is considered one of the most difficult tasks in natural language processing (NLP). It is one of the most important challenges that stand against the modern computer system's capabilities with all its new improvement. Many papers and research studies address this task in literature but are being carried out in extractive summarization, and few of them are being carried out in abstractive summarization, especially in the Arabic language due to its complexity. In this paper, an abstractive Arabic text summarization system is proposed, based on a sequence-to-sequence model. This model works through two components, encoder and decoder. Our aim is to develop the sequence-to-sequence model using several deep artificial neural networks to investigate which of them achieves the best performance. Different layers of Gated Recurrent Units (GRU), Long Short-Term Memory (LSTM), and Bidirectional Long Short-Term Memory (BiLSTM) have been used to develop the encoder and the decoder. In addition, the global attention mechanism has been used because it provides better results than the local attention mechanism. Furthermore, AraBERT preprocess has been applied in the data preprocessing stage that helps the model to understand the Arabic words and achieves state-of-the-art results. Moreover, a comparison between the skip-gram and the continuous bag of words (CBOW) word2Vec word embedding models has been made. We have built these models using the Keras library and run-on Google Colab Jupiter notebook to run seamlessly. Finally, the proposed system is evaluated through ROUGE-1, ROUGE-2, ROUGE-L, and BLEU evaluation metrics. The experimental results show that three layers of BiLSTM hidden states at the encoder achieve the best performance. In addition, our proposed system outperforms the other latest research studies. Also, the results show that abstractive summarization models that use the skip-gram word2Vec model outperform the models that use the CBOW word2Vec model.

Deep learning based sequence to sequence model for abstractive telugu text summarization

Neural Abstractive Text Summarizer for Telugu Language

Neural Sequence-to-Sequence Modeling with Attention by Leveraging Deep Learning Architectures for Enhanced Contextual Understanding in Abstractive Text Summarization

Neural Abstractive Text Summarization with Sequence-to-Sequence Models

An innovative Telugu text summarization framework using the pointer network and optimized attention layer

Abstractive method-based Text Summarization using Bidirectional Long Short-Term Memory and Pointer Generator Mode

A machine translation model for abstractive text summarization based on natural language processing

An abstractive text summarization technique using transformer model with self-attention mechanism

Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyond

Abstractive Arabic Text Summarization Based on Deep Learning

Document vector embedding based extractive text summarization system for Hindi and English text

GAE-ISumm: Unsupervised Graph-Based Summarization of Indian Languages

Abstractive Summarization Using Attentive Neural Techniques

Topic-Aware Abstractive Text Summarization

Bidirectional Attentional Encoder-Decoder Model and Bidirectional Beam Search for Abstractive Summarization

Hierarchical Human-Like Deep Neural Networks for Abstractive Text Summarization

Assessment of Transformer-Based Encoder-Decoder Model for Human-Like Summarization

Improving Sequence-to-Sequence Models for Abstractive Text Summarization Using Meta Heuristic Approaches

Abstractive and Extractive Text Summarization using Document Context Vector and Recurrent Neural Networks

Abstractive Text Summarization by Incorporating Reader Comments.

Attention based Recurrent Neural Network for Nepali Text Summarization