Abstract:Recently, with the rapid developments of the Internet and social networks, there have been tremendous increase in the amount of complex-structured text resources. These information explosions require extensive studies as well as more advanced methods in order to better understand and effectively model/learn these high-dimensional/structure-complicated textual datasets. Moving along with the recent progresses in deep learning and textual representation learning approaches, many researchers in this domain have been attracted by utilizing different deep neural architectures for learning essential features from texts. These novel neural architectures must enable to handle complex textual feature engineering. Moreover, it also has to be able to extract deeper semantic and structural information from textual resources. Recently, there are several integrations between advanced deep learning architectures, such as recurrent neural networks (RNNs), sequence-to-sequence (seq2seq) and transformers in text classification have been proposed. These hybrid deep neural architectures have shed light on how computers can comprehensively process sequential information from texts to fine-tune for leveraging the performance of multiple tasks in natural language processing, including classification. However, most of recent RNN-based techniques still suffer from several limitations. These limitations are mainly related to the capability of capturing the global long-range dependent as well syntactical structures of the given text corpus. There are some recent studies have shown that a combination of graph-based text representation and graph neural network (GNN) approaches can cope with these challenges. In this survey works, we mainly focus on discussing about recent state-of-the-art studies which are mainly dedicated on the text graph representation learning through GNN, named as TG-GNN. In addition, beside the TG-GNN based models’ features and capability discussions, we also mentioned about the pros/cons. Extensive comparative studies of TG-GNN based techniques in benchmark datasets for text classification problem are also provided in this survey. Finally, we highlight existing challenges as well as identify perspectives which might be useful for future improvements in this research direction.

Deep Learning, Graph-Based Text Representation and Classification: a Survey, Perspectives and Challenges

Graph Neural Networks for Text Classification: A Survey

A survey of graph neural networks in various learning paradigms: methods, applications, and challenges

An Integrated Graph-of-Words with Tensor Graph Neural Network Learning Paradigm for Text Classification

Graph Neural Networks for Natural Language Processing: A Survey

A Survey on Text Classification: From Traditional to Deep Learning

Connecting the Dots: What Graph-Based Text Representations Work Best for Text Classification Using Graph Neural Networks?

Deep Learning on Graphs: A Survey

A Survey on Text Classification: From Shallow to Deep Learning

A Comprehensive Survey on Deep Graph Representation Learning Methods

Text Classification using Graph Convolutional Networks: A Comprehensive Survey

Graph neural networks in vision-language image understanding: a survey

Graph Neural Networks for Intelligent Modelling in Network Management and Orchestration: A Survey on Communications

Graph Neural Networks: Methods, Applications, and Opportunities

The Evolution of Distributed Systems for Graph Neural Networks and their Origin in Graph Processing and Deep Learning: A Survey

Text Classification: A Perspective of Deep Learning Methods

A Systematic Review of Deep Graph Neural Networks: Challenges, Classification, Architectures, Applications & Potential Utility in Bioinformatics

Graph-level Neural Networks: Current Progress and Future Directions

A Survey of Text Representation Methods and Their Genealogy