Abstract:Sentiment analysis is a branch of natural language analytics that aims to correlate what is expressed which comes normally within unstructured format with what is believed and learnt. Several attempts have tried to address this gap (i.e., Naive Bayes, RNN, LSTM, word embedding, etc.), even though the deep learning models achieved high performance, their generative process remains a "black-box" and not fully disclosed due to the high dimensional feature and the non-deterministic weights assignment. Meanwhile, graphs are becoming more popular when modeling complex systems while being traceable and understood. Here, we reveal that a good trade-off transparency and efficiency could be achieved with a Deep Neural Network by exploring the Credit Assignment Paths theory. To this end, we propose a novel algorithm which alleviates the features' extraction mechanism and attributes an importance level of selected neurons by applying a deterministic edge/node embeddings with attention scores on the input unit and backward path respectively. We experiment on the Twitter Health News dataset were the model has been extended to approach different approximations (tweet/aspect and tweets' source levels, frequency, polarity/subjectivity), it was also transparent and traceable. Moreover, results of comparing with four recent models on same data corpus for tweets analysis showed a rapid convergence with an overall accuracy of ≈83% and 94% of correctly identified true positive sentiments. Therefore, weights can be ideally assigned to specific active features by following the proposed method. As opposite to other compared works, the inferred features are conditioned through the users' preferences (i.e., frequency degree) and via the activation's derivatives (i.e., reject feature if not scored). Future direction will address the inductive aspect of graph embeddings to include dynamic graph structures and expand the model resiliency by considering other datasets like SemEval task7, covid-19 tweets, etc.

Tree Communication Models for Sentiment Analysis

Tree-based Convolution for Sentence Modeling.

When Are Tree Structures Necessary for Deep Learning of Representations?

Modeling Structured Dependency Tree with Graph Convolutional Networks for Aspect-Level Sentiment Classification

Latent Variable Sentiment Grammar

Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks

Tree-based convolution: A new architecture for sentence modeling

Discriminative Neural Sentence Modeling by Tree-Based Convolution

Opinion Tree Parsing for Aspect-based Sentiment Analysis

Learning to Compose over Tree Structures via POS Tags

Encoding Syntactic Knowledge in Neural Networks for Sentiment Classification.

Integrated Syntactic and Semantic Tree for Targeted Sentiment Classification Using Dual-Channel Graph Convolutional Network

Combining Convolution and Recursive Neural Networks for Sentiment Analysis

Text Sentiment Analysis Based on Convolutional Neural Network and Bidirectional LSTM Model.

An Augmented Neural Network for Sentiment Analysis Using Grammar

Twain-GCN: twain-syntax graph convolutional networks for aspect-based sentiment analysis

On Tree-Based Neural Sentence Modeling

An investigation into the deep learning approach in sentimental analysis using graph-based theories

Convolution over Hierarchical Syntactic and Lexical Graphs for Aspect Level Sentiment Analysis

Tree-Structured Neural Machine for Linguistics-Aware Sentence Generation

TreeNet: Learning Sentence Representations with Unconstrained Tree Structure.