Abstract:In social network, users can manage their social network and social identity, publish information on various topics, and obtain information published by other users through friend relationship. The resulting large amount of text data attract more and more scholars to study it. Text sentiment analysis has become a hot spot in social network data analysis and has important application value in academic field, social field, and business field. Based on the idea of pre-training, this paper improves the random word masking algorithm of deep pretraining task in the BERT (Bidirectional Encoder Representation) model to improve the efficiency and stability of model pretraining. Second, a new pretraining task of original sentence judgment is designed to enable the model to measure the degree of sentence smoothness, so that the BERT model can better understand the semantics of context. By referring to the idea of attention mechanism, a deep learning framework with attention weight added into gated convolution is constructed and the special attention weight method is adopted to enhance semantic information. Second, gating convolution and attention mechanism are combined to model aspect-related semantic information and text complete semantic information. Finally, classify the emotion classifier layer of social network, use Softmax function to complete negative, positive, and neutral multiple classifications and calculate the result of emotion classification. By applying the optimized convolutional neural network cyclic optimization network to single task and multitask in practice, the feasibility of applying the optimized convolutional neural network and cyclic neural network to social network sentiment analysis is verified.

Transfer Pretrained Sentence Encoder to Sentiment Classification.

Self-attention Transfer Networks for Speech Emotion Recognition

Natural Language Processing Through Transfer Learning: A Case Study on Sentiment Analysis

Cross-Lingual Propagation for Deep Sentiment Analysis

Leveraging Sparse and Dense Feature Combinations for Sentiment Classification

Transferring Vision-Language Models for Visual Recognition: A Classifier Perspective

Application of the Deep Pretrained Language Model Processing Method in Social Network Sentiment Analysis

A GAN-based Transfer Learning Approach for Sentiment Analysis

On the Sentence Embeddings from Pre-trained Language Models

Transfer Learning for Sentiment Classification Using Bidirectional Encoder Representations from Transformers (BERT) Model

MEDT: Using Multimodal Encoding-Decoding Network as in Transformer for Multimodal Sentiment Analysis

Visual Sentiment Analysis Using Deep Learning Models with Social Media Data

Practical Text Classification With Large Pre-Trained Language Models

Incorporating Pre-trained Transformer Models into TextCNN for Sentiment Analysis on Software Engineering Texts

Word Embedding Dropout And Variable-Length Convolution Window In Convolutional Neural Network For Sentiment Classification

Sentiment Lexicon Enhanced Neural Sentiment Classification

A deep learning classifier for sentence classification in biomedical and computer science abstracts

Deep Learning Paradigm with Transformed Monolingual Word Embeddings for Multilingual Sentiment Analysis

Sentiment Commonsense Induced Sequential Neural Networks for Sentiment Classification.

Encoding Syntactic Knowledge in Neural Networks for Sentiment Classification.

Performance Evaluation and Comparison using Deep Learning Techniques in Sentiment Analysis