Extended Multi-modality Features and Deep Learning Based Microblog Short Text Sentiment Analysis

Sun Xiao,Peng Xiaoqi,Hu Min,Ren Fuji
DOI: https://doi.org/10.11999/jeit160975
2017-01-01
Abstract:This paper presents a Deep Belief Nets (DBN) model and a multi-modality feature extraction method to extend features, dimensionalities of short text for Chinese microblogging sentiment classification. Besides traditional features sets for document classification, comments for certain posts are also extracted as part of the microblogging features according to the relationship between commenters and posters through constructing microblogging social network as input information. Multi-modality features are combined and adopted as the input vector for DBN. A DBN model, which is stacked with several layers of Restricted Boltzmann Machine (RBM), is implemented to initialize the structure of neural network. The RBM layers can take probability distribution samples of input data to learn hidden syntactic structures for better feature representation. A Classification RBM (ClassRBM) layer, which is stacked on top of the former RBM layers, is adapted to achieve the final sentiment classification. The results demonstrate that, with proper structure and parameter, the performance of the proposed deep learning method on sentiment classification is better than the state of the art surface learning models such as SVM or NB, which proves that DBN is suitable for short-length document classification with the proposed feature dimensionality extension method.
What problem does this paper attempt to address?