Method of Sina microblogging big data grabbing based on multi-strategy and its application

Xiao SUN,Jia-qi YE,Chen-yi TANG,Fu-ji REN
DOI: https://doi.org/10.3969/j.issn.1003-5060.2014.10.012
2014-01-01
Abstract:Dealing with microblogging data belongs to big data areas ,and the premise is to obtain a large a-mount of microblogging data .For the commercial interests as well as security considerations ,the access to the microblogging data is more and more difficult and the Sina official open API does not support large data plug-in .In this paper ,a mining scheme ,w hich is mainly based on the access mechanism of multi-strategy and ex-isting resources ,is designed to catch data stably from Sina microblog .And an example of its application in sentiment analysis is given .The test results show that the proposed mining scheme can catch microblogging data as needed and it is suitable for the sentiment analysis of microblog .
What problem does this paper attempt to address?