News Topic Detection Approach on Chinese Microblog

Zheng Feiran,Duoqian Miao,Zhifei Zhang,Chengde Gao

2012-01-01

Computer Science

Abstract:The popularity of microblogging brings another form of social news media.The paper proposed an approach of news topics mining from microblog.News topics were formed by finding the emerging

What problem does this paper attempt to address?

Chinese Microblog Topic Detection through POS-Based Semantic Expansion

Lianhong Ding,Bin Sun,Peng Shi

DOI: https://doi.org/10.3390/info9080203

2018-08-10

Information

Abstract:A microblog is a new type of social media for information publishing, acquiring, and spreading. Finding the significant topics of a microblog is necessary for popularity tracing and public opinion following. This paper puts forward a method to detect topics from Chinese microblogs. Since traditional methods showed low performance on a short text from a microblog, we put forward a topic detection method based on the semantic description of the microblog post. The semantic expansion of the post supplies more information and clues for topic detection. First, semantic features are extracted from a microblog post. Second, the semantic features are expanded according to a thesaurus. Here TongYiCi CiLin is used as the lexical resource to find words with the same meaning. To overcome the polysemy problem, several semantic expansion strategies based on part-of-speech are introduced and compared. Third, an approach to detect topics based on semantic descriptions and an improved incremental clustering algorithm is introduced. A dataset from Sina Weibo is employed to evaluate our method. Experimental results show that our method can bring about better results both for post clustering and topic detection in Chinese microblogs. We also found that the semantic expansion of nouns is far more efficient than for other parts of speech. The potential mechanism of the phenomenon is also analyzed and discussed.
A Popular Topic Detection Method based on Microblog Images and Short Text Information

Wenjun Liu,Hai Wang,Jieyang Wang,Huan Guo,Yuyan Sun,Mengshu Hou,Bao Yu,Hailan Wang,Qingcheng Peng,Chao Zhang,Cheng Liu

DOI: https://doi.org/10.1016/j.websem.2024.100820

2024-05-09

Web Semantics

Abstract:Popular topic detection is a topic identification by the information of documents posted by users in social networking platforms. In a large body of research literature, most popular topic detection methods identify the distribution of unknown topics by integrating information from documents based on social networking platforms. However, among these popular topic detection methods, most of them have a low accuracy in topic detection due to the short text content and the abundance of useless punctuation marks and emoticons. Image information in short texts has also been overlooked, while this information may contain the real topic matter of the user's posted content. In order to solve the above problems and improve the quality of topic detection, this paper proposes a popular topic detection method based on microblog images and short text information. The method uses an image description model to obtain more information about short texts, identifies hot words by a new word discovery algorithm in the preprocessing stage, and uses a PTM model to improve the quality and effectiveness of topic detection during topic detection and aggregation. The experimental results show that the topic detection method in this paper improves the values of evaluation indicators compared with the other three topic detection methods. In conclusion, the popular topic detection method proposed in this paper can improve the performance of topic detection by integrating microblog images and short text information, and outperforms other topic detection methods selected in this paper.
A System to Manage and Mine Microblogging Data.

Zhongying Zhao,Yong Zhang,Chao Li,Li Ning,Jiancong Fan

DOI: https://doi.org/10.3233/jifs-161622

2017-01-01

Journal of Intelligent & Fuzzy Systems

Abstract:Microblogging, an internet-based social media application, is well adopted by people to show their ideas and to exchange their minds. It is also a valuable resource to capture people's interests, thoughts and actions. The contents that people posted are widely spread with distinctive topical feature and contain sentiment-rich information of individuals. In this paper, a microblogging data mining system is developed, which has three functional modules: data preparation, topic analysis and sentiment computing. In data preparation, the microblogging data collecting module is implemented by hadoop and a storm based managing and preprocessing module is designed so that the data is processed effectively and efficiently. For the topic analysis, an LDA based method is adopted to detect topics hidden in microblogs. We also propose a method to calculate the hot degree of each topic and to track the topic evolution. For the sentiment analysis, an integrated method by combining the emotion and the dictionary is introduced to quantify the sentiment. Furthermore, the system is used to make a spatial sentimental analysis on microblogging data from all provinces of China. The sentiment changes with topic or event are also presented with visualization.
Topic Detection in News Video and Audio

陈凯江,欧嘉致,黄萱菁,吴立德

DOI: https://doi.org/10.3969/j.issn.1002-137X.2002.11.026

2002-01-01

Computer Science

Abstract:Topic Detection in News Video and Audio is to automatically detect snippets with a topic the user searches for, in the news streams, including video,audio and broadcasting. It is a novel research scope rises along with the rapid development of multimedia technology, automatic speech recognition and natural language processing. This technology detects the topic of the news in the semantic level and fits for most people's retrieval need.
Incorporating Sentiment Series into Trending Topic Detection on Microblog

LI BinYang,HAN Xu,PENG BaoLin,LI Jing,WANG TengJiao,WONG Kam-Fai

DOI: https://doi.org/10.1360/n112015-00249

2015-01-01

Abstract:Twitter plays a significant role in information diffusion, and it has evolved to become an important information resource as well as news feed.There is a widespread interest in what is happening on Twitter, and the instantaneous news information that is passed on.However, with the large amount of data, it is impossible to manually determine what topic is trending, which makes real-time topic detection attractive and significant.Furthermore, Twitter provides a platform for the sharing of opinions and providing feedback for events, news, and products, etc.Because users tend to express their real thoughts on Twitter, it is recognized as a valuable source of opinions.Nevertheless, most works about trending topic detection fail to consider sentiments.In this work, we develop a non-parametric supervised real-time-trending topic-detection model with a sentimental feature.By performing experiments, we show that our model successfully detects trending sentimental topic in a short time.After applying a combination of multiple features, e.g., tweet volume and user volume, the proposed model demonstrates impressive effectiveness with an 82.3% recall rate, surpassing all of the competitors.
Multi Feature Extraction and Trend Prediction for Weibo Topic Dissemination Network

Zhian Yang,Hao Jiang,Lingyue Huang,Yiming Liu

DOI: https://doi.org/10.1007/s11265-023-01905-4

2024-02-13

Journal of Signal Processing Systems

Abstract:In the era of big data, the extensive collection and dissemination of information has brought new security challenges, and how to ensure the security of big data under the premise of ensuring the normal operation of the topic transmission network has become an urgent problem to be solved. Online social networks have become the main channels and carriers for obtaining and disseminating information. Current social events and trending topics are transmitted in the form of topics on the microblog platform. Therefore, studying the evolution process and development trend of microblog topic communication is of great significance for public opinion monitoring, crisis prevention and control, early warning, and precision marketing. A multi-feature metric analysis method is designed for the influencing factors in the process of topic propagation, and the influencing factors are divided into two levels: content characteristics and structural characteristics. Aiming at the problem of Weibo topic trend prediction, this paper proposes a micro-blog topic trend prediction model, G-Informer, which integrates graph attention. Considering the graph structure and time evolution characteristics of the topic in the process of propagation evolution, the experimental results show that the G-Informer model in this paper has certain advantages in predicting the trend of microblog topics and has good robustness for predicting long series.

computer science, information systems,engineering, electrical & electronic
5WTAG: Detecting the Topics of Chinese Microblogs Based on 5W Model

Zhao Zhibin,Jia Yanfeng,Yao Lan,Yu Ge,Li Xiangyang

DOI: https://doi.org/10.1109/wisa.2013.52

2013-01-01

Abstract:A hash tag is an important metadata in micro blogs and used to mark topics or index messages. However, statistics show hash tags are absent from most of the micro blogs. It poses great challenges to the retrieve and analysis of these tagless micro blogs. In this paper, we summarize the similarity between micro blogs and short message news, and then propose an algorithm named 5WTAG for detecting micro blog topics based on 5W (When, Where, Who, What, how) model. Since 5W attributes are the core components in event description, it is guaranteed theoretically that 5WTAG can extract the semantics of the micro blogs properly. We introduce the detailed procedure of 5WTAG in this paper including the candidate hash tag construction and recommendation computation. Finally, we verify the semantical correctness of the candidate hash tags as well as the effectiveness of recommendation computation using the real data set from Sina Weibo.
Thread Cleaning and Merging for Microblog Topic Detection.

Jianfeng Zhang,Yunqing Xia,Bin Ma,Jian-Min Yao,Yu Hong

2011-01-01

Abstract:As a classic natural language processing technology, topic detection recently attracts more research interests due largely to the rapid development of microblog. The most challenging issue in microblog topic detection is sparse data problem. In this paper, the temporal-author-topic (TAT) model is designed to accomplish microblog topic detection in two phases. In the first phase, the TAT model is applied to clean the thread, namely, to filter noisy microblog texts out of each thread. In the second phase, microblog texts within each thread are merged to form the thread text so that the TAT model is applied to find global topics. The new approach differs from the Hierarchical Agglomerative Clustering (HAC) algorithm by making use of microblog threads to overcome the sparse data problem. Experimental results justify our claims.
Bursty Feature Based Topic Detction and Summarization

Xiongjun Liang,Wei Chen,Jiajun Bu

DOI: https://doi.org/10.1109/iccet.2010.5486273

2010-01-01

Abstract:Thousands of news is available on the Web every day, it is almost impossible for people to read all of them. Because people are usually interested in “what's new”, or “what's hot”, it is quite necessary to find out these hot topics. In this paper, we propose a bursty feature based topic detection and automatic summarization method, which can help people have a gist of what's happening daily. It first identifies bursty features in the news stream; and then these features are grouped into topics; finally, a centroid based summarization method is used to generate summary. Through the proposed method, bursty topic can be detected quickly, and the generated summary can help people get the general idea of the topic effectively.
News Topic Discovery Through Community Detection

Daqing Wu,Xiangyang Guo,Jinwen Ma

DOI: https://doi.org/10.1109/icsidp47821.2019.9173189

2019-01-01

Abstract:With the rapid development of communication and internet, there are a huge number of items of news every day. According to the characteristics of news dissemination, many pieces of news will focus on one topic about the same event or person. So, news topic discovery becomes a very important and urgent task in text mining. In fact, for news topic discovery, Latent Dirichlet Allocation (LDA) is the most frequently used model which considers each document being generated from a finite mixture of $K$ possible topics. However, the performance of LDA is not so satisfactory in practical applications. In this paper, we try to solve this problem through text structure mining. Our proposed method consists of two steps. The first step is to find out the topics as the clusters or communities of all the news items through the method of community detection, while the second step is to utilize the Bayesian unigram model to obtain the topic tokens for each topic. It is demonstrated by the experimental results that our proposed method can find out the topics much better than LDA on a real world news dataset.
Mining the Interests of Chinese Microbloggers Via Keyword Extraction

Zhiyuan Liu,Xinxiong Chen,Maosong Sun

DOI: https://doi.org/10.1007/s11704-011-1174-8

2012-01-01

Abstract:Microblogging provides a new platform for communicating and sharing information among Web users. Users can express opinions and record daily life using microblogs. Microblogs that are posted by users indicate their interests to some extent. We aim to mine user interests via keyword extraction from microblogs. Traditional keyword extraction methods are usually designed for formal documents such as news articles or scientific papers. Messages posted by microblogging users, however, are usually noisy and full of new words, which is a challenge for keyword extraction. In this paper, we combine a translation-based method with a frequency-based method for keyword extraction. In our experiments, we extract keywords for microblog users from the largest microblogging website in China, Sina Weibo. The results show that our method can identify users' interests accurately and efficiently.
Design and Application of an On-line News Topic Detection System

万小军,杨建武

DOI: https://doi.org/10.3321/j.issn:1000-565X.2004.z1.009

2004-01-01

Abstract:Topic detection technique can be used to detect news topics from a great amount of news stream, and help us organize and utilize news information according to their topics. A Chinese news topic detection system is designed and tested by using the improved time window strategy and adopting the self-adaptive inverse document frequency. It is then indicated that the proposed system is effective. The application of the system in the data center of XinHua Net further illustrates that the system meet the application demands well.
Visual Analysis for Microblog Topic Modeling

Zhen-Huang WANG,Si-Ming CHEN,Xiao-Ru YUAN

DOI: https://doi.org/10.13328/j.cnki.jos.005261

2018-01-01

Abstract:With the development and increasing impact of social media (e.g.microblog),it is critical to analyze the topic of the microblog.Topic modeling can extract topics from text data.However,it is a challenging task on the microblog data,due to the short content,heavy noises and limited amount of information in each microblog message.This article proposes a visual analytics system for microblog topic modeling.The proposed system enables the visual exploration and analysis process of the topic modeling results of microblogs with multiple linked views and interactions.It considers user behaviors and time effects in the topic modeling process.Users can analyze topics of microblog from multiple perspectives.The system also supports interactive topic editing to improve the topic modeling results in accuracy and reliability.The case study confirms that the described system can effectively help users analyze the Sina Weibo contents interactively.
New words discovery in microblog content

Shuai Huo,Min Zhang,Yiqun Liu,Shaoping Ma

DOI: https://doi.org/10.3969/j.issn.1003-6059.2014.02.007

2014-01-01

Abstract:New words discovery is of great significance in the field of natural language processing. It is more difficult to find new words in microblog than in other corpus. In this paper, an algorithm based on context entropy is proposed, and the new word candidates are filtered based on the context. To improve the precision, lexical features are introduced and an algorithm combining them with term frequency is put forward. Thus, the precision rate and the recall rate are greatly improved, and the F-measure value is up to 89 . 6%.
Lexicon-Based Sentiment Analysis on Topical Chinese Microblog Messages.

Anqi Cui,Haochen Zhang,Yiqun Liu,Min Zhang,Shaoping Ma

DOI: https://doi.org/10.1007/978-1-4614-6880-6_29

2013-01-01

Abstract:Microblogging is a popular social media where people express their opinions and sentiment on social topics. The Chinese microblogging service, called Weibo, has become a remarkable media in the Chinese society. People are eager to know others’ attitudes towards social events; thus sentiment analysis on those topical microblog messages is important. In this paper we introduce a lexicon-based sentiment analysis method. We construct a Weibo Lexicon with representative topical words and out-of-vocabulary (OOV) words, which are usually informal and are not existing in formal dictionaries. In addition, we use a propagation algorithm to automatically assign sentiment polarity scores to the discovered words. These scores are more closely reflecting the Weibo context since words may have new or opposite polarities instead of their formal meanings. Evaluations on the classification tasks show that our method is effective on recognizing the subjectivity and sentiment of Weibo sentences. The Weibo lexicon increases the performance of the classifications.
Topic Sentiment Analysis in Chinese News

Chunping Ouyang,Wen Zhou,Ying Yu,Liu Zhiming,Yang Xiaohua

DOI: https://doi.org/10.14257/ijmue.2014.9.11.37

2014-01-01

International Journal of Multimedia and Ubiquitous Engineering

Abstract:Sentiment analysis in news is different from normal text sentiment analysis. News usually have a specific topic, a focus semantic emotion, therefore, this paper, based on the principal of using Emotion Dependency Tuple (EDT) as the basic unit of news emotion analysis, resolves topic sentiment analysis in news into three progressive sub-problem, namely, topic sentence recognition, EDT extraction and topic sentiment analysis. We use an improved TF- IDF and cross entropy to extract feature set of topics. Then, based on space vector model, calculate the topic association of a sentence and extract topic sentence. Finally, we construct topic sentence based on EDT and complete clustering of news topic sentiment. This method is evaluated using COAE2014 dataset, and differential means shows that our results close to the best results. This shows that the topic based EDT could effectively improve performance of sentiment analysis in news.
On-Line Topic Detection Using Named Entity Recognition

Yan FU,Dongqing YANG,Shiwei TANG,Wei WU,Tengjiao WANG,Jun GAO

DOI: https://doi.org/10.3321/j.issn:0479-8023.2009.02.008

2009-01-01

Abstract:In order to make on-line topic detection more efficient, a new method is proposed based on named entity recognition. New method extracts news elements from stories. Based on news elements, query composition is used to detect story link. This process reduces complex computation of text similarities. Experimental result indicates that the proposed method performs on-link topic detection accurately and efficiently.
NewsMiner: Multifaceted News Analysis for Event Search

Lei Hou,Juanzi Li,Zhichun Wang,Jie Tang,Peng Zhang,Ruibing Yang,Qian Zheng

DOI: https://doi.org/10.1016/j.knosys.2014.11.017

IF: 8.139

2014-01-01

Knowledge-Based Systems

Abstract:Online news has become increasingly prevalent due to its convenience for information acquisition, and meanwhile the rapid development of social applications enables news generate and spread through various ways at an unprecedented rate. How to organize and integrate news from multiple sources, and how to analyze and present news to users are two challenging problems. In this article, we represent news as a link-centric heterogeneous network and formalize news analysis and mining task as link discovery problem. More specifically, we propose a co-mention and context based knowledge linking method and a topic-level social content alignment method to establish the links between news and external sources (i.e. knowledge base and social content), and introduce a unified probabilistic model for topic extraction and inner relationship discovery within events. We further present a multifaceted ranking strategy to rank the linked events, topics and entities simultaneously. Extensive experiments demonstrate the advantage of the proposed approaches over baseline methods and the online system we developed (i.e. NewsMiner) has been running for more than three years.
Sentiment Analysis for Topics Based on Interaction Chain Model.

Ning Gu,Duo-yong Sun,Bo Li,Ze Li

DOI: https://doi.org/10.1109/eisic.2015.23

2015-01-01

Abstract:With the rapid development of Internet and Web 2.0, online social networks, such as Facebook, Twitter, LinkedIn, have become valuable sources for public opinion mining and sentiment analysis. Millions of users are sharing their views and discussing current issues through social media every day. Microblog, as a convenient and easily access platform, also attracts more and more people to express their feelings about hot topics. However, as the maximum message length is only 140 characters in microblog, traditional sentiment analysis methods for topics cannot well performed due to the lack of information. In this paper, we propose a novel sentiment analysis methods based on interaction chain. Firstly, we organize messages as interaction-chains by taking advantages of the explicit interaction markers in microblog. Then, interaction-chains are clustered into different topics by comparing the similarity among them. After that, we perform sentiment analysis using semantic-based SBV polarity algorithm. We also proposed two heuristics according to the specificities of microblog. Experimental evaluations show that the proposed heuristic interaction-chain-based algorithm can extract discriminative and meaningful topics and could conduct sentiment analysis effectively.
Retweet Behavior Prediction Using Topic Model

Ya GUO,Yeyun GONG,Qi ZHANG,Xuanjing HUANG

DOI: https://doi.org/10.3969/j.issn.1003-0077.2018.04.016

2018-01-01

Abstract:In the Microblogging service,retweeting is a key behavior for information diffusion.The task of predic-ting retweet behavior is an important step for various social network applications,such as social marketing,microb-log retrieval,popular event prediction,and so on.We collect a large number of microblogs and the corresponding social networks from Sina Weibo,and discover several factors which affect users'retweet behavior:author of the tweet,user interest and popularity of the tweet.Then we propose a novel retweet behavior prediction method based on LDA model to combine structural,textual and author information.To evaluate the proposed method,we simu-late the real user environment on the constructed dataset.Experimental results demonstrate that the proposed meth-od can achieve better performance than state-of-the-art methods.The relative improvement of the proposed over the baseline method is more than 35%-45% in terms of F1-Score.

News Topic Detection Approach on Chinese Microblog

Chinese Microblog Topic Detection through POS-Based Semantic Expansion

A Popular Topic Detection Method based on Microblog Images and Short Text Information

A System to Manage and Mine Microblogging Data.

Topic Detection in News Video and Audio

Incorporating Sentiment Series into Trending Topic Detection on Microblog

Multi Feature Extraction and Trend Prediction for Weibo Topic Dissemination Network

5WTAG: Detecting the Topics of Chinese Microblogs Based on 5W Model

Thread Cleaning and Merging for Microblog Topic Detection.

Bursty Feature Based Topic Detction and Summarization

News Topic Discovery Through Community Detection

Mining the Interests of Chinese Microbloggers Via Keyword Extraction

Design and Application of an On-line News Topic Detection System

Visual Analysis for Microblog Topic Modeling

New words discovery in microblog content

Lexicon-Based Sentiment Analysis on Topical Chinese Microblog Messages.

Topic Sentiment Analysis in Chinese News

On-Line Topic Detection Using Named Entity Recognition

NewsMiner: Multifaceted News Analysis for Event Search

Sentiment Analysis for Topics Based on Interaction Chain Model.

Retweet Behavior Prediction Using Topic Model