A Political News Corpus in Chinese for Opinion Analysis.

Benjamin K. Tsou,Bin Lu

2008-01-01

Abstract:In this paper, we present an annotated corpus of political election news in Chinese for opinion analysis, and discuss some issues in the manual annotation process. The annotation scheme is described with examples, and inter-annotator agreement is explored for different levels of annotation: expression, sentence and document.

What problem does this paper attempt to address?

Opinion Annotation in On-line Chinese Product Reviews

Xu Ruifeng,Xia Yunqing,Wong Kam-Fai,Li Wenjie

2008-01-01

Abstract:This paper presents the design and construction of a Chinese opinion corpus. Based on the observation on the characteristics of opinion expression in Chinese online product reviews, which is quite different from in the formal texts such as news, an annotation framework is proposed to guide the construction of an opinion corpus based on online product reviews. The opinionated sentences are manually identified from the review text. Furthermore, for each comment in the opinionated sentences, its 13 describing elements are annotated including the expressions related to the target product attributes and user opinion expressions as well as the polarity and degree of the opinions. Currently, 12,724 comments are annotated in 10,935 sentences from product reviews. Through statistical observation on the opinion corpus, some interesting characteristics of Chinese opinion expression are presented. This corpus is helpful to support systematic research on Chinese opinion analysis.
Manually Crafted Chinese Text Corpus for Text Emotion Recognition.

Bo Gao,Fan Zhang

DOI: https://doi.org/10.1109/ijcnn54540.2023.10191747

2023-01-01

Abstract:Aiming at the scarcity of high-quality emotion corpus resources in the current Chinese text emotion recognition task, we have manually completed the annotation of 35,000 text data in seven typical emotion classes. At the same time, we also proposed a text emotion recognition model ERNIE-BiLSTM based on enhanced language representation with information entities (ERNIE) and bidirectional long short-term memory network (BiLSTM). The model can effectively extract text semantics and capture context information, which can greatly improve the capability of text emotion recognition. Finally, the model achieved good recognition performance on our text emotion corpus, with the accuracy, precision, recall, and F1 score reaching as high as 93.29%, 93.05%, 93.04%, and 92.98%, respectively.
A Manually Annotated Chinese Corpus for Non-task-oriented Dialogue Systems

Jing Li,Yan Song,Haisong Zhang,Shuming Shi

DOI: https://doi.org/10.48550/arXiv.1805.05542

2018-05-15

Computation and Language

Abstract:This paper presents a large-scale corpus for non-task-oriented dialogue response selection, which contains over 27K distinct prompts more than 82K responses collected from social media. To annotate this corpus, we define a 5-grade rating scheme: bad, mediocre, acceptable, good, and excellent, according to the relevance, coherence, informativeness, interestingness, and the potential to move a conversation forward. To test the validity and usefulness of the produced corpus, we compare various unsupervised and supervised models for response selection. Experimental results confirm that the proposed corpus is helpful in training response selection models.
A Contrastive Corpus Study on Lexical Features of the English Translation of the Report of the 20th and 19th CPC National Congress

Yiyu Zhang,Lin Wang,Wenming Hu,Xiajing Yao

DOI: https://doi.org/10.1051/shsconf/202315503017

2023-01-13

SHS Web of Conferences

Abstract:As the channel spreads the Chinese voice and promotes Chinese culture, the status of political document translation is self-evident with the deepening of global communication. Taking the English translation of the reports of the 20th and the 19th CPC National Congress as examples, this paper makes a contrastive study of their lexical features in a corpus-based way. With the assistance of corpus analysis software such as AntConc, TagAnt and WordSmith4.0, the author investigates TTR (type-token ratio), lexical density, average sentence length, high-frequency words, and keywords between two reports. It is found that the report of the 20th CPC Nation Congress has more diversified and native expressions with fewer words used, which provides a guiding significance for the English translation of political documents.
Statistical language model-based analysis of the English-Chinese corpus and political discourse

Xueyu Sun,Songsong Zhang

DOI: https://doi.org/10.2478/amns.2023.2.00387

2023-09-27

Applied Mathematics and Nonlinear Sciences

Abstract:Abstract Politics and political discourse are closely related to people’s daily life, and this study aims to propose a new approach to political discourse analysis by combining English and Chinese corpora. By exploring the composition of formal language and the grammar generation process, this paper proposes an improved N-gram algorithm to address the shortcomings of the N-gram model in dealing with low-frequency words with low accuracy and uses the strategy of introducing alternative words to alleviate the problem of sparse data. Then, a critical metaphor analysis of political discourse in the English-Chinese corpus is conducted based on the improved statistical language model, and the convergence of political discourse is studied in terms of space and time. By analyzing the political discourse of American presidents, the spatial centrality factors of “we” and “our nation” were accurately extracted, and their correlations were 0.83, 0.73, 0.68, 0.51, 0.76, and 0.41 in order. The correlations of the unqualified facsimile noun phrases in the temporal convergence of political discourse reached 0.28, 0.25, 0.72, 0.68, and 0.54, respectively, and the accuracy of the improved N-gram model improved by about 28.1% compared with the traditional method, making using statistical linguistic models for political discourse analysis feasible and applicable.
Annotating the Contemporary Chinese Corpus

Qiang Zhou,Shiwen Yu

DOI: https://doi.org/10.1075/ijcl.2.2.05qia

1997-01-01

International Journal of Corpus Linguistics

Abstract:In recent years, great progress has been made in Chinese corpus processing. A fifty-million-word Chinese National Corpus project has been put into effect, and many automatic corpus processing programs have also been developed. In this paper, we will briefly introduce our work on constructing a large scale annotated corpus for Chinese grammatical research and developing a Chinese Corpus Multilevel Processing system—CCMP. First, we present our annotation scheme. Second, we discuss some basic methodologies for Chinese corpus analysis and propose a man-machine mutually dependent corpus processing model. Finally, we introduce the survey of our CCMP. We hope our work will give impetus to further research in Chinese corpus linguistics.
The Moral Foundations Weibo Corpus

Renjie Cao,Miaoyan Hu,Jiahan Wei,Baha Ihnaini

2024-11-15

Abstract:Moral sentiments expressed in natural language significantly influence both online and offline environments, shaping behavioral styles and interaction patterns, including social media selfpresentation, cyberbullying, adherence to social norms, and ethical decision-making. To effectively measure moral sentiments in natural language processing texts, it is crucial to utilize large, annotated datasets that provide nuanced understanding for accurate analysis and modeltraining. However, existing corpora, while valuable, often face linguistic limitations. To address this gap in the Chinese language domain,we introduce the Moral Foundation Weibo Corpus. This corpus consists of 25,671 Chinese comments on Weibo, encompassing six diverse topic areas. Each comment is manually annotated by at least three systematically trained annotators based on ten moral categories derived from a grounded theory of morality. To assess annotator reliability, we present the kappa testresults, a gold standard for measuring consistency. Additionally, we apply several the latest large language models to supplement the manual annotations, conducting analytical experiments to compare their performance and report baseline results for moral sentiment classification.

Computation and Language,Machine Learning
ORCHID: A Chinese Debate Corpus for Target-Independent Stance Detection and Argumentative Dialogue Summarization

Xiutian Zhao,Ke Wang,Wei Peng

DOI: https://doi.org/10.18653/v1/2023.emnlp-main.582

2024-10-17

Abstract:Dialogue agents have been receiving increasing attention for years, and this trend has been further boosted by the recent progress of large language models (LLMs). Stance detection and dialogue summarization are two core tasks of dialogue agents in application scenarios that involve argumentative dialogues. However, research on these tasks is limited by the insufficiency of public datasets, especially for non-English languages. To address this language resource gap in Chinese, we present ORCHID (Oral Chinese Debate), the first Chinese dataset for benchmarking target-independent stance detection and debate summarization. Our dataset consists of 1,218 real-world debates that were conducted in Chinese on 476 unique topics, containing 2,436 stance-specific summaries and 14,133 fully annotated utterances. Besides providing a versatile testbed for future research, we also conduct an empirical study on the dataset and propose an integrated task. The results show the challenging nature of the dataset and suggest a potential of incorporating stance detection in summarization for argumentative dialogue.

Computation and Language
Polarity Classification of Celebrity Coverage in the Chinese Press

Benjamin K. Tsou,Raymond W. M. Yuen,Oi Yee Kwong,Tom B. Y. Lai,Wei Lung Wong

2005-01-01

Abstract:The importance of media opinion on strategic subjects has long been recognized, and increasingly so for the foreign press. Recent interests in the automatic classification of summative views have focused on nglish (Wilson and Wiebe, 2003; Wilson et al., 2003) and have yielded fruitful results (Wiebe and Riloff, 2005). Interests in classifying polarity in the Chinese Press is only beginning (Yuen et al,. 2004). This paper reports on linguistic issues relevant to polarity in Chinese texts and an experimental annotation scheme, the derivation of polarity indices from annotated textual attributes, as well as results obtained from a comparison of manual and automatic classification efforts. Manual classification was performed by 4 trained scorers who used a scale of -5 to 5 to indicate the extent of positive or negative polarity of each news article. There were 600 articles mainly on U.S. and Taiwan presidential elections in 2004. Normalized results on the polarity of the news articles regarding 4 well-known political figures (i.e., John Kerry, George W Bush, Junichiro Koizumi and Chen Shui-bian) show wide variations in the different Chinese communities, represented by Beijing, Hong Kong, Shanghai and Taipei. A system to automatically score the polarity of the sample news articles is introduced, which incorporates initially a set of pre-selected polar lexical items along the lines of Yuen et al. (2004). The Spread, Density and Intensity of polar lexical items are explored. Spread indicates the extent to which the polar lexical items spread over an article in terms of paragraphs or sentences. Density means how extensive polar lexical items are found in the polar paragraphs. Intensity refers to the strength of the polarity of the lexical items. The possible contributions by Spread and Density to improve correlation with manual classification are explored in this paper.
Opinmine - Opinion Analysis System by CUHK for NTCIR-6 Pilot Task.

Ruifeng Xu,Kam-Fai Wong,Yunqing Xia

2007-01-01

Abstract:This paper presents the CUHK opinion analysis system, namely Opinmine, for the NTCIR-6 pilot task. Opinmine comprises of three functional modules: (1) Preprocessing and Assignment Module (PAM) performs word segmentation, part-of-speech (POS) tagging and named entity recognition on the input Chinese text. It is based on lexicalized Hidden Markov Model and heuristic rules. (2) Knowledge Acquisition Module (KAM) applies unsupervised learning techniques to acquire different opinion knowledge including opinion operator, opinion indicator and opinion words from annotated data and Web data. (3) Sentence Analysis Module (SAM) analyzes each input sentence to determine whether it is opinionated. For each opinionated sentence, its opinion holders, opinion operators and opinion words are recognized and its polarity is determined. Furthermore, the relevance between the sentence and a topic are judged by based on sentence-topic and document-topic relevance. For lenient evaluation, the F1 performance of Opinmine in opinion extraction, polarity decision and relevance judgment are 0.635, 0.405 and 0.812, respectively; and for strict evaluation, the F1 performances are 0.427, 0.296 and 0.616, respectively.
Learning multilinguistic knowledge for opinion analysis

Ruifeng Xu,Kam-Fai Wong,Qin Lu,Yunqing Xia

DOI: https://doi.org/10.1007/978-3-540-87442-3_122

2008-01-01

Abstract:Most existing opinion analysis techniques used word-level sentiment knowledge but lack the learning capacity on the behaviors of context-dependent opinion words. Meanwhile, the use of collocation-level sentiment knowledge is not well studied. This paper presents an opinion analysis system, namely OA, which incorporates the word-level and collocation-level sentiment knowledge. Based on the observation on the NTCIR-6 opinion training corpus, some word-level and collocation-level linguistic clues for opinion analysis are discovered. Learning techniques are developed to learn the features corresponding to these discovered clues. These features are in turn incorporated into a classifier based on support vector machine to identify opinionated sentences and determine their polarities from running text. Evaluations on NTCIR-6 opinion testing dataset show that OA achieved promising overall performance. © 2008 Springer-Verlag Berlin Heidelberg.
Supervised Approaches and Dependency Parsing for Chinese Opinion Analysis at NTCIR-8.

Bin Lu,Benjamin K. Tsou,Tao Jiang

2010-01-01

Abstract:In this paper, we describe our participating system, which is based on supervised approaches and dependency parsing, for opinion analysis on traditional Chinese texts at NTCIR-8. For opinionated sentence recognition, the supervised lexicon-based approach, SVM and Maximum Entropy are combined together. For polarity classification, we use only the supervised lexicon-based approach. For opinion holder and target identification, we, on the basis of dependency parsing, identify opinion holders by means of reporting verbs and identify opinion targets by considering both opinion holders and opinion-bearing words. The results show that among all the teams participating in the traditional Chinese task, our system achieve: 1) the highest F-measure on the opinionated sentence recognition task, 2) the second highest F-measure on the identification of both opinion holders and targets, 3) the middle ranking for opinion polarity classification.
A Chinese Corpus for Fine-grained Entity Typing

Chin Lee,Hongliang Dai,Yangqiu Song,Xin Li

DOI: https://doi.org/10.48550/arXiv.2004.08825

2020-04-19

Abstract:Fine-grained entity typing is a challenging task with wide applications. However, most existing datasets for this task are in English. In this paper, we introduce a corpus for Chinese fine-grained entity typing that contains 4,800 mentions manually labeled through crowdsourcing. Each mention is annotated with free-form entity types. To make our dataset useful in more possible scenarios, we also categorize all the fine-grained types into 10 general types. Finally, we conduct experiments with some neural models whose structures are typical in fine-grained entity typing and show how well they perform on our dataset. We also show the possibility of improving Chinese fine-grained entity typing through cross-lingual transfer learning.

Computation and Language
Sentiment and Content Analysis of Chinese News Coverage

Benjamin Ka-Yin T'sou,Oi Yee Kwong,Wei Lung Wong,Tom B. Y. Lai

DOI: https://doi.org/10.1142/s0219427905001249

2005-01-01

International Journal of Computer Processing Of Languages

Abstract:Typical news coverage contains both objective facts and subjective sentiments. This is especially true for newsworthy individuals and organizations, and media opinion on strategic subjects. Analysis either on demand or on a longitudinal basis provides a critical source of information heretofore not readily nor economically obtainable for a range of meaningful purposes. One application is the monitoring of positive or negative summative news coverage on targeted subjects.
Recent Developments in Chinese Corpus Research

Zhan Weidong,Chang Baobao,Duan Huiming,Zhang Huarui

2006-01-01

Abstract:In this paper, the author firstly gives a brief overview of the history of developing Chinese corpora in mainland of China, especially focusing on some representative research projects in the last decade, such as the General Contermporary Chinese Corpus that is sponsored by the State Language Commission of China National Ministry of Education, and the Chinese Corpus of Situated Discourse in Beijing Area that is built up by China Academy of Social Science, and so on. And then the related works in this field made by Peking University on designing, annotating and using of corpus are elaborated. There are four parts are discussed in detail, including (1) a very large scale of wide time-span Chinese corpus using for linguistic research with an on-line KWIC concordance based on Web-Lucene search engine, (2) People Daily corpus which is processed with word segmentation and part-of-speech tagging, (3) a Chinese Treebank. Based on the Treebank, Chinese phrasal constructing rules can be extracted automatically, and the distribution of all kinds of phrases can be described through statistical approach. (4) a Chinese-English parallel corpus based on which a workbench prototype has been built to support Chinese-English lexicography. In the latter part of this paper, the author discusses briefly some issues, which have received more attention in this field recently, including the standardization of Chinese corpora encoding and the approaches to share large-scale Chinese corpora for researches and public use.
Categorizing terms' subjectivity and polarity manually for opinion mining in Chinese

Xiaoying Xu,Aijun Li,Liping Hu,Jianhua Tao

DOI: https://doi.org/10.1109/ACII.2009.5349566

2009-01-01

Abstract:The paper proposes three principles and a clear guideline to create a large-scale Chinese sentiment lexicon for opinion mining systems. The comparative analysis between the criterions used in ready-made resource and the subjectivity and polarity in opinion mining system is also discussed in the paper. With the analysis results, we manually categorize 116533 entries of Hownet terms for the lexicon according to the guideline. Two experiments are conducted to investigate the reliability of manual subjectivity labeling of the terms. The result of the first experiment shows significant high agreement between different annotators, while the second experiment demonstrates the effectiveness of our lexicon in judging the polarity of subjective sentence considering the simple recognition method and verifying our approach's high reliability.
Learning knowledge from relevant webpage for opinion analysis

Xu Ruifeng,Wong Kam-Fai,Lu Qin,Xia Yunqing,Li Wenjie

DOI: https://doi.org/10.1109/WIIAT.2008.388

2008-01-01

Abstract:T This paper presents an opinion analysis system based on linguistic knowledge which is acquired from small-scale annotated text and raw topic-relevant webpage. Based on the observation on the annotated opinion corpus, some word-, collocation-and sentence-level linguistic features for opinion analysis are discovered. Supervised and unsupervised learning techniques are developed to learn these features from annotated text and raw relevant webpage, respectively. These features are then incorporated into a support vector machine based classifier to identify opinionated sentences from running text and determine their polarities. Evaluations show that the proposed opinion analysis system, namely OA, achieved promising performance, which shows the effectiveness of linguistic knowledge learning from relevant webpage. © 2008 IEEE.
Summarizing Event Opinions for News Reports

chang liu,weiyi ge,chenglong he,xin xu

DOI: https://doi.org/10.1109/ICNISC.2015.113

2015-01-01

Abstract:Opinions on the news reports are very useful for people to understand an event, while the vast availability of such opinions becomes overwhelming to people when there is too much to digest. In this paper, we present an approach on summarizing event opinions for news reports. Firstly, we search relevant reports by submitting event-describing keywords, and for each report, we extract main textual content and separate subjective opinions from objective facts. Secondly, we propose a subjectivity detection approach to identify the opinion sentences. Thirdly, in order to summarize opinions, we propose a digest approach to list and compare standpoints by classifying opinions into positive/negative camps according to their sentiment polarities. In each camp, besides salient opinions, we also identify and present opinion holders (e.g. People, organizations, and countries), which contribute to a better understanding of their stances and relations. Lastly, we develop a system to display the opinion summarization of the event that is searched. An evaluation on effectiveness shows that it is favored by users.
A Corpus for Sentence-level Subjectivity Detection on English News Articles

Francesco Antici,Andrea Galassi,Federico Ruggeri,Katerina Korre,Arianna Muti,Alessandra Bardi,Alice Fedotova,Alberto Barrón-Cedeño

2024-05-24

Abstract:We develop novel annotation guidelines for sentence-level subjectivity detection, which are not limited to language-specific cues. We use our guidelines to collect NewsSD-ENG, a corpus of 638 objective and 411 subjective sentences extracted from English news articles on controversial topics. Our corpus paves the way for subjectivity detection in English and across other languages without relying on language-specific tools, such as lexicons or machine translation. We evaluate state-of-the-art multilingual transformer-based models on the task in mono-, multi-, and cross-language settings. For this purpose, we re-annotate an existing Italian corpus. We observe that models trained in the multilingual setting achieve the best performance on the task.

Computation and Language
Topic Sentiment Analysis in Chinese News

Chunping Ouyang,Wen Zhou,Ying Yu,Liu Zhiming,Yang Xiaohua

DOI: https://doi.org/10.14257/ijmue.2014.9.11.37

2014-01-01

International Journal of Multimedia and Ubiquitous Engineering

Abstract:Sentiment analysis in news is different from normal text sentiment analysis. News usually have a specific topic, a focus semantic emotion, therefore, this paper, based on the principal of using Emotion Dependency Tuple (EDT) as the basic unit of news emotion analysis, resolves topic sentiment analysis in news into three progressive sub-problem, namely, topic sentence recognition, EDT extraction and topic sentiment analysis. We use an improved TF- IDF and cross entropy to extract feature set of topics. Then, based on space vector model, calculate the topic association of a sentence and extract topic sentence. Finally, we construct topic sentence based on EDT and complete clustering of news topic sentiment. This method is evaluated using COAE2014 dataset, and differential means shows that our results close to the best results. This shows that the topic based EDT could effectively improve performance of sentiment analysis in news.

A Political News Corpus in Chinese for Opinion Analysis.

Opinion Annotation in On-line Chinese Product Reviews

Manually Crafted Chinese Text Corpus for Text Emotion Recognition.

A Manually Annotated Chinese Corpus for Non-task-oriented Dialogue Systems

A Contrastive Corpus Study on Lexical Features of the English Translation of the Report of the 20th and 19th CPC National Congress

Statistical language model-based analysis of the English-Chinese corpus and political discourse

Annotating the Contemporary Chinese Corpus

The Moral Foundations Weibo Corpus

ORCHID: A Chinese Debate Corpus for Target-Independent Stance Detection and Argumentative Dialogue Summarization

Polarity Classification of Celebrity Coverage in the Chinese Press

Opinmine - Opinion Analysis System by CUHK for NTCIR-6 Pilot Task.

Learning multilinguistic knowledge for opinion analysis

Supervised Approaches and Dependency Parsing for Chinese Opinion Analysis at NTCIR-8.

A Chinese Corpus for Fine-grained Entity Typing

Sentiment and Content Analysis of Chinese News Coverage

Recent Developments in Chinese Corpus Research

Categorizing terms' subjectivity and polarity manually for opinion mining in Chinese

Learning knowledge from relevant webpage for opinion analysis

Summarizing Event Opinions for News Reports

A Corpus for Sentence-level Subjectivity Detection on English News Articles

Topic Sentiment Analysis in Chinese News