SemEval-2007 Task 05: Multilingual Chinese-English Lexical Sample.

Peng Jin,Yunfang Wu,Shiwen Yu

DOI: https://doi.org/10.3115/1621474.1621478

2007-01-01

Abstract:The Multilingual Chinese-English lexical sample task at SemEval-2007 provides a framework to evaluate Chinese word sense disambiguation and to promote research. This paper reports on the task preparation and the results of six participants.

What problem does this paper attempt to address?

HIT-WSD: using search engine for multilingual Chinese-English lexical sample task

PengYuan Liu,TieJun Zhao,MuYun Yang

DOI: https://doi.org/10.3115/1621474.1621509

2007-01-01

Abstract:We have participated in the Multilingual Chinese-English Lexical Sample Task of SemEval-2007. Our system disambiguates senses of Chinese words and finds the correct translation in English by using the web as WSD knowledge source. Since all the statistic data is obtained from search engine, the method is considered to be unsupervised and does not require any sense-tagged corpus.
SemEval-2012 Task 5: Chinese Semantic Dependency Parsing

Wanxiang Che,Meishan Zhang,Yanqiu Shao,Ting Liu

DOI: https://doi.org/10.18653/v1/s16-1167

2012-01-01

Abstract:The paper presents the SemEval-2012 Shared Task 5: Chinese Semantic Dependency Parsing. The goal of this task is to identify the dependency structure of Chinese sentences from the semantic view. We firstly introduce the motivation of providing Chinese semantic dependency parsing task, and then describe the task in detail including data preparation, data format, task evaluation, and so on. Over ten thousand sentences were labeled for participants to train and evaluate their systems. At last, we briefly describe the submitted systems and analyze these results.
SemEval-2010 Task 18: Disambiguating Sentiment Ambiguous Adjectives

Yunfang Wu,Peng Jin

DOI: https://doi.org/10.1007/s10579-012-9206-z

2012-01-01

Language Resources and Evaluation

Abstract:Sentiment ambiguous adjectives, which have been neglected by most previous researches, pose a challenging task in sentiment analysis. We present an evaluation task at SemEval-2010, designed to provide a framework for comparing different approaches on this problem. The task focuses on 14 Chinese sentiment ambiguous adjectives, and provides manually labeled test data. There are 8 teams submitting 16 systems in this task. In this paper, we define the task, describe the data creation, list the participating systems, and discuss different approaches.
A survey of Chinese word sense disambiguation:Resources,methods and evaluation

WU Yunfang

2009-01-01

Abstract:Word sense disambiguation(WSD)has long been a central concern for computational linguistics.This paper makes a general survey of the state of the art in Chinese WSD in three major aspects:(1)linguistic resources;(2)WSD methods;and(3)semantic evaluation.Correspondingly the paper consists of three main parts.The linguistic resources part examines machine lexicon compilation and semantic annotation of a corpus.The WSD methods part concentrates on the supervised learning methods.The semantic evaluation part reviews SemEval.
SemEval-2 Task 15: Infrequent Sense Identification for Mandarin Text to Speech Systems

Peng Jin,Yunfang Wu

2010-01-01

Abstract:There are seven cases of grapheme to phoneme in a text to speech system (Yarowsky, 1997). Among them, the most difficult task is disambiguating the homograph word, which has the same POS but different pronunciation. In this case, different pronunciations of the same word always correspond to different word senses. Once the word senses are disambiguated, the problem of GTP is resolved.
SemEval-2012 Task 4: Evaluating Chinese Word Similarity.

Peng Jin,Yunfang Wu

2012-01-01

Abstract:This task focuses on evaluating word similarity computation in Chinese. We follow the way of Finkelstein et al. (2002) to select word pairs. Then we organize twenty undergraduates who are major in Chinese linguistics to annotate the data. Each pair is assigned a similarity score by each annotator. We rank the word pairs by the average value of similar scores among the twenty annotators. This data is used as gold standard. Four systems participating in this task return their results. We evaluate their results on gold standard data in term of Kendall's tau value, and the results show three of them have a positive correlation with the rank manually created while the taus' value is very small.
Measuring Word Polysemousness And Sense Granularity At A Language Level

Hong Zhu,Yang Liu,Shiwen Yu

DOI: https://doi.org/10.1109/NLPKE.2008.4906762

2008-01-01

Abstract:Word sense acquisition and distinction are key issues for both lexicography and lexical semantic processing. However, it is quite difficult to automatically acquire word senses and to further evaluate the results with the lexica, which more likely bear the different findings of word sense distinction anti granularity. In this paper, we'd like to put forward the idea of measuring word polysemousness anti sense granularity at a language level. Two methods, viz. MECBC and THEM, are at first employed as attempts to extract Chinese word senses from the corpora. Automatic word senses mapping to the lexica and evaluation of the results are devised and realized afterwards. Our experiments shows a rather fine fitness of Chinese word polysemousness between the results anti the lexica at the whole language level. Comaprison of sense granularity between different lexical semantic resources can hence he made on a sound judgment.
Researches on Word Sense Discrimination of Chinese Adjective

朱虹,刘扬,俞士汶

DOI: https://doi.org/10.3969/j.issn.1003-0077.2009.06.003

2009-01-01

Abstract:Lexical knowledge acquisition is the bottleneck for many tasks like word sense disambiguation,lexical knowledge base construction et al.This paper introduces an automatic word sense discrimination method for Chinese mid-high-frequency adjectives.We employ the EM algorithm and exploit the features of Chinese character,contextual bag-of-words and host-attribute pair instead of the more unreliable syntactic information.We further optimize the morphology selection by utilizing HowNet in our work.The experimental results show that word sense discrimination results are different from Chinese lexicons and could be used for lexicon modification and expansion even for other type of Chinese words.
A Study in Dictionary-Based All-word Word Sense Disambiguation for Pre-Qin Chinese

ZHANG Yingjie,LI Bin,CHEN Jiajun,CHEN Xiaohe

DOI: https://doi.org/10.3969/j.issn.1003-0077.2012.03.012

2012-01-01

Abstract:Word Sense Disambiguation(WSD) is a basic task of Natural Language Processing,including the processing of ancient Chinese documents.In this paper we focuse on the specific field of analyzing pre-Qin ancient Chinese documents.Considering the shortage of training data and semantic resources,we employe a semi-supervised machine learning method to perform all-word WSD of Zuo Zhuan and use Chinese Dictionary v2.0 as the knowledge resource.We randomly selecte 22 words of different frequency and sense number to evaluate the proposed method.On the selected words,our method achieves an average accuracy of 67%,which is significant higher than the baseline method of selecting the most frequent sense.This method is promising for sense tagging of ancient Chinese documents when there is no training data available.It also provides a raw sense tagging result for human correction,enriching traditional dictionaries which usually suffer from insufficient word sense entries.
CityU-DAC: Disambiguating Sentiment-Ambiguous Adjectives Within Context.

Bin Lu,Benjamin Ka-Yin T'sou

2010-01-01

Abstract:This paper describes our system participating in task 18 of SemEval-2010, i.e. disambiguating Sentiment-Ambiguous Adjectives (SAAs). To disambiguating SAAs, we compare the machine learning-based and lexicon-based methods in our submissions: 1) Maximum entropy is used to train classifiers based on the annotated Chinese data from the NTCIR opinion analysis tasks, and the clause-level and sentence-level classifiers are compared; 2) For the lexicon-based method, we first classify the adjectives into two classes: intensifiers (i.e. adjectives intensifying the intensity of context) and suppressors (i.e. adjectives decreasing the intensity of context), and then use the polarity of context to get the SAAs' contextual polarity based on a sentiment lexicon. The results show that the performance of maximum entropy is not quite high due to little training data; on the other hand, the lexicon-based method could improve the precision by considering the polarity of context.
CUHK Experiments with ImageCLEF 2005.

Steven C. H. Hoi,Jianke Zhu,Michael R. Lyu

2005-01-01

Abstract:This paper describes the empirical studies of cross-language and cross-media for the ImageCLEF competition in 2005. It reports the empirical summary of the work of CUHK (The Chinese University of Hong Kong) at ImageCLEF 2005. This is the flrst participation of our group at ImageCLEF. The task we participated this year is the \Bilingual ad hoc retrieval task. There are three major focuses and contributions in our participation. The flrst is the empirical evaluations of language models and the smoothing strategies for cross-language image retrieval. The second is the evaluations of cross-media image retrieval, i.e., combining text and visual content for image retrieval. The last one is the evaluation of the bilingual image between English and Chinese. We provide empirical analysis on the experimental results. From the o‐cial testing results of the Bilingual ad hoc task, we achieve the highest MAP result (0.4135) in the monolingual query among all organizations.
PKU: combining supervised classifiers with features selection

Peng Jin,Danqing Zhu,Fuxin Li,Yunfang Wu

2007-01-01

Abstract:This paper presents the word sense disambiguation system of Peking University which was designed for the SemEval-2007 competition. The system participated in the Web track of task 11 "English Lexical Sample Task via English-Chinese Parallel Text". The system is a hybrid model by combining two supervised learning algorithms SVM and ME. And the method of entropy-based feature chosen was experimented. We obtained precision (and recall) of 81.5%.
Unsupervised translation disambiguation based on maximum web bilingual relatedness: web as lexicon

PengYuan Liu,TieJun Zhao

DOI: https://doi.org/10.1109/FSKD.2009.768

2009-01-01

Abstract:This paper regards Web as a semantic lexicon and alleviates the problem of bilingual lexical knowledge acquiring. Based on mix-language web page counts, four Web Bilingual Relatedness (WBR) measurements are built. WBR measurements are evaluated by a modified Miller-Charles' dataset and it is found that the measurement based on point-wise mutual information achieves the best performance. Furthermore, this paper presents a fully unsupervised translation disambiguation method which selects the translation to maximize the sum of WBR between translation and all context words. By testing this disambiguation method on Multilingual Chinese English Lexical Sample Task in SemEval-2007, it is found that the WBR disambiguation model based on point-wise mutual information achieves the best performance, outperforms other previous work and gets the state-of-the-art results (P mar =0.451)
Coarse-Grained Word Sense Disambiguation Using Features Described in the Lexicon

WU Yun-fang,JIN Peng,GUO Tao

DOI: https://doi.org/10.3969/j.issn.1003-0077.2007.02.001

2007-01-01

Abstract:This paper presents a simple but effective feature-based approach to Chinese word sense disambiguation using the distributional features available from the Grammatical Knowledge-base of Contemporary Chinese. The test data is the sense-tagged corpus of People's Daily.A Nave Bayes classifier is also tried as a comparable statistical method.The feature-based approach achieves precision of 90%,which is comparable to the NB classifier.The striking advantages of the feature-based approach are 1) It is not influenced by the data size,and 2) It can disambiguate some specific words with precision of 100%.The features appropriate for different parts of speech in Chinese WSD are also discussed.This paper demonstrates that sense features described in the lexicon are worth including in WSD.
Overview of the NLPCC 2017 Shared Task: Chinese Word Semantic Relation Classification.

Yunfang Wu,Minghua Zhang

DOI: https://doi.org/10.1007/978-3-319-73618-1_81

2017-01-01

Abstract:Word semantic relation classification is a challenging task for natural language processing, so we organize a semantic campaign on this task at NLPCC 2017. The dataset covers four kinds of semantic relations (synonym, antonym, hyponym and meronym), and there are 500 word pairs per category. Together 17 teams submit their results. In this paper, we describe the data construction and experimental setting, make an analysis on the evaluation results, and make a brief introduction to some of the participating systems.
PengYuan@PKU: Extracting infrequent sense instance with the same N-gram pattern for the SemEval-2010 task 15

Peng-Yuan Liu,Shui Liu,Shi-Wen Yu,Tie-Jun Zhao

2010-01-01

Abstract:This paper describes our infrequent sense identification system participating in the SemEval-2010 task 15 on Infrequent Sense Identification for Mandarin Text to Speech Systems. The core system is a supervised system based on the ensembles of Naïve Bayesian classifiers. In order to solve the problem of unbalanced sense distribution, we intentionally extract only instances of infrequent sense with the same N-gram pattern as the complement training data from an untagged Chinese corpus -- People's Daily of the year 2001. At the same time, we adjusted the prior probability to adapt to the distribution of the test data and tuned the smoothness coefficient to take the data sparseness into account. Official result shows that, our system ranked the first with the best Macro Accuracy 0.952. We briefly describe this system, its configuration options and the features used for this task and present some discussion of the results.
CUHK at ImageCLEF 2005: cross-language and cross-media image retrieval

Steven C. H. Hoi,Jianke Zhu,Michael R. Lyu

DOI: https://doi.org/10.1007/11878773_67

2006-01-01

Abstract:In this paper, we describe our studies of cross-language and cross-media image retrieval at the ImageCLEF 2005. This is the first participation of our CUHK (The Chinese University of Hong Kong) group at ImageCLEF. The task in which we participated is the “bilingual ad hoc retrieval” task. There are three major focuses and contributions in our participation. The first is the empirical evaluation of language models and smoothing strategies for cross-language image retrieval. The second is the evaluation of cross-media image retrieval, i.e., combining text and visual contents for image retrieval. The last is the evaluation of bilingual image retrieval between English and Chinese. We provide an empirical analysis of our experimental results, in which our approach achieves the best mean average precision result in the monolingual query task in the campaign. Finally we summarize our empirical experience and address the future improvement of our work.
A Survey on Lexical Ambiguity Detection and Word Sense Disambiguation

Miuru Abeysiriwardana,Deshan Sumanathilaka

2024-03-24

Abstract:This paper explores techniques that focus on understanding and resolving ambiguity in language within the field of natural language processing (NLP), highlighting the complexity of linguistic phenomena such as polysemy and homonymy and their implications for computational models. Focusing extensively on Word Sense Disambiguation (WSD), it outlines diverse approaches ranging from deep learning techniques to leveraging lexical resources and knowledge graphs like WordNet. The paper introduces cutting-edge methodologies like word sense extension (WSE) and neuromyotonic approaches, enhancing disambiguation accuracy by predicting new word senses. It examines specific applications in biomedical disambiguation and language specific optimisation and discusses the significance of cognitive metaphors in discourse analysis. The research identifies persistent challenges in the field, such as the scarcity of sense annotated corpora and the complexity of informal clinical texts. It concludes by suggesting future directions, including using large language models, visual WSD, and multilingual WSD systems, emphasising the ongoing evolution in addressing lexical complexities in NLP. This thinking perspective highlights the advancement in this field to enable computers to understand language more accurately.

Computer Science
MIXCD: System Description for Evaluating Chinese Word Similarity at SemEval-2012.

Yingjie Zhang,Bin Li,Xinyu Dai,Jiajun Chen

2012-01-01

Abstract:This document describes three systems calculating semantic similarity between two Chinese words. One is based on Machine Readable Dictionaries and the others utilize both MRDs and Corpus. These systems are performed on SemEval-2012 Task 4: Evaluating Chinese Word Similarity.
End to End Chinese Lexical Fusion Recognition with Sememe Knowledge

Yijiang Liu,Meishan Zhang,Donghong Ji

DOI: https://doi.org/10.48550/arXiv.2004.05456

2020-04-12

Abstract:In this paper, we present Chinese lexical fusion recognition, a new task which could be regarded as one kind of coreference recognition. First, we introduce the task in detail, showing the relationship with coreference recognition and differences from the existing tasks. Second, we propose an end-to-end joint model for the task, which exploits the state-of-the-art BERT representations as encoder, and is further enhanced with the sememe knowledge from HowNet by graph attention networks. We manually annotate a benchmark dataset for the task and then conduct experiments on it. Results demonstrate that our joint model is effective and competitive for the task. Detailed analysis is offered for comprehensively understanding the new task and our proposed model.

Computation and Language

SemEval-2007 Task 05: Multilingual Chinese-English Lexical Sample.

HIT-WSD: using search engine for multilingual Chinese-English lexical sample task

SemEval-2012 Task 5: Chinese Semantic Dependency Parsing

SemEval-2010 Task 18: Disambiguating Sentiment Ambiguous Adjectives

A survey of Chinese word sense disambiguation:Resources,methods and evaluation

SemEval-2 Task 15: Infrequent Sense Identification for Mandarin Text to Speech Systems

SemEval-2012 Task 4: Evaluating Chinese Word Similarity.

Measuring Word Polysemousness And Sense Granularity At A Language Level

Researches on Word Sense Discrimination of Chinese Adjective

A Study in Dictionary-Based All-word Word Sense Disambiguation for Pre-Qin Chinese

CityU-DAC: Disambiguating Sentiment-Ambiguous Adjectives Within Context.

CUHK Experiments with ImageCLEF 2005.

PKU: combining supervised classifiers with features selection

Unsupervised translation disambiguation based on maximum web bilingual relatedness: web as lexicon

Coarse-Grained Word Sense Disambiguation Using Features Described in the Lexicon

Overview of the NLPCC 2017 Shared Task: Chinese Word Semantic Relation Classification.

PengYuan@PKU: Extracting infrequent sense instance with the same N-gram pattern for the SemEval-2010 task 15

CUHK at ImageCLEF 2005: cross-language and cross-media image retrieval

A Survey on Lexical Ambiguity Detection and Word Sense Disambiguation

MIXCD: System Description for Evaluating Chinese Word Similarity at SemEval-2012.

End to End Chinese Lexical Fusion Recognition with Sememe Knowledge