Study on word sense expressing methods and their calculability

YangSen Zhang,Yunfang Wu,Shiwen Yu

2008-01-01

Abstract:The merits and shortcoming of some Chinese word sense expressing methods such as word sense allocution, semantic primitive, and concept dependence are analyzed in this article, and the basis to select dictionary knowledge sources for computer automatic word sense disambiguation is offered.

What problem does this paper attempt to address?

A Model of Chinese Word Sense Disambiguation Based on Combining Rule and Statistics Method

XIE Yu,ZHANG Yang-sen,XIAO Jian-tao

DOI: https://doi.org/10.1109/etcs.2010.51

2007-01-01

Abstract:For the existing disadvantage of Word Sense Disambiguation(WSD) research methods, we have analyzed the computability and computational complexity of knowledge Dictionaries with different structure, and chosen Â¿The Grammatical knowledge-base of Contemporary ChineseÂ¿ and Â¿the Semantic Knowledge-base of Contemporary ChineseÂ¿ which written by Institute of Computational Linguistics of Peking University, and combined the People's Daily corpus, which has been tagged word sense on, as knowledge sources for WSD. We obtained statistical knowledge and rules knowledge, which are needed by the Chinese Word Sense Disambiguation, from the selected knowledge sources, and adopted a approach of combining rule and statistics to construct the model of Word Sense Disambiguation. It has achieved a satisfactory effect of WSD.
A survey of Chinese word sense disambiguation:Resources,methods and evaluation

WU Yunfang

2009-01-01

Abstract:Word sense disambiguation(WSD)has long been a central concern for computational linguistics.This paper makes a general survey of the state of the art in Chinese WSD in three major aspects:(1)linguistic resources;(2)WSD methods;and(3)semantic evaluation.Correspondingly the paper consists of three main parts.The linguistic resources part examines machine lexicon compilation and semantic annotation of a corpus.The WSD methods part concentrates on the supervised learning methods.The semantic evaluation part reviews SemEval.
Measuring Word Polysemousness And Sense Granularity At A Language Level

Hong Zhu,Yang Liu,Shiwen Yu

DOI: https://doi.org/10.1109/NLPKE.2008.4906762

2008-01-01

Abstract:Word sense acquisition and distinction are key issues for both lexicography and lexical semantic processing. However, it is quite difficult to automatically acquire word senses and to further evaluate the results with the lexica, which more likely bear the different findings of word sense distinction anti granularity. In this paper, we'd like to put forward the idea of measuring word polysemousness anti sense granularity at a language level. Two methods, viz. MECBC and THEM, are at first employed as attempts to extract Chinese word senses from the corpora. Automatic word senses mapping to the lexica and evaluation of the results are devised and realized afterwards. Our experiments shows a rather fine fitness of Chinese word polysemousness between the results anti the lexica at the whole language level. Comaprison of sense granularity between different lexical semantic resources can hence he made on a sound judgment.
A Study in Dictionary-Based All-word Word Sense Disambiguation for Pre-Qin Chinese

ZHANG Yingjie,LI Bin,CHEN Jiajun,CHEN Xiaohe

DOI: https://doi.org/10.3969/j.issn.1003-0077.2012.03.012

2012-01-01

Abstract:Word Sense Disambiguation(WSD) is a basic task of Natural Language Processing,including the processing of ancient Chinese documents.In this paper we focuse on the specific field of analyzing pre-Qin ancient Chinese documents.Considering the shortage of training data and semantic resources,we employe a semi-supervised machine learning method to perform all-word WSD of Zuo Zhuan and use Chinese Dictionary v2.0 as the knowledge resource.We randomly selecte 22 words of different frequency and sense number to evaluate the proposed method.On the selected words,our method achieves an average accuracy of 67%,which is significant higher than the baseline method of selecting the most frequent sense.This method is promising for sense tagging of ancient Chinese documents when there is no training data available.It also provides a raw sense tagging result for human correction,enriching traditional dictionaries which usually suffer from insufficient word sense entries.
Survey of Word Sense Disambiguation Approaches.

Xiaohua Zhou,Hyoil Han

2005-01-01

Abstract:Word Sense Disambiguation (WSD) is an important but challenging technique in the area of natural language processing (NLP). Hundreds of WSD algorithms and systems are available, but less work has been done in regard to choosing the optimal WSD algorithms. This paper summarizes the various knowledge sources used for WSD and classifies existing WSD algorithms according to their techniques. The rationale, tasks, performance, knowledge sources used, computational complexity, assumptions, and suitable applications for each class of WSD algorithms are also discussed. This paper will provide users with general knowledge for choosing WSD algorithms for their specific applications or for further adaptation.
Word Sense Indicators: Effective Feature For Chinese Word Sense Disambiguation

Changqin Quan,Fuji Ren,Tingting He

2009-01-01

Abstract:This paper presents a statistical method to extract word sense indicators as semantic disambiguators. Word sense indicators are collected based on selecting the best seeds and retrieving collocations. The similarities are comparied between sets of sense indicators for tagging sense. Our experiments showed that one or two indicators around the ambiguous word can help to recognize its sense, and sense indicators are mainly appear in +/- 3 context window size in Chinese.
Anothor Method of Chinese Word Sense Disambiguation Method

ZHANG Jin,LIU Ya-qing,YU Chun-yan

DOI: https://doi.org/10.3969/j.issn.1000-1220.2006.04.034

2006-01-01

Abstract:There is the fault of blindness in traditionary chinese word sense disambiguation method based on primitive co-occurrence data. On the ground of the depiction for the concept of Hownet,the author calculates these relation-moduluses between the first unattached primitive、the other unattached primitive、the relation primitive、the sign primitive of each sense of multivocal word and them of character-words.At last,the sense of multivocal word is choosed by comparing these relation-moduluses between sense of multivocal word and character-words. The result of experimentation showed that the effect of word sense disambiguation is improved.
Chinese WSD Based on Selecting the Best Seeds from Collocations

Liu Hui

Abstract:The key problem of word sense disambiguation based on statistic model lies in how to acquiring the word sense indicators automatically. Although it is feasible to acquire a large number of collocations by learning examples, it is hard to select good seeds manually to increase new collocations effectively. The method of selecting the best seeds by machine learning is provided in this paper to solve this problem. The best seeds are used to augment more new word sense indicators; finally disambiguate polysemous words with the acquired indicators. The average accuracy is 87.7% for 8 polysemous words by this method.

Computer Science
A Chinese Word Sense Disambiguation System Based on Primitive CO- Occurrence Data

LIU Ya-qing,ZHANG Jin,YU Chun-yan

DOI: https://doi.org/10.3969/j.issn.1673-629x.2006.05.062

2006-01-01

Abstract:Word sense disambiguation has always been important in natural language processing.The precision rate of word sense disambiguation depends on the completeness of disambiguation knowledge.Most methods currently which are based on dictionary and on corpora are not satisfiable.This paper introduces an automatic system of Chinese word sense disambiguation which is based on HOWNET and takes primitive co-occurrence data matrix as the disambiguation knowledge.The result of experimentation proves that the the precision rate of word sense disambiguation is higher.
Maximum Entropy-Based Chinese Word Sense Disambiguation

Xiao-rong CHEN,Jin QIN

DOI: https://doi.org/10.3969/j.issn.1002-137X.2005.05.049

2005-01-01

Computer Science

Abstract:Word sense disambiguation is a crucial problem to be solved in NLP. A supervised machine learning method is proposed in this paper, which is applied in word disambiguation in Chinese. The method combines various features in context to disambiguate word senses. The features include annotations of words, parts of speech and sub- jects etc. And a uniform representation formalizes the features. In this way, the problem of synthesis among various features and knowledge representation of feature will be solved. 20 Chinese polysemous words are tested in our exper- iment. The result with average precision 87% shows that the method is effective.
Analysis and Comparison of 4 Kinds of Statistical Word Sense Disambiguation Models

Jifeng Guo

2011-01-01

Abstract:Many modeling methods corresponding to different machine learning methods have been used for computational linguistic problems.To determine an appropriate modeling method,and select an effective machine learning methods is most important for statistical word sense disambiguation.In this paper the Bayesian model,decision tree model,vector space model and maximum entropy are probed comprehensively,Their effects on Chinese word sense disambiguation are compared,in order to build foundation for selecting and applying word sense disambiguation models.
Word Sense Disambiguation Based on Word Sense Indicators

QUAN Changqin,He Tingting,JI Donghong,LIU Hui

DOI: https://doi.org/10.3969/j.issn.1000-3428.2005.16.019

2005-01-01

Abstract:There are many different kinds of features contribute to the resolution of word meaning, in order to analyze the feature of word senseindicators, this paper presents a statistical method to extract indicators as semantic disambiguation. The experiments show that the strategy isworkable and provides credible reference for Chinese word sense disambiguation with multi-feature.
Unsupervised Opinion Word Disambiguation Based on Topic Distribution Similarity

GUO Yingmei,SHI Xiaodong,CHEN Yidong,GAO Yan

DOI: https://doi.org/10.13209/j.0479-8023.2013.015

2013-01-01

Abstract:The authors present an automatic method for choosing the correct sense of a polysemous word by using topic information,distance and mutual information of words.The only resources used in the method are an online dictionary and a web search engine.The sense of ambiguous opinion word can be broadly described from words in the context.Experiments show that new approach could achieve high accuracy,and especially keep superior performance for opinion words with more alternative senses.
Researches on Word Sense Discrimination of Chinese Adjective

朱虹,刘扬,俞士汶

DOI: https://doi.org/10.3969/j.issn.1003-0077.2009.06.003

2009-01-01

Abstract:Lexical knowledge acquisition is the bottleneck for many tasks like word sense disambiguation,lexical knowledge base construction et al.This paper introduces an automatic word sense discrimination method for Chinese mid-high-frequency adjectives.We employ the EM algorithm and exploit the features of Chinese character,contextual bag-of-words and host-attribute pair instead of the more unreliable syntactic information.We further optimize the morphology selection by utilizing HowNet in our work.The experimental results show that word sense discrimination results are different from Chinese lexicons and could be used for lexicon modification and expansion even for other type of Chinese words.
The State-of-the-Art and Future Aspects of Word Sense Disambiguation

李生,张晶,赵铁军,姚建民

DOI: https://doi.org/10.3969/j.issn.1002-137X.2001.09.025

2001-01-01

Computer Science

Abstract:This paper outlines the state-of-the-art of word sense disambiguation(WSD)in the following aspects: the application of WSD,representation of disambiguation knowledge ,approaches and their evaluations. The paper analyzes current widely-applied WSD approaches,compares their merits and shortages. The direction of further researches in WSD field has been explored.
Effectiveness Comparison of Feature Words for Word Sense Disambiguation

Wenpeng Lu -,Heyan Huang -

DOI: https://doi.org/10.4156/aiss.vol4.issue8.1

2012-01-01

Abstract:The context of ambiguous words is the most important clue for word sense disambiguation (WSD). The selection and weight assignment of feature words affect the performance of WSD directly. The existing method usually selects the words in a certain length of window as feature words, which is easy to induce noise words in a short distance and neglect feature words in a long distance. Syntax parsing can analyze syntactic relations among words and output phrase structure tree or dependency tree of the sentence, which could be utilized to select feature words. The paper proposes the methods to select feature words based on phrase structure tree and dependency tree, and compares their effectiveness in detail. The results of experiments show that the method to select feature words and assign their weights with dependency tree is a preferred strategy for WSD.
An Improved Chinese Word Sense Disambiguation Method Based on Primitive Co-Occurrence Data

LIU Ya-qing,YU Chun-yan,ZHANG Jin

DOI: https://doi.org/10.3969/j.issn.1007-130x.2006.12.043

2006-01-01

Abstract:The fault of blindness exists in traditional Chinese word sense disambiguation methods which are based on primitive co-occurrence data. Based on the depiction for the concept of Hownet,the authors calculate these relation- moduluses between the first unattached primitive,the other unattached primitive,the relation primitive,the sign primitive of each sense of a multivocal word and that of character-words.Finally, the sense of the multivocal word is chosen by comparing these relation- moduluses between each sense of the multivocal word and character-words. The experimental results show that the accuracy of word sense disambiguation of the method is higher.
Word Sense Disambiguation: A Structured Learning Perspective.

Yun Zhou,Ting Wang,Zhiyuan Wang

2015-01-01

Abstract:This paper explores the application of structured learning methods (SLMs) to word sense disambiguation (WSD). On one hand, the semantic dependencies between polysemous words in the sentence can be encoded in SLMs. On the other hand, SLMs obtained significant achievements in natural language processing, and so it is a natural idea to apply them to WSD. However, there are many theoretical and practical problems when SLMs are applied to WSD, due to characteristics of WSD. Beginning with the method based on hidden Markov model, this paper proposes for the first time a comprehensive and unified solution for WSD based on maximum entropy Markov model, conditional random field and tree-structured conditional random field, and reduces the time complexity and running time of the proposed methods to a reasonable level by beam search, approximate training, and parallel training. The update of models brings performance improvement, the introduction of one step dependency improves performance by 1-5 percent, the adoption of non-independent features improves performance by 2-3 percent, and the extension of underlying structure to dependency parsing tree improves performance by about 1 percent. On the English all-words WSD dataset of Senseval-2004, the method based on tree-structured conditional random field outperforms the best attendee system significantly. Nevertheless, almost all machine learning methods suffer from data sparseness due to the scarcity of sense tagged data, and so do SLMs. Besides improving structured learning methods according to the characteristics of WSD, another approach to improve disambiguation performance is to mine disambiguation knowledge from all kinds of sources, such as Wikipedia, parallel corpus, and to alleviate knowledge acquisition bottleneck of WSD.
A knowledge-based word sense disambiguation algorithm utilizing syntactic dependency relation

Lin Han,Xinjie Deng,Guohua Wu

DOI: https://doi.org/10.1109/IEMCON.2017.8117155

2017-01-01

Abstract:Accurate recognition of the meaning of words in the given document fragments has a long historical standing in computational linguistics. Because of its importance in understanding natural language semantics, it becomes one of the most challenging issues within this field. In this paper, we present an enhanced knowledge-based word sense disambiguation (WSD) algorithm that manipulates by calculating the semantic similarity between definitions of the target word and an extended syntactic context vector. The actual meaning of the target word is identified as that for which the semantic similarity between definition and extended syntactic context vector is highest. Therefore, while traditional WSD approaches are based on semantic information, our method is built on both semantic and syntactic relations between sentences. This allows it to take advantage of a better use of comprehensive knowledge and more in line with the human being way of thinking. For the sake of improving the performance of WSD, we combine the syntactic importance of the words within the original document piece to provide a sequence that can be used to decide which words should be disambiguated. Finally, the evaluation performed on two standard datasets shows that our algorithm goes better beyond the baselines and has more desirable features than other popular algorithms.
Two statistics methods of Chinese word sense disambiguation

Zhimao Lu,Ting Liu,Sheng Li

2005-01-01

Abstract:Word Sense Disambiguation (WSD) has always been a difficult and hot points in natural language processing. At present, only some ambiguous words are selected as research objects in most WSD research, which has large gap with the real application. In this paper, large scale real texts are applied in WSD based on two classical statistics model. The supervised WSD method based on Hidden Markov Model (HMM) got a lower precision, only about 85% in open test. The precision of the method based on Naive Bayes Model (NBM) is 92%, it's a higher precision. And the unsupervised WSD based on NBM got a little lower precision in comparison to the supervised, but it is worthy further researching since it has a well extension performance.

Study on word sense expressing methods and their calculability

A Model of Chinese Word Sense Disambiguation Based on Combining Rule and Statistics Method

A survey of Chinese word sense disambiguation:Resources,methods and evaluation

Measuring Word Polysemousness And Sense Granularity At A Language Level

A Study in Dictionary-Based All-word Word Sense Disambiguation for Pre-Qin Chinese

Survey of Word Sense Disambiguation Approaches.

Word Sense Indicators: Effective Feature For Chinese Word Sense Disambiguation

Anothor Method of Chinese Word Sense Disambiguation Method

Chinese WSD Based on Selecting the Best Seeds from Collocations

A Chinese Word Sense Disambiguation System Based on Primitive CO- Occurrence Data

Maximum Entropy-Based Chinese Word Sense Disambiguation

Analysis and Comparison of 4 Kinds of Statistical Word Sense Disambiguation Models

Word Sense Disambiguation Based on Word Sense Indicators

Unsupervised Opinion Word Disambiguation Based on Topic Distribution Similarity

Researches on Word Sense Discrimination of Chinese Adjective

The State-of-the-Art and Future Aspects of Word Sense Disambiguation

Effectiveness Comparison of Feature Words for Word Sense Disambiguation

An Improved Chinese Word Sense Disambiguation Method Based on Primitive Co-Occurrence Data

Word Sense Disambiguation: A Structured Learning Perspective.

A knowledge-based word sense disambiguation algorithm utilizing syntactic dependency relation

Two statistics methods of Chinese word sense disambiguation