MIXCD: System Description for Evaluating Chinese Word Similarity at SemEval-2012.

Yingjie Zhang,Bin Li,Xinyu Dai,Jiajun Chen

2012-01-01

Abstract:This document describes three systems calculating semantic similarity between two Chinese words. One is based on Machine Readable Dictionaries and the others utilize both MRDs and Corpus. These systems are performed on SemEval-2012 Task 4: Evaluating Chinese Word Similarity.

What problem does this paper attempt to address?

SemEval-2012 Task 4: Evaluating Chinese Word Similarity.

Peng Jin,Yunfang Wu

2012-01-01

Abstract:This task focuses on evaluating word similarity computation in Chinese. We follow the way of Finkelstein et al. (2002) to select word pairs. Then we organize twenty undergraduates who are major in Chinese linguistics to annotate the data. Each pair is assigned a similarity score by each annotator. We rank the word pairs by the average value of similar scores among the twenty annotators. This data is used as gold standard. Four systems participating in this task return their results. We evaluate their results on gold standard data in term of Kendall's tau value, and the results show three of them have a positive correlation with the rank manually created while the taus' value is very small.
Application-Oriented Comparison and Evaluation of Six Semantic Similarity Measures Based on Wordnet

Peng-Yuan Liu,Tie-Jun Zhao,Xiao-Feng Yu

DOI: https://doi.org/10.1109/icmlc.2006.258857

2006-01-01

Abstract:In the task of auto-building a Chinese-English semantic lexicon for translation selection, this research presents a method, which introduces WordNet similarity measures to wash out misaligned Chinese-English word pairs. Six different proposed measures of similarity based on WordNet were experimentally compared and evaluated by using WordNet and the software package WordNet::Similarity. It was found that the leader measure is res and lch, then wup, lin takes the fourth place, then jcn, and random is the tailender
Chinese Word Similarity Computing Based on Combination Strategy

Shaoru Guo, Yong Guan, Ru Li, Qi Zhang

DOI: https://doi.org/10.1007/978-3-319-50496-4_67

2016-01-01

Abstract:Chinese word similarity computing is a fundamental task for natural language processing. This paper presents a method to calculate the similarity between Chinese words based on combination strategy. We apply Baidubaike to train Word2Vector model, and then integrate different methods, semantic Dictionary-based method, Word2Vector-based method and Chinese FrameNet (CFN)-based method, to calculate the semantic similarity between Chinese words. The semantic Dictionary-based method includes dictionaries such as HowNet, DaCilin, Tongyici Cilin (Extended) and Antonym. The experiments are performed on 500 pairs of words and the Spearman correlation coefficient of test data is 0.524, which shows that the proposed method is feasible and effective.
Overview Of The Nlpcc-Iccpol 2016 Shared Task: Chinese Word Similarity Measurement

Yunfang Wu,Wei Li

DOI: https://doi.org/10.1007/978-3-319-50496-4_75

2016-01-01

Abstract:Word similarity computation is a fundamental task for natural language processing. We organize a semantic campaign of Chinese word similarity measurement at NLPCC-ICCPOL 2016. This task provides a benchmark dataset of Chinese word similarity (PKU-500 dataset), including 500 word pairs with their similarity scores. There are 21 teams submitting 24 systems in this campaign. In this paper, we describe clearly the data preparation and word similarity annotation, make an in-depth analysis on the evaluation results and give a brief introduction to participating systems.
SSMT:A Machine Translation Evaluation View to Paragraph-to-Sentence Semantic Similarity

Pingping Huang,Baobao Chang

DOI: https://doi.org/10.3115/v1/s14-2102

2014-01-01

Abstract:This paper presents the system SSMT measuring the semantic similarity between a paragraph and a sentence submitted to the SemEval 2014 task3: Cross-level Semantic Similarity. The special difficulty of this task is the length disparity between the two semantic comparison texts. We adapt several machine translation evaluation metrics for features to cope with this difficulty, then train a regression model for the semantic similarity prediction. This system is straightforward in intuition and easy in implementation. Our best run gets 0.808 in Pearson correlation. METEORderived features are the most effective ones in our experiment.
Research on Chinese Semantic Similarity Algorithm

Jian Zhang,Wei Deng,Xinlin Liu

DOI: https://doi.org/10.1109/EIECS59936.2023.10435567

2023-09-22

Abstract:The rapid development of information technology and the rapid popularization of mobile terminals have promoted the transmission of information, and the growing amount of text data has become an important source of information for people to understand. This article studies the use of Word2vec to calculate word vectors to improve semantic similarity between texts, overcoming the shortcomings of traditional methods that rely on background knowledge bases, dictionaries, etc. to calculate similarity between texts. The accuracy of similarity calculation is compared with traditional cosine similarity and editing distance similarity. The implementation shows that the similarity calculation method based on Word2vec improvement proposed in this article has higher computational accuracy.

Computer Science
ICL00 at SemEval-2016 Task 3: Translation-Based Method for CQA System

Yunfang Wu,Minghua Zhang

DOI: https://doi.org/10.18653/v1/s16-1132

2016-01-01

Abstract:We participate in the English subtask B and C at SemEval-2016 Task 3 "Community Question Answering".This paper is concerned with the description of our participating system.We propose a ranking model that combines a translation model with the cosine similarity-based method.Compared to the traditional bag of words method, the proposed model is more effective because the relationships between words can be explicitly modeled through wordto-word translation probabilities.Experiments conducted on the official test data demonstrate that our proposed ranking method obtains promising results.
Semantic Word-formation Based Chinese Word Similarity Computing

Sichen KANG,Yang LIU

2017-01-01

Abstract:Chinese word similarity computing plays an important role in the Chinese information processing.Based on the notion of character-orientation,Chinese semantic word-formation knowledge,including word POS,word-formation pattern and morphemic concepts,is employed to compute Chinese word similarity.This lexical knowledge representation is simple,intuitive and easy to expand and the model is straight-forward,with characteristics and parameters adopted as less as possible.Experimental results show that the approach is promising for the typical sampling word pair.Also,the numerical values of similarity are more in line with human cognition and present a reasonable distribution of the global data.
A survey on the techniques, applications, and performance of short text semantic similarity

Mengting Han,Xuan Zhang,Xin Yuan,Jiahao Jiang,Wei Yun,Chen Gao

DOI: https://doi.org/10.1002/cpe.5971

2020-08-24

Concurrency and Computation: Practice and Experience

Abstract:<p>Short text similarity plays an important role in natural language processing (NLP). It has been applied in many fields. Due to the lack of sufficient context in the short text, it is difficult to measure the similarity. The use of semantics similarity to calculate textual similarity has attracted the attention of academia and industry and achieved better results. In this survey, we have conducted a comprehensive and systematic analysis of semantic similarity. We first propose three categories of semantic similarity: corpus‐based, knowledge‐based, and deep learning (DL)‐based. We analyze the pros and cons of representative and novel algorithms in each category. Our analysis also includes the applications of these similarity measurement methods in other areas of NLP. We then evaluate state‐of‐the‐art DL methods on four common datasets, which proved that DL‐based can better solve the challenges of the short text similarity, such as sparsity and complexity. Especially, bidirectional encoder representations from transformer model can fully employ scarce information of short texts and semantic information and obtain higher accuracy and F1 value. We finally put forward some future directions.</p>
PolyUCOMP: Combining Semantic Vectors with Skip Bigrams for Semantic Textual Similarity

Jian Xu,Qin Lu,Zhengzhong Liu

2012-01-01

Abstract:This paper presents the work of the Hong Kong Polytechnic University (PolyUCOMP) team which has participated in the Semantic Textual Similarity task of SemEval-2012. The PolyUCOMP system combines semantic vectors with skip bigrams to determine sentence similarity. The semantic vector is used to compute similarities between sentence pairs using the lexical database WordNet and the Wikipedia corpus. The use of skip bigram is to introduce the order of words in measuring sentence similarity.
Semantic Similarity Measures to Disambiguate Terms in Medical Text.

Kai Lei,Jiyue Huang,Shangchun Si,Ying Shen

DOI: https://doi.org/10.1007/978-3-030-04239-4_36

2018-01-01

Abstract:Computing the semantic similarity accurately between words is an important but challenging task in the semantic web field. However, the semantic similarity measures involve the comprehensiveness of knowledge learning and the sufficient training of words of both high and low frequency. In this study, an approach MedSim is presented for semantic similarity measures to identify synonym terms in medical text with effectiveness and accuracy well-balanced. Experimental results on Chinese medical text demonstrate that our proposed method has robust superiority over competitors for synonym identification.
Cross-Language Similar Document Retrieval

WANG Hong-jun,SHI Shui-cai,YU Shi-wen,XIAO Shi-bin

DOI: https://doi.org/10.3969/j.issn.1003-0077.2007.01.005

2007-01-01

Abstract:To retrieve translations of a document is very helpful for bilingual parallel corpora construction.This paper proposes an improved approach for this purpose,which uses statistical translation model to match bilingual word-pairs,uses weights of word-pairs as features for computing similarity and uses a new Dice-based method to compute Cross-Language document similarity.The approach was evaluated by measuring the numbers of how many times the translation of a given document was identified in the top N similar documents. Although two noisy datasets were used in the experiment,about 90% translations were identified in the top 5 similar documents.The experimental results show that the weighs of bilingual words-pairs are good features for similarity computing and this approaqch can effectively find translation equivalent of a document in other languages.
SemEval-2007 Task 05: Multilingual Chinese-English Lexical Sample.

Peng Jin,Yunfang Wu,Shiwen Yu

DOI: https://doi.org/10.3115/1621474.1621478

2007-01-01

Abstract:The Multilingual Chinese-English lexical sample task at SemEval-2007 provides a framework to evaluate Chinese word sense disambiguation and to promote research. This paper reports on the task preparation and the results of six participants.
Improved Word Similarity Computation for Chinese Using Sub-word Information

Peng Jin,John A. Carroll,Yunfang Wu,Diana McCarthy

DOI: https://doi.org/10.1109/cis.2011.108

2011-01-01

Abstract:In the Chinese language, words consist of characters each of which is composed of one or more components. Almost every individual Chinese character has a specific meaning, and the meaning of a word is usually highly related to the characters that comprise it. Likewise, sub-character components often make a predictable contribution to the meaning of a character, and in general characters that have the same components have similar or related meanings. It is easy to automatically decompose words into characters and their components. In this paper, we improve on a corpus-based approach to computing word similarity in Chinese by extending it according to the characters and components shared between words. In an evaluation on 30,000 word types (noun, verb and adjective), we obtain a 39% relative improvement compared with a state-of-the-art baseline.
Chinese Sentence Similarity Measure Based on Word Sequence Length and Word Weight

Rongbo Wang,Zheru Chi,Baobao CHANG,Xiaojing BAI

DOI: https://doi.org/10.3969/j.issn.1000-3428.2005.13.052

2005-01-01

Abstract:This paper proposes an improved Chinese sentence similarity measure for example-based Chinese to English translation. The length of identical word sequence and the weights of words in the sequence are considered in this method. The preliminary experimental results show that the measure work is well when it is tested on a small dataset.
COS960: A Chinese Word Similarity Dataset of 960 Word Pairs.

Junjie Huang,Fanchao Qi,Chenghao Yang,Zhiyuan Liu,Maosong Sun

2019-01-01

Abstract: Word similarity computation is a widely recognized task in the field of lexical semantics. Most proposed tasks test on similarity of word pairs of single morpheme, while few works focus on words of two morphemes or more morphemes. In this work, we propose COS960, a benchmark dataset with 960 pairs of Chinese wOrd Similarity, where all the words have two morphemes in three Part of Speech (POS) tags with their human annotated similarity rather than relatedness. We give a detailed description of dataset construction and annotation process, and test on a range of word embedding models. The dataset of this paper can be obtained from https://github.com/thunlp/COS960.
An Experimental Study on Discriminating Chinese Near Synonyms: Contrasts Between Machine Learning Systems and Second Language Learners

Zhan Weidong,Cao Xiaoyu,Cui Wei,Chang Baobao

2019-01-01

Abstract:In this article, machine learning technology is introduced into fill-in-the-blank (FITB) tasks involving the discrimination of Chinese near synonyms. A preliminary experimental study was carried out on said tasks between machines and L2 learners of Chinese. This study adheres to principles of balance and comprehensiveness in selecting synonyms and making test sets for the experimental research. The test results show that the performance of machines in discriminating Chinese near synonyms in FITB tasks is significantly comparable to that of human L2 learners. The score of the machine was also positively correlated with that of intermediate-level Chinese learners. In addition to the sets of near synonyms varying in difficulty, the difference of test question types also has a significant impact on test scores. The influence of lexical meaning features on the discrimination of near synonyms is no less than that of its formal features. Meanwhile, it is more effective for machines and L2 learners to exploit syntactic formal features rather than distinguishing collocation features in FITB tasks.
Automatic detection of contrastive word pairs using textual and acoustic features

Zang Xiao,Wu Zhiyong,Ning Yishuang,Meng Helen,Cai Lianhong

DOI: https://doi.org/10.1109/ICOSP.2014.7015073

IF: 4.729

2014-01-01

Signal Processing

Abstract:Labeling emphatic words from speech recordings plays an important role in building speech corpus for expressive speech synthesis. People generally pronounce some words stronger than usual, making the speech more expressive and signaling the focus of the sentence. Contrastive word pairs are often pronounced with stronger prominences and their presence modifies the meaning of the utterance in subtle but important ways. We used a subset of Switchboard corpus to study the acoustic characteristics of contrastive word pairs and the differences between contrastive and non-contrastive words. To address the problem of automatic detection of contrastive word pairs, support vector machines (SVMs) are used to automatically detect contrastive word pairs. We report the results for automatic detection of contrastive word pairs based on textual and acoustic features. By adding acoustic features, a much better performance is achieved.
Sentence Similarity Computation in Question Answering Robot

Shijing Si,Weiguo Zheng,Liuyang Zhou,Mei Zhang

DOI: https://doi.org/10.1088/1742-6596/1237/2/022093

2019-01-01

Journal of Physics Conference Series

Abstract:Computing semantic similarity between sentences or texts is vital in many natural language processing (NLP) tasks such as search, query suggestion, and question answering (QA). Many methods have been developed, based on lexical matching, distributional semantics, etc. However, lexical features, like string matching, fail to capture semantic similarity. In this research, our focus lies on the implementation of distributional representations and how to tune parameters when obtaining representations of words with commonly used word embedding techniques, e.g., Word2Vec and GloVe. We conduct experiments in the setting of Chinese semantic sentence matching tasks on the finance-domain. We examine the goodness of word embedding by both the cosine similarity of semantically similar sentence pairs and semantically dissimilar pairs. Based on our experiments, Word2Vec performs better than GloVe in the sense that Chinese character embedding from Word2Vec yield larger disparity of cosine distances between similar sentence pairs and dissimilar pairs. Also we report the optimal parameters for Word2Vec continuous bag-of-word (CBOW) through our trials, with window size being 6 and embedding dimension being 400, which can be good initial values for other projects.
Wordnet Based Comparison Of Language Variation: A Study Based On Ccd And Cwn

Jia-Fei Hong,Chu-Ren Huang,Yang Liu

2005-01-01

Abstract:This paper will deal with the lexica of comparing the Chinese Concept Dictionary (CCD) with the Chinese WordNet (CWN) by WordNet. CCD is a WordNet-like semantic lexicon that developed by the Institute of Computational Linguistics, Peking University. And CWN is a bilingual wordnet by linking to the SUMO ontology that developed by Academia Sinica Bilingual Ontological WordNet. In this paper, we will base on WordNet database to show several situations for both CCD and CWN, such as: the same translation for them, zero translation only for CCD or CWN, and unique translation only for CCD or CWN. Then, through these analyses, we could find out the unique usage of English translating for traditional Chinese Characters or simplified Chinese characters.

MIXCD: System Description for Evaluating Chinese Word Similarity at SemEval-2012.

SemEval-2012 Task 4: Evaluating Chinese Word Similarity.

Application-Oriented Comparison and Evaluation of Six Semantic Similarity Measures Based on Wordnet

Chinese Word Similarity Computing Based on Combination Strategy

Overview Of The Nlpcc-Iccpol 2016 Shared Task: Chinese Word Similarity Measurement

SSMT:A Machine Translation Evaluation View to Paragraph-to-Sentence Semantic Similarity

Research on Chinese Semantic Similarity Algorithm

ICL00 at SemEval-2016 Task 3: Translation-Based Method for CQA System

Semantic Word-formation Based Chinese Word Similarity Computing

A survey on the techniques, applications, and performance of short text semantic similarity

PolyUCOMP: Combining Semantic Vectors with Skip Bigrams for Semantic Textual Similarity

Semantic Similarity Measures to Disambiguate Terms in Medical Text.

Cross-Language Similar Document Retrieval

SemEval-2007 Task 05: Multilingual Chinese-English Lexical Sample.

Improved Word Similarity Computation for Chinese Using Sub-word Information

Chinese Sentence Similarity Measure Based on Word Sequence Length and Word Weight

COS960: A Chinese Word Similarity Dataset of 960 Word Pairs.

An Experimental Study on Discriminating Chinese Near Synonyms: Contrasts Between Machine Learning Systems and Second Language Learners

Automatic detection of contrastive word pairs using textual and acoustic features

Sentence Similarity Computation in Question Answering Robot

Wordnet Based Comparison Of Language Variation: A Study Based On Ccd And Cwn