Abstract:Words have different meanings (i.e., senses) depending on the context. Disambiguating the correct sense is important and a challenging task for natural language processing. An intuitive way is to select the highest similarity between the context and sense definitions provided by a large lexical database of English, WordNet. In this database, nouns, verbs, adjectives, and adverbs are grouped into sets of cognitive synonyms interlinked through conceptual semantics and lexicon relations. Traditional unsupervised approaches compute similarity by counting overlapping words between the context and sense definitions which must match exactly. Similarity should compute based on how words are related rather than overlapping by representing the context and sense definitions on a vector space model and analyzing distributional semantic relationships among them using latent semantic analysis (LSA). When a corpus of text becomes more massive, LSA consumes much more memory and is not flexible to train a huge corpus of text. A word-embedding approach has an advantage in this issue. Word2vec is a popular word-embedding approach that represents words on a fix-sized vector space model through either the skip-gram or continuous bag-of-words (CBOW) model. Word2vec is also effectively capturing semantic and syntactic word similarities from a huge corpus of text better than LSA. Our method used Word2vec to construct a context sentence vector, and sense definition vectors then give each word sense a score using cosine similarity to compute the similarity between those sentence vectors. The sense definition also expanded with sense relations retrieved from WordNet. If the score is not higher than a specific threshold, the score will be combined with the probability of that sense distribution learned from a large sense-tagged corpus, SEMCOR. The possible answer senses can be obtained from high scores. Our method shows that the result (50.9% or 48.7% without the probability of sense distribution) is higher than the baselines (i.e., original, simplified, adapted and LSA Lesk) and outperforms many unsupervised systems participating in the SENSEVAL-3 English lexical sample task.

Using a Chinese Lexicon to Learn Sense Embeddings and Measure Semantic Similarity.

Do Multi-Sense Embeddings Improve Natural Language Understanding?

Chinese Word Sense Embedding with SememeWSD and Synonym Set

Learning Sense-specific Word Embeddings By Exploiting Bilingual Resources.

Learning Word Sense Embeddings from Word Sense Definitions

A Simple Approach to Learn Polysemous Word Embeddings

Leveraging Human Prior Knowledge to Learn Sense Representations

Word Sense Disambiguation Using Cosine Similarity Collaborates with Word2vec and WordNet

Revisit Word Embeddings with Semantic Lexicons for Modeling Lexical Contrast

Not All Synonyms Are Created Equal: Incorporating Similarity of Synonyms to Enhance Word Embeddings

Improved Learning of Chinese Word Embeddings with Semantic Knowledge.

Real Multi-Sense or Pseudo Multi-Sense: an Approach to Improve Word Representation

Multi-phase Word Sense Embedding Learning Using a Corpus and a Lexical Ontology.

Multi-phase Word Sense Embedding Retrofitting with Lexical Ontology

Measuring Word Polysemousness And Sense Granularity At A Language Level

Learning Chinese Word Embeddings by Discovering Inherent Semantic Relevance in Sub-characters

Enhancing Embedding-Based Chinese Word Similarity Evaluation with Concepts and Synonyms Knowledge

Beyond Bilingual: Multi-sense Word Embeddings using Multilingual Context

Structured Vectors for Chinese Word Representations

PolyLM: Learning about Polysemy through Language Modeling

Improving Chinese Word Representation with Conceptual Semantics