Abstract:Several language applications often require word semantics as a core part of their processing pipeline, either as precise meaning inference or semantic similarity. Multi-sense embeddings (M-SE) can be exploited for this important requirement. M-SE seeks to represent each word by their distinct senses in order to resolve the conflation of meanings of words as used in different contexts. Previous works usually approach this task by training a model on a large corpus and often ignore the effect and usefulness of the semantic relations offered by lexical resources. However, even with large training data, coverage of all possible word senses is still an issue. In addition, a considerable percentage of contextual semantic knowledge are never learned because a huge amount of possible distributional semantic structures are never explored. In this paper, we leverage the rich semantic structures in WordNet using a graph-theoretic walk technique over word senses to enhance the quality of multi-sense embeddings. This algorithm composes enriched texts from the original texts. Furthermore, we derive new distributional semantic similarity measures for M-SE from prior ones. We adapt these measures to word sense disambiguation (WSD) aspect of our experiment. We report evaluation results on 11 benchmark datasets involving WSD and Word Similarity tasks and show that our method for enhancing distributional semantic structures improves embeddings quality on the baselines. Despite the small training data, it achieves state-of-the-art performance on some of the datasets.

Multi-sense Definition Modeling using Word Sense Decompositions

Do Multi-Sense Embeddings Improve Natural Language Understanding?

Definition Modeling: Learning to define word embeddings in natural language

Exploiting Correlations Between Contexts and Definitions with Multiple Definition Modeling

On Modeling Sense Relatedness in Multi-prototype Word Embedding.

Improving interpretability of word embeddings by generating definition and usage

Real Multi-Sense or Pseudo Multi-Sense: an Approach to Improve Word Representation

Learning Word Sense Embeddings from Word Sense Definitions

sense2vec - A Fast and Accurate Method for Word Sense Disambiguation In Neural Word Embeddings

A Unified Model for Word Sense Representation and Disambiguation.

Constructing High Quality Sense-specific Corpus and Word Embedding Via Unsupervised Elimination of Pseudo Multi-sense.

Understanding and Improving Multi-Sense Word Embeddings via Extended Robust Principal Component Analysis

Mark my Word: A Sequence-to-Sequence Approach to Definition Modeling

EDS-MEMBED: Multi-sense embeddings based on enhanced distributional semantic structures via a graph walk over word senses

Language Modelling Makes Sense: Propagating Representations through WordNet for Full-Coverage Word Sense Disambiguation

Addressing the Polysemy Problem in Language Modeling with Attentional Multi-Sense Embeddings

Beyond Bilingual: Multi-sense Word Embeddings using Multilingual Context

xSense: Learning Sense-Separated Sparse Representations and Textual Definitions for Explainable Word Sense Networks

Vision Meets Definitions: Unsupervised Visual Word Sense Disambiguation Incorporating Gloss Information

Word Sense Disambiguation by Refining Target Word Embedding

Word sense extension