Abstract:Word sense induction (WSI), or the task of automatically discovering multiple senses or meanings of a word, has three main challenges: domain adaptability, novel sense detection, and sense granularity flexibility. While current latent variable models are known to solve the first two challenges, they are not flexible to different word sense granularities, which differ very much among words, from aardvark with one sense, to play with over 50 senses. Current models either require hyperparameter tuning or nonparametric induction of the number of senses, which we find both to be ineffective. Thus, we aim to eliminate these requirements and solve the sense granularity problem by proposing AutoSense, a latent variable model based on two observations: (1) senses are represented as a distribution over topics, and (2) senses generate pairings between the target word and its neighboring word. These observations alleviate the problem by (a) throwing garbage senses and (b) additionally inducing fine-grained word senses. Results show great improvements over the stateof-the-art models on popular WSI datasets. We also show that AutoSense is able to learn the appropriate sense granularity of a word. Finally, we apply AutoSense to the unsupervised author name disambiguation task where the sense granularity problem is more evident and show that AutoSense is evidently better than competing models. We share our data and code here: https://github.com/rktamplayo/AutoSense.

Unsupervised Word Sense Induction Using Rival Penalized Competitive Learning.

Unsupervised Word Sense Disambiguation Based on WordNet

Adapted competitive learning on continuous semantic space for word sense induction

Learning Sense Representation from Word Representation for Unsupervised Word Sense Disambiguation (student Abstract).

AutoSense Model for Word Sense Induction

Inducing Word Sense with Automatically Learned Hidden Concepts.

Multilingual Substitution-based Word Sense Induction

Word sense induction using word embeddings and community detection in complex networks

A Unified Model for Word Sense Representation and Disambiguation.

WSD-GAN: Word Sense Disambiguation Using Generative Adversarial Networks.

Word Sense Disambiguation Based on Improved Bayesian Classifiers

A Knowledge Based Method for Chinese Word Sense Induction

Word Sense Disambiguation: A Comprehensive Knowledge Exploitation Framework

Research on dual pattern of unsupervised and supervised word sense disambiguation

Combining Neural Language Models for WordSense Induction

Chinese Word Sense Induction with Basic Clustering Algorithms.

Inducing word senses for cross-lingual document clustering

A Novel Word Sense Disambiguation Algorithm Based on Semi-Supervised Statistical Learning

Word Sense Learning Based on Feature Selection and MDL Principle

Unsupervised Word Sense Discrimination Improves Construction of the Wordnets.