Abstract:Word sense disambiguation (WSD) is to determine correct sense of ambiguous word based on its context. WSD is widely used in text classification, machine translation and information retrieval and so on. WSD accuracy is low because disambiguation features can not cover more language phenomenon and the discriminative ability of WSD model is not high. In order to improve accuracy of simplified Chinese WSD, a WSD model based on multi-head self-attention and gated-dilated convolutional neural network(AGDCNN) is proposed. Ambiguous word is viewed as the center and 4 adjacent lexical units are extracted successively toward the left and right side. Words, parts of speech, and semantic categories in 4 adjacent lexical units are vectorized and the vectorized results are input into gated-dilated convolutional neural network to get discriminative features. Then, multi-head self-attention is adopted to learn the difference and connection among discriminative features fully. Finally, classification weights are output from adaptive average pooling layer. Experiments are conducted on SemEval-2007: Task#5 and SemEval-2021: Task#2. Experimental results show that AGDCNN model has higher accuracy compared with other methods. Our goal is to improve the quality of simplified Chinese WSD as much as possible based on current linguistic resources and machine learning methods. The challenge we face is to extract effective discriminative features and design disambiguation model in high quality. Our novelty lies in that gated-dilated convolution is combined with multi-head self-attention to extract effective discriminative features, and learn their difference and connection from word form, parts of speech, and semantic categories.

Word Sense Disambiguation Corpus Acquisition by Language Model Validation

Unsupervised Word Sense Disambiguation Based on WordNet

Active Learning for Chinese Word Sense Disambiguation

A survey of Chinese word sense disambiguation:Resources,methods and evaluation

A Unified Model for Word Sense Representation and Disambiguation.

An Approach to Corpus-based Word Sense Disambiguation

Word Sense Disambiguation using Knowledge-based Word Similarity

A Survey on Lexical Ambiguity Detection and Word Sense Disambiguation

Chinese WSD Based on Selecting the Best Seeds from Collocations

Survey of Word Sense Annotated Corpus Construction

WSD-GAN: Word Sense Disambiguation Using Generative Adversarial Networks.

A Study in Dictionary-Based All-word Word Sense Disambiguation for Pre-Qin Chinese

Try to Substitute: an Unsupervised Chinese Word Sense Disambiguation Method Based on HowNet.

A WSD Model for Corpus Construction

Coarse-Grained Word Sense Disambiguation Using Features Described in the Lexicon

A Language Model for Word Sense Disambiguation

Comparison of Web-Based Unsupervised Translation Disambiguation Word Model and N-gram Model

Survey of Word Sense Disambiguation Approaches.

Language Modelling Makes Sense: Propagating Representations through WordNet for Full-Coverage Word Sense Disambiguation

Integrating Weakly Supervised Word Sense Disambiguation into Neural Machine Translation

Multi-Head Self-Attention Gated-Dilated Convolutional Neural Network for Word Sense Disambiguation