Abstract:It is widely accepted that traditional word embedding models, which rely on distributional semantics hypothesis, are relatively limited for contrast meaning problem. Distributional semantics hypothesis indicates that words lying in similar contexts have similar representations in vector space. Nevertheless, synonyms and antonyms often locate in similar contexts, which means they appear close to each other in vector space. Hence, it is of great difficulty to distinguish antonyms from synonyms. To address this challenge, we propose an optimization model, named Lexicon-based Word Embedding Tuning (LWET) model. The goal of LWET is to incorporate reliable semantic lexicons to tune the distributions of pre-trained word embeddings in the vector space so as to improve their ability of distinguishing antonyms from synonyms. To speed up the training process of LWET, we propose two approximation algorithms, including positive sampling and quasi-hierarchical softmax. Compared with quasi-hierarchical softmax, positive sampling is faster, however, at the cost of worse performance. In experiments, LWET and other state-of-the-art models are tested on antonyms recognition, distinguishing antonyms from synonyms and word similarity. The results of the first two experiments show that LWET significantly improves the ability of word embeddings to detect antonyms, thus achieving the state-of-the-art performance. On word similarity, LWET gets slightly better performance than the state-of-the-art models. It means that LWET can remain and strengthen the semantic structure rather than destroy it when tuning word distributions in vector space. In general, compared with related work, LWET can not only achieve similar or even better performance, but also speed up the training process.

Building Sentiment Lexicon with Representation Learning Based on Contrast and Label of Sentiment

Construction Of Microblog-Specific Chinese Sentiment Lexicon Based On Representation Learning

Sentiment Lexicon Enhanced Neural Sentiment Classification

Revisit Word Embeddings with Semantic Lexicons for Modeling Lexical Contrast

Leveraging Vision-Language Pre-Trained Model and Contrastive Learning for Enhanced Multimodal Sentiment Analysis

Lexicon construction: A topic model approach

Text-Centric Multimodal Contrastive Learning for Sentiment Analysis

Automatic Construction of Target-Specific Sentiment Lexicon

Contrastive Learning Models for Sentence Representations

CLMLF:A Contrastive Learning and Multi-Layer Fusion Method for Multimodal Sentiment Detection

Refining Word Embeddings Using Intensity Scores for Sentiment Analysis

SentiLR: Linguistic Knowledge Enhanced Language Representation for Sentiment Analysis

Construction Method of Sentiment Lexicon Based on Word2vec

Improving the Modality Representation with Multi-View Contrastive Learning for Multimodal Sentiment Analysis

Sentiment Lexicon Enhanced Attention-Based LSTM for Sentiment Classification

Building a robust sentiment lexicon with (almost) no resource

Aspect-Pair Supervised Contrastive Learning for aspect-based sentiment analysis

Multimodal Sentiment Analysis Representations Learning via Contrastive Learning with Condense Attention Fusion

A method of constructing a fine-grained sentiment lexicon for the humanities computing of classical chinese poetry

A Training-Optimization-Based Method for Constructing Domain-Specific Sentiment Lexicon

Emotions are Subtle: Learning Sentiment Based Text Representations Using Contrastive Learning