Abstract:Recently, researchers started to pay attention to the detection of temporal shifts in the meaning of words. However, most (if not all) of these approaches restricted their efforts to uncovering change over time, thus neglecting other valuable dimensions such as social or political variability. We propose an approach for detecting semantic shifts between different viewpoints--broadly defined as a set of texts that share a specific metadata feature, which can be a time-period, but also a social entity such as a political party. For each viewpoint, we learn a semantic space in which each word is represented as a low dimensional neural embedded vector. The challenge is to compare the meaning of a word in one space to its meaning in another space and measure the size of the semantic shifts. We compare the effectiveness of a measure based on optimal transformations between the two spaces with a measure based on the similarity of the neighbors of the word in the respective spaces. Our experiments demonstrate that the combination of these two performs best. We show that the semantic shifts not only occur over time, but also along different viewpoints in a short period of time. For evaluation, we demonstrate how this approach captures meaningful semantic shifts and can help improve other tasks such as the contrastive viewpoint summarization and ideology detection (measured as classification accuracy) in political texts. We also show that the two laws of semantic change which were empirically shown to hold for temporal shifts also hold for shifts across viewpoints. These laws state that frequent words are less likely to shift meaning while words with many senses are more likely to do so.

Identify Shifts of Word Semantics Through Bayesian Surprise

Do Multi-Sense Embeddings Improve Natural Language Understanding?

Unsupervised detection of diachronic word sense evolution

Dynamic Word Embeddings for Evolving Semantic Discovery

Diachronic Synonymy and Polysemy: Exploring Dynamic Relation Between Forms and Meanings of Words Based on Word Embeddings

An Improved Historical Embedding without Alignment

Words are Malleable: Computing Semantic Shifts in Political and Media Discourse

Graph-based Clustering for Detecting Semantic Change Across Time and Languages

Politicize and Depoliticize: A Study of Semantic Shifts on People’s Daily Fifty Years’ Corpus via Distributed Word Representation Space

Visual Exploration and Comparison of Word Embeddings.

An Exploration Of Semantic Relations In Neural Word Embeddings Using Extrinsic Knowledge

Beyond Bilingual: Multi-sense Word Embeddings using Multilingual Context

Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors

Studying word meaning evolution through incremental semantic shift detection

Revealing COVID-19's Social Dynamics: Diachronic Semantic Analysis of Vaccine and Symptom Discourse on Twitter

On Identifying Points of Semantic Shift Across Domains

Generalize or Detect? Towards Robust Semantic Segmentation Under Multiple Distribution Shifts

A Survey on Contextualised Semantic Shift Detection

Temporal word embedding with predictive capability

Inducing Word Sense with Automatically Learned Hidden Concepts.

Discovering emergent connections in quantum physics research via dynamic word embeddings