Abstract:Recently, researchers started to pay attention to the detection of temporal shifts in the meaning of words. However, most (if not all) of these approaches restricted their efforts to uncovering change over time, thus neglecting other valuable dimensions such as social or political variability. We propose an approach for detecting semantic shifts between different viewpoints--broadly defined as a set of texts that share a specific metadata feature, which can be a time-period, but also a social entity such as a political party. For each viewpoint, we learn a semantic space in which each word is represented as a low dimensional neural embedded vector. The challenge is to compare the meaning of a word in one space to its meaning in another space and measure the size of the semantic shifts. We compare the effectiveness of a measure based on optimal transformations between the two spaces with a measure based on the similarity of the neighbors of the word in the respective spaces. Our experiments demonstrate that the combination of these two performs best. We show that the semantic shifts not only occur over time, but also along different viewpoints in a short period of time. For evaluation, we demonstrate how this approach captures meaningful semantic shifts and can help improve other tasks such as the contrastive viewpoint summarization and ideology detection (measured as classification accuracy) in political texts. We also show that the two laws of semantic change which were empirically shown to hold for temporal shifts also hold for shifts across viewpoints. These laws state that frequent words are less likely to shift meaning while words with many senses are more likely to do so.

Politicize and Depoliticize: A Study of Semantic Shifts on People’s Daily Fifty Years’ Corpus via Distributed Word Representation Space

Words are Malleable: Computing Semantic Shifts in Political and Media Discourse

Lexical Semantic Variation and Social Change：Quantitative Observation and Analysis

Diachronic Synonymy and Polysemy: Exploring Dynamic Relation Between Forms and Meanings of Words Based on Word Embeddings

New Word Identification in Social Network Text Based on Time Series Information

Unsupervised detection of diachronic word sense evolution

Identify Shifts of Word Semantics Through Bayesian Surprise

Dynamics of Language in Social Emergency: Investigating COVID-19 Hot Words on Weibo.

Studying word meaning evolution through incremental semantic shift detection

Diachronic Deviation Features In Continuous Space Word Representations

Diachronic Corpus Based Word Semantic Variation and Change Mining.

Cultural Shift or Linguistic Drift? Comparing Two Computational Measures of Semantic Change

How Does Language Change As a Lexical Network? an Investigation Based on Written Chinese Word Co-Occurrence Networks

Revealing COVID-19's Social Dynamics: Diachronic Semantic Analysis of Vaccine and Symptom Discourse on Twitter

Dynamic Word Embeddings for Evolving Semantic Discovery

A Multidimensional Framework for Evaluating Lexical Semantic Change with Social Science Applications

Measuring, Predicting and Visualizing Short-Term Change in Word Representation and Usage in VKontakte Social Network

A Tale of Two Laws of Semantic Change: Predicting Synonym Changes with Distributional Semantic Models

From cart to truck: meaning shift through words in English in the last two centuries

Simple, Interpretable and Stable Method for Detecting Words with Usage Change across Corpora

On Identifying Points of Semantic Shift Across Domains