Abstract:Generating the precise semantic representation of a word or concept is a fundamental task in natural language processing. Recent studies which incorporate semantic knowledge into word embedding have shown their potential in improving the semantic representation of a concept. However, existing approaches only achieved limited performance improvement as they usually 1) model a word's semantics from some explicit aspects while ignoring the intrinsic aspects of the word, 2) treat semantic knowledge as a supplement of word embeddings, and 3) consider partial relations between concepts while ignoring rich coupling relations between them, such as explicit concept co-occurrences in descriptive texts in a corpus as well as concept hyperlink relations in a knowledge network, and implicit couplings between concept co-occurrences and hyperlinks. In human consciousness, a concept is always associated with various couplings that exist within/between descriptive texts and knowledge networks, which inspires us to capture as many concept couplings as possible for building a more informative concept representation. We thus propose a neural coupled concept representation (CoupledCR) framework and its instantiation: a coupled concept embedding (CCE) model. CCE first learns two types of explicit couplings that are based on concept co-occurrences and hyperlink relations, respectively, and then learns a type of high-level implicit couplings between these two types of explicit couplings for better concept representation. Extensive experimental results on six real-world datasets show that CCE significantly outperforms eight state-of-the-art word embeddings and semantic representation methods.

Enhancing Semantic Word Representations by Embedding Deeper Word Relationships

Embedding Semantic Relations into Word Representations

Learning Semantic Representations for Novel Words: Leveraging Both Form and Context

Lexical semantics enhanced neural word embeddings

Improving Chinese Word Representation with Conceptual Semantics

Learning Word Representations from Relational Graphs

Embedded Representation of Relation Words with Visual Supervision

An Exploration Of Semantic Relations In Neural Word Embeddings Using Extrinsic Knowledge

Semantic Structure-Based Word Embedding by Incorporating Concept Convergence and Word Divergence

Learning Effective Word Embedding Using Morphological Word Similarity

Extending Embedding Representation by Incorporating Latent Relations.

Improving Word Embeddings by Emphasizing Co-hyponyms.

A Survey of Word Embeddings Based on Deep Learning

Category Enhanced Word Embedding.

Word Representation Based on Word Relations

Contextualized Word Embeddings Encode Aspects of Human-Like Word Sense Knowledge

Concept Representation by Learning Explicit and Implicit Concept Couplings

Learning Context-Specific Word/Character Embeddings.

Semantic Dependency Word Representation

Improved Word Representation Learning with Sememes

Beyond Word Embeddings: Learning Entity and Concept Representations from Large Scale Knowledge Bases