Abstract:Learning representations for semantic relations is important for various tasks such as analogy detection, relational search, and relation classification. Although there have been several proposals for learning representations for individual words, learning word representations that explicitly capture the semantic relations between words remains under developed. We propose an unsupervised method for learning vector representations for words such that the learnt representations are sensitive to the semantic relations that exist between two words. First, we extract lexical patterns from the co-occurrence contexts of two words in a corpus to represent the semantic relations that exist between those two words. Second, we represent a lexical pattern as the weighted sum of the representations of the words that co-occur with that lexical pattern. Third, we train a binary classifier to detect relationally similar vs. non-similar lexical pattern pairs. The proposed method is unsupervised in the sense that the lexical pattern pairs we use as train data are automatically sampled from a corpus, without requiring any manual intervention. Our proposed method statistically significantly outperforms the current state-of-the-art word representations on three benchmark datasets for proportional analogy detection, demonstrating its ability to accurately capture the semantic relations among words.

Word Representation Based on Word Relations

Word Embedding Representation with Synthetic Position and Context Information for Relation Extraction

An Unsupervised Graph Based Continuous Word Representation Method for Biomedical Text Mining.

Embedded Representation of Relation Words with Visual Supervision

Learning Word Representations by Jointly Modeling Syntagmatic and Paradigmatic Relations.

Embedding Semantic Relations into Word Representations

A Knowledge Resources Based Neural Network for Learning Word and Relation Representations

Research on Text Representation Model Integrated Semantic Relationship

An Exploration Of Semantic Relations In Neural Word Embeddings Using Extrinsic Knowledge

Semantic Dependency Word Representation

Learning word embeddings from dependency relations

Learning Word Representations from Relational Graphs

Enhancing Semantic Word Representations by Embedding Deeper Word Relationships

Distantly Supervised Neural Network Model For Relation Extraction

Extending Embedding Representation by Incorporating Latent Relations.

Sparse Lifting of Dense Vectors: Unifying Word and Sentence Representations

Geometric Relationship Between Word and Context Representations

A comparative study for wordnet guided text representation

Word Representation on Small Background Texts.

Combining Character-Level Representation For Relation Classification

Representation Learning for Measuring Entity Relatedness with Rich Information.