Abstract:Consider a question and its answers in Stack Overflow as a knowledge unit. Knowledge units often contain semantically relevant knowledge, and thus linkable for different purposes, such as duplicate questions, directly linkable for problem solving, indirectly linkable for related information. Recognising different classes of linkable knowledge would support more targeted information needs when users search or explore the knowledge base. Existing methods focus on binary relatedness (i.e., related or not), and are not robust to recognize different classes of semantic relatedness when linkable knowledge units share few words in common (i.e., have lexical gap). In this paper, we formulate the problem of predicting semantically linkable knowledge units as a multiclass classification problem, and solve the problem using deep learning techniques. To overcome the lexical gap issue, we adopt neural language model (word embeddings) and convolutional neural network (CNN) to capture word- and document-level semantics of knowledge units. Instead of using human-engineered classifier features which are hard to design for informal user-generated content, we exploit large amounts of different types of user-created knowledge-unit links to train the CNN to learn the most informative wordlevel and document-level features for the multiclass classification task. Our evaluation shows that our deep-learning based approach significantly and consistently outperforms traditional methods using traditional word representations and human-engineered classifier features.

Knowledge-Powered Deep Learning for Word Embedding

Incorporating Knowledge into Neural Network for Text Representation.

Knowledge-based Document Embedding for Cross-Domain Text Classification

Predicting Semantically Linkable Knowledge In Developer Online Forums Via Convolutional Neural Network

Learning Effective Word Embedding Using Morphological Word Similarity

A Survey of Word Embeddings Based on Deep Learning

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

An Exploration Of Semantic Relations In Neural Word Embeddings Using Extrinsic Knowledge

Learning word embedding using morphological knowledge

Co-learning of Word Representations and Morpheme Representations.

KNET: A General Framework for Learning Word Embedding using Morphological Knowledge

Co-learning of Word Representations and Morpheme Representations

Knowledge-Enhanced Ensemble Learning for Word Embeddings

Learning Better Word Embedding by Asymmetric Low-Rank Projection of Knowledge Graph

Learning structured embeddings of knowledge bases

Improved Learning of Word Embeddings with Word Definitions and Semantic Injection.

Leveraging Web Semantic Knowledge in Word Representation Learning.

Knowledge Efficient Deep Learning for Natural Language Processing

Integrating Extra Knowledge into Word Embedding Models for Biomedical NLP Tasks

Training Word Embeddings for Deep Learning in Biomedical Text Mining Tasks

Incorporating Linguistic Knowledge for Learning Distributed Word Representations.