Relation Classification Via Recurrent Neural Network with Attention and Tensor Layers

Runyan Zhang,Fanrong Meng,Yong Zhou,Bing Liu
DOI: https://doi.org/10.26599/bdma.2018.9020022
2018-01-01
Big Data Mining and Analytics
Abstract:Relation classification is a crucial component in many Natural Language Processing (NLP) systems. In this paper, we propose a novel bidirectional recurrent neural network architecture (using Long Short-Term Memory, LSTM, cells) for relation classification, with an attention layer for organizing the context information on the word level and a tensor layer for detecting complex connections between two entities. The above two feature extraction operations are based on the LSTM networks and use their outputs. Our model allows end-to-end learning from the raw sentences in the dataset, without trimming or reconstructing them. Experiments on the SemEval-2010 Task 8 dataset show that our model outperforms most state-of-the-art methods.
What problem does this paper attempt to address?