Neural Network based Deep Transfer Learning for Cross-domain Dependency Parsing

Xia Zhentao,Wang Likai,Qu Weiguang,Zhou Junsheng,Gu Yanhui
DOI: https://doi.org/10.1007/978-981-15-8101-4_49
2020-01-01
Abstract:In recent years, dependency parsers perform well on the in-domain data, but perform poor on the out-of-domain. In this paper, we present a deep neural network for cross-domain dependency parsing. Our system is based on the stack-pointer networks (STACKPTR). Considering the importance of context, we utilize self-attention mechanism for the representation vectors to capture the meaning of words. In addition, to adapt three different domains, we utilize neural network based deep transfer learning which transfers the pre-trained partial network in the source domain to be a part of deep neural network in the three target domains (product comments, product blogs and web fiction) respectively. Results on the three target domains demonstrate that our model performs competitively.
What problem does this paper attempt to address?