Accelerating Graph-Based Dependency Parsing with Lock-Free Parallel Perceptron.

Shuming Ma,Xu Sun,Yi Zhang,Bingzhen Wei
DOI: https://doi.org/10.1007/978-3-319-99495-6_22
2018-01-01
Abstract:Dependency parsing is an important NLP task. A popular approach for dependency parsing is structured perceptron. Still, graph-based dependency parsing has the time complexity of $O(n^3)$, and it suffers from slow training. To deal with this problem, we propose a parallel algorithm called parallel perceptron. The parallel algorithm can make full use of a multi-core computer which saves a lot of training time. Based on experiments we observe that dependency parsing with parallel perceptron can achieve 8-fold faster training speed than traditional structured perceptron methods when using 10 threads, and with no loss at all in accuracy.
What problem does this paper attempt to address?