Abstract:In this paper, we aimed to develop a neural parser for Vietnamese based on simplified Head-Driven Phrase Structure Grammar (HPSG). The existing corpora, VietTreebank and VnDT, had around 15% of constituency and dependency tree pairs that did not adhere to simplified HPSG rules. To attempt to address the issue of the corpora not adhering to simplified HPSG rules, we randomly permuted samples from the training and development sets to make them compliant with simplified HPSG. We then modified the first simplified HPSG Neural Parser for the Penn Treebank by replacing it with the PhoBERT or XLM-RoBERTa models, which can encode Vietnamese texts. We conducted experiments on our modified VietTreebank and VnDT corpora. Our extensive experiments showed that the simplified HPSG Neural Parser achieved a new state-of-the-art F-score of 82% for constituency parsing when using the same predicted part-of-speech (POS) tags as the self-attentive constituency parser. Additionally, it outperformed previous studies in dependency parsing with a higher Unlabeled Attachment Score (UAS). However, our parser obtained lower Labeled Attachment Score (LAS) scores likely due to our focus on arc permutation without changing the original labels, as we did not consult with a linguistic expert. Lastly, the research findings of this paper suggest that simplified HPSG should be given more attention to linguistic expert when developing treebanks for Vietnamese natural language processing.

A neural joint model for Vietnamese word segmentation, POS tagging and dependency parsing

Augmenting Part-of-speech Tagging with Syntactic Information for Vietnamese and Chinese

PhoNLP: A joint multi-task learning model for Vietnamese part-of-speech tagging, named entity recognition and dependency parsing

Joint Khmer Word Segmentation and Part-of-Speech Tagging Using Deep Learning

A Graph-based Model for Joint Chinese Word Segmentation and Dependency Parsing

A joint method for Chinese word segmentation and part-of-speech labeling based on deep neural network

Transformer-Based Contextualized Language Models Joint with Neural Networks for Natural Language Inference in Vietnamese

Joint Segmentation and Tagging with Coupled Sequences Labeling

A Feature-Enriched Neural Model for Joint Chinese Word Segmentation and Part-of-Speech Tagging

Joint Chinese Word Segmentation and Part-of-speech Tagging via Two-stage Span Labeling

Joint POS Tagging and Dependency Parsing with Transition-based Neural Networks

A Unified Model for Joint Chinese Word Segmentation and Dependency Parsing

A Pilot Study of Text-to-SQL Semantic Parsing for Vietnamese

Integrating graph embedding and neural models for improving transition-based dependency parsing

Joint Training and Decoding Using Virtual Nodes for Cascaded Segmentation and Tagging Tasks.

An Attempt to Develop a Neural Parser based on Simplified Head-Driven Phrase Structure Grammar on Vietnamese

Multi-Task Cross-Lingual Sequence Tagging from Scratch

A Long Dependency Aware Deep Architecture for Joint Chinese Word Segmentation and POS Tagging.

Joint POS Tagging and Dependence Parsing With Transition-Based Neural Networks

Vietnamese Part of Speech Tagging Based on Multi-category Words Disambiguation Model.

Analyzing Vietnamese Legal Questions Using Deep Neural Networks with Biaffine Classifiers