Abstract:Syntactic processing is fundamental to natural language processing. It provides rich and comprehensive syntax information in sentences that could be potentially beneficial for downstream tasks. Recently, pretrained language models have shown great success in Chinese syntactic processing, which typically involves word segmentation, POS tagging, and dependency parsing. However, the on-going research never ends since performance would be degraded drastically when tested on a highly-discrepant domain. This problem is widely accepted as domain adaptation, where the test domain differs from the training domain in supervised learning. Self-training is one promising solution for it, and straightforward source-to-target adaptation has already shown remarkable effectiveness in previous work. While this strategy ignores the fact that sentences of the target domain sentences may have very different gaps from the source training domain. More specifically, sentences with large gaps might fail by direct self-training adaptation. To this end, we propose fine-grained domain adaptation for Chinese syntactic processing in this work, aiming to model the gaps between the source and the target domains accurately and progressively. The key idea is to divide the target domain into fine-grained subdomains by using a specified domain distance metric, and then perform gradual self-training on the subdomains. We further offer an intuitive theoretical illustration based on the theory of Kumar et al. (2020) approximately. In addition, a novel representation learning framework is proposed to encode fine-grained subdomains effectively, aiming to utilize the above idea fully. Experimental results on benchmark datasets show that our method can achieve significant improvements over a variety of baselines.

Type-Supervised Domain Adaptation for Joint Segmentation and POS-Tagging

Unsupervised Domain Adaptation for Joint Segmentation and POS-Tagging.

Learning a Target-Dependent Classifier for Cross-Domain Semantic Segmentation: Fine-tuning Versus Meta-Learning

Semi-supervised Domain Adaptation for Dependency Parsing

Joint Chinese Word Segmentation and POS Tagging System with Undirected Graphical Models

Unsupervised Domain Adaptation for Referring Semantic Segmentation

Domain Adaptation for CRF-based Chinese Word Segmentation using Free Annotations.

Translation as Cross-Domain Knowledge - Attention Augmentation for Unsupervised Cross-Domain Segmenting and Labeling Tasks.

Domain Adaptative Semantic Segmentation by Fine-Grained Alignment

A Multi-Grained Unsupervised Domain Adaptation Approach for Semantic Segmentation

Joint Chinese Word Segmentation and POS Tagging on Heterogeneous Annotated Corpora with Multiple Task Learning.

Joint Semantic Domain Alignment and Target Classifier Learning for Unsupervised Domain Adaptation

Ancient Chinese Word Segmentation and Part-of-Speech Tagging Using Distant Supervision

Differential Treatment for Stuff and Things: A Simple Unsupervised Domain Adaptation Method for Semantic Segmentation

Domain Adaptation for Semantic Segmentation of Road Scenes Via Two-Stage Alignment of Traffic Elements

Unsupervised Domain Adaptation using Lexical Transformations and Label Injection for Twitter Data

Fine-Grained Domain Adaptation for Chinese Syntactic Processing

Improving Chinese Word Segmentation Using Partially Annotated Sentences

Partial Domain Adaptation on Semantic Segmentation

Joint Segmentation and Tagging with Coupled Sequences Labeling

Unsupervised Domain Adaptation on Sentence Matching Through Self-Supervision