Abstract:Syntactic processing is fundamental to natural language processing. It provides rich and comprehensive syntax information in sentences that could be potentially beneficial for downstream tasks. Recently, pretrained language models have shown great success in Chinese syntactic processing, which typically involves word segmentation, POS tagging, and dependency parsing. However, the on-going research never ends since performance would be degraded drastically when tested on a highly-discrepant domain. This problem is widely accepted as domain adaptation, where the test domain differs from the training domain in supervised learning. Self-training is one promising solution for it, and straightforward source-to-target adaptation has already shown remarkable effectiveness in previous work. While this strategy ignores the fact that sentences of the target domain sentences may have very different gaps from the source training domain. More specifically, sentences with large gaps might fail by direct self-training adaptation. To this end, we propose fine-grained domain adaptation for Chinese syntactic processing in this work, aiming to model the gaps between the source and the target domains accurately and progressively. The key idea is to divide the target domain into fine-grained subdomains by using a specified domain distance metric, and then perform gradual self-training on the subdomains. We further offer an intuitive theoretical illustration based on the theory of Kumar et al. (2020) approximately. In addition, a novel representation learning framework is proposed to encode fine-grained subdomains effectively, aiming to utilize the above idea fully. Experimental results on benchmark datasets show that our method can achieve significant improvements over a variety of baselines.

Efficient dynamic feature adaptation for cross language sentiment analysis with biased adversarial training

Adversarial And Domain-Aware Bert For Cross-Domain Sentiment Analysis

Asymmetric Mutual Learning for Multi-source Unsupervised Sentiment Adaptation with Dynamic Feature Network.

Feature Adaptation of Pre-Trained Language Models Across Languages and Domains with Robust Self-Training

Dynamic Adaptive Optimization for Effective Sentiment Analysis Fine-Tuning on Large Language Models

Active Sentiment Domain Adaptation.

Exploiting Diverse Characteristics and Adversarial Ambivalence for Domain Adaptive Segmentation

Improving Domain-Adapted Sentiment Classification by Deep Adversarial Mutual Learning

Fine-Grained Domain Adaptation for Chinese Syntactic Processing

Cross-Domain Data Augmentation with Domain-Adaptive Language Modeling for Aspect-Based Sentiment Analysis.

Unified Feature and Instance Based Domain Adaptation for Aspect-Based Sentiment Analysis

DaMSTF: Domain Adversarial Learning Enhanced Meta Self-Training for Domain Adaptation

Classes Matter: A Fine-grained Adversarial Approach to Cross-domain Semantic Segmentation

Contrastive Transformer Based Domain Adaptation for Multi-Source Cross-Domain Sentiment Classification

Aspect-invariant Sentiment Features Learning: Adversarial Multi-task Learning for Aspect-based Sentiment Analysis.

Transferable Adversarial Training: A General Approach to Adapting Deep Classifiers

Self-adaptive Re-weighted Adversarial Domain Adaptation

Striking a Balance in Unsupervised Fine-Grained Domain Adaptation Using Adversarial Learning.

Sentiment Domain Adaptation with Multi-Level Contextual Sentiment Knowledge

DAST: Unsupervised Domain Adaptation in Semantic Segmentation Based on Discriminator Attention and Self-Training.