Abstract:In this paper, we study the task of referring semantic segmentation in a highly practical setting, in which labeled visual data with corresponding text descriptions are available in the source, but only unlabeled visual data (without text descriptions) are available in the target. It is a challenging task that has many difficulties: (1) how to obtain proper queries for the target domain; (2) how to adapt visual-text joint distribution shifts; (3) how to maintain the original segmentation performance. Thus, we propose a cycle-consistent vision-language matching network to narrow down the domain gap and ease adaptation difficulty. Our model has significant practical applications since they are capable generalising to new data sources without requiring corresponding text annotations. First, a pseudo-text selector is devised to handle the missing modality, through the pre-trained clip model to measure the gap between query features of the source and visual features of the target. Next, a cross-domain segmentation predictor is adopted, which prompts the joint representations to be domain invariant and minimize the discrepancy between two domains. Then, we present a cycle-consistent query matcher to learn discriminative features via reconstructing visual features from masks. Instead of doing the textual comparison, we match the visual features to the pseudo queries. Extensive experiments show the effectiveness of our method.

Addressing Domain Adaptation for Chinese Word Segmentation with Instances-Based Transfer Learning.

Addressing Domain Adaptation for Chinese Word Segmentation with Global Recurrent Structure.

Improving Cross-Domain Chinese Word Segmentation with Word Embeddings

Adaptive Multi-Task Transfer Learning for Chinese Word Segmentation in Medical Text.

Domain Adaptation for Chinese Word Segmentation Based on Neural Network

A Joint Multiple Criteria Model in Transfer Learning for Cross-domain Chinese Word Segmentation

A New Domain Adaptation Method Based on Rules Discovered from Cross-Domain Features

Unsupervised Domain Adaptation for Referring Semantic Segmentation

Transfer Deep Learning for Low-Resource Chinese Word Segmentation with a Novel Neural Network

Domain Adaptation for CRF-based Chinese Word Segmentation using Free Annotations.

Neural Networks Incorporating Unlabeled and Partially-labeled Data for Cross-domain Chinese Word Segmentation

Domain structure-based transfer learning for cross-domain word representation

A New Error-driven Learning Approach for Chinese Word Segmentation

Neural Networks Incorporating Dictionaries for Chinese Word Segmentation.

Neural Chinese Word Segmentation with Dictionary Knowledge

Learning Semantic Representations for Unsupervised Domain Adaptation.

Neural Chinese Word Segmentation as Sequence to Sequence Translation

Leveraging Rich Linguistic Features for Cross-domain Chinese Segmentation.

Combining Statistical Model and Dictionary for Domain Adaption of Chinese Word Segmentation

Segment, Mask, and Predict: Augmenting Chinese Word Segmentation with Self-Supervision

Adapting Conventional Chinese Word Segmenter for Segmenting Micro-blog Text: Combining Rule-based and Statistic-based Approaches.