Abstract:In this paper, we study the task of referring semantic segmentation in a highly practical setting, in which labeled visual data with corresponding text descriptions are available in the source, but only unlabeled visual data (without text descriptions) are available in the target. It is a challenging task that has many difficulties: (1) how to obtain proper queries for the target domain; (2) how to adapt visual-text joint distribution shifts; (3) how to maintain the original segmentation performance. Thus, we propose a cycle-consistent vision-language matching network to narrow down the domain gap and ease adaptation difficulty. Our model has significant practical applications since they are capable generalising to new data sources without requiring corresponding text annotations. First, a pseudo-text selector is devised to handle the missing modality, through the pre-trained clip model to measure the gap between query features of the source and visual features of the target. Next, a cross-domain segmentation predictor is adopted, which prompts the joint representations to be domain invariant and minimize the discrepancy between two domains. Then, we present a cycle-consistent query matcher to learn discriminative features via reconstructing visual features from masks. Instead of doing the textual comparison, we match the visual features to the pseudo queries. Extensive experiments show the effectiveness of our method.

Domain Adaptation for Chinese Word Segmentation Based on Neural Network

Addressing Domain Adaptation for Chinese Word Segmentation with Global Recurrent Structure.

Neural Networks Incorporating Dictionaries for Chinese Word Segmentation.

Domain-Aware Word Segmentation for Chinese Language: A Document-Level Context-Aware Model

Unsupervised Domain Adaptation for Referring Semantic Segmentation

Neural Word Segmentation Learning for Chinese

Adapting Conventional Chinese Word Segmenter for Segmenting Micro-blog Text: Combining Rule-based and Statistic-based Approaches.

Long Short-Term Memory Neural Networks for Chinese Word Segmentation.

Neural Networks Incorporating Unlabeled and Partially-labeled Data for Cross-domain Chinese Word Segmentation

Domain-Adapted Word Segmentation for an Out-of-Domain Language Modeling

Improving Cross-Domain Chinese Word Segmentation with Word Embeddings

Toward Fast and Accurate Neural Chinese Word Segmentation with Multi-Criteria Learning

Segment, Mask, and Predict: Augmenting Chinese Word Segmentation with Self-Supervision

Neural Chinese Word Segmentation as Sequence to Sequence Translation

A New Error-driven Learning Approach for Chinese Word Segmentation

Neural Chinese Word Segmentation with Dictionary Knowledge

Multi-sequence Cardiac MR Segmentation with Adversarial Domain Adaptation Network

Fast and Accurate Neural Word Segmentation for Chinese

Domain Adaptation for Semantic Segmentation via Patch-Wise Contrastive Learning

Neural Chinese Word Segmentation with Lexicon and Unlabeled Data via Posterior Regularization

Transfer Deep Learning for Low-Resource Chinese Word Segmentation with a Novel Neural Network