Abstract:Referring Image Segmentation (RIS) consistently requires language and appearance semantics to more understand each other. The need becomes acute especially under hard situations. To achieve, existing works tend to resort to various trans-representing mechanisms to directly feed forward language semantic along main RGB branch, which however will result in referent distribution weakly-mined in space and non-referent semantic contaminated along channel. In this paper, we propose Spatial Semantic Recurrent Mining (S\textsuperscript{2}RM) to achieve high-quality cross-modality fusion. It follows a working strategy of trilogy: distributing language feature, spatial semantic recurrent coparsing, and parsed-semantic balancing. During fusion, S\textsuperscript{2}RM will first generate a constraint-weak yet distribution-aware language feature, then bundle features of each row and column from rotated features of one modality context to recurrently correlate relevant semantic contained in feature from other modality context, and finally resort to self-distilled weights to weigh on the contributions of different parsed semantics. Via coparsing, S\textsuperscript{2}RM transports information from the near and remote slice layers of generator context to the current slice layer of parsed context, capable of better modeling global relationship bidirectional and structured. Besides, we also propose a Cross-scale Abstract Semantic Guided Decoder (CASG) to emphasize the foreground of the referent, finally integrating different grained features at a comparatively low cost. Extensive experimental results on four current challenging datasets show that our proposed method performs favorably against other state-of-the-art algorithms.

Region-based Image Retrieval Using Semantic Mining

Remotely Sensed Image Retrieval Based on Region-Level Semantic Mining

Semantic Image Retrieval Based on Multiple-Instance Learning

A Remote Sensing Image Retrieval Model Based on Semantic Mining

Research on high-level semantic image retrieval

Multi-spectral Remote Sensing Image Retrieval Based on Semantic Extraction

Domain-Specific Modeling and Semantic Alignment for Image-Based 3d Model Retrieval

An Image Retrieval Method Based on High-level Image Semantic Information

GIS Semantics-Based Approach of Remote Sensing Image Retrieval

ImageSaker : A Semantic-based Image Retrieval System Refining with Concept Model

Image Retrieval Based on Fuzzy Semantic Relevance Matrix

Two-stage high resolution remote sensing image retrieval combining semantic and visual features

Modeling Image Data for Effective Indexing and Retrieval in Large General Image Databases.

Spatial Semantic Recurrent Mining for Referring Image Segmentation

Semantic Level Image Retrieval in Domain Adaptive Semantic Segmentation

Image Semantic Annotating Method Based on Region Features Relevancy

Semantic Sensitive Region Retrieval Using Keyword-Integrated Bayesian Reasoning

A Semantic-Preserving Deep Hashing Model for Multi-Label Remote Sensing Image Retrieval

Multilateral Semantic Relations Modeling for Image Text Retrieval

Using Visual Dictionary to Associate Semantic Objects in Region-Based Image Retrieval

Multi-view and region reasoning semantic enhancement for image-text retrieval