Abstract:Referring Image Segmentation (RIS) consistently requires language and appearance semantics to more understand each other. The need becomes acute especially under hard situations. To achieve, existing works tend to resort to various trans-representing mechanisms to directly feed forward language semantic along main RGB branch, which however will result in referent distribution weakly-mined in space and non-referent semantic contaminated along channel. In this paper, we propose Spatial Semantic Recurrent Mining (S\textsuperscript{2}RM) to achieve high-quality cross-modality fusion. It follows a working strategy of trilogy: distributing language feature, spatial semantic recurrent coparsing, and parsed-semantic balancing. During fusion, S\textsuperscript{2}RM will first generate a constraint-weak yet distribution-aware language feature, then bundle features of each row and column from rotated features of one modality context to recurrently correlate relevant semantic contained in feature from other modality context, and finally resort to self-distilled weights to weigh on the contributions of different parsed semantics. Via coparsing, S\textsuperscript{2}RM transports information from the near and remote slice layers of generator context to the current slice layer of parsed context, capable of better modeling global relationship bidirectional and structured. Besides, we also propose a Cross-scale Abstract Semantic Guided Decoder (CASG) to emphasize the foreground of the referent, finally integrating different grained features at a comparatively low cost. Extensive experimental results on four current challenging datasets show that our proposed method performs favorably against other state-of-the-art algorithms.

Semantic Image Segmentation Based on Spatial Context Relations

CRF with Locality-Consistent Dictionary Learning for Semantic Segmentation

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

A Spectral–Spatial Context-Boosted Network for Semantic Segmentation of Remote Sensing Images

A semantic segmentation method for remote sensing images based on multiple contextual feature extraction

Context-based Global Multi-Class Semantic Image Segmentation by Wireless Multimedia Sensor Networks.

Semantic Segmentation Via Structured Patch Prediction, Context Crf And Guidance Crf

An RGB-D Fusion Based Semantic Segmentation Algorithm Based on Neighborhood Metric Relations

Spatial Semantic Recurrent Mining for Referring Image Segmentation

A Semantic Context Model For Automatic Image Annotation

Image Region Labeling by Exploring Contextual Information of Visual Spatial and Semantic Concepts

Image Region Annotation Based on Segmentation and Semantic Correlation Analysis

Exploiting Multi-Context Analysis in Semantic Image Classification

Contextually guided very-high-resolution imagery classification with semantic segments

Semantic image classification using statistical local spatial relations model

Encouraging the Mutual Interact Between Dataset-Level and Image-Level Context for Semantic Segmentation of Remote Sensing Image

Semantic-guided modeling of spatial relation and object co-occurrence for indoor scene recognition

ISNet - Integrate Image-Level and Semantic-Level Context for Semantic Segmentation.

Real-time Semantic Image Segmentation Via Spatial Sparsity.

A Deep Semantic Segmentation Network with Semantic and Contextual Refinements

Semantic Segmentation of High Resolution Remote Sensing Images with Extra Context Attention Mechanism