Abstract:Binary segmentation is used to distinguish objects of interest from background, and is an active area of convolutional encoder-decoder network research. The current decoders are designed for specific objects based on the common backbones as the encoders, but cannot deal with complex backgrounds. Inspired by the way human eyes detect objects of interest, a new unified dual-branch decoder paradigm named the difference-aware decoder is proposed in this paper to explore the difference between the foreground and the background and separate the objects of interest in optical images. The difference-aware decoder imitates the human eye in three stages using the multi-level features output by the encoder. In Stage A, the first branch decoder of the difference-aware decoder is used to obtain a guide map. The highest-level features are enhanced with a novel field expansion module and a dual residual attention module, and are combined with the lowest-level features to obtain the guide map. In Stage B, the other branch decoder adopts a middle feature fusion module to make trade-offs between textural details and semantic information and generate background-aware features. In Stage C, the proposed difference-aware extractor, consisting of a difference guidance model and a difference enhancement module, fuses the guide map from Stage A and the background-aware features from Stage B, to enlarge the differences between the foreground and the background and output a final detection result. The results demonstrate that the difference-aware decoder can achieve a higher accuracy than the other state-of-the-art binary segmentation methods for these tasks.

Decoding Image Semantics Based On Image Background And Salient Objects

Research On Methodology Of Image Semantic Understanding

Research on methodology of image semantic understanding based on generalized computing

Semantic Image Segmentation Based on Spatial Context Relations

Study on Image Description Methods

Semantic image segmentation integrating gradient reconstruction and non-linear processing

Salient Objects: Semantic Building Blocks For Image Concept Interpretation

A Visual Semantic Template of Background for Scene Image

Semantic Reconstruction based on RGB Image and Sparse Depth

Boat in the Sky: Background Decoupling and Object-aware Pooling for Weakly Supervised Semantic Segmentation

A Method of Main-Region Extraction for Semantic Image Retrieve

Towards Complex Backgrounds: A Unified Difference-Aware Decoder for Binary Segmentation

Joint learning of foreground, background and edge for salient object detection

Background Prior-Based Salient Object Detection Via Deep Reconstruction Residual.

Fast semantic segmentation for images with complex backgrounds based on reuse of the feature map

Image Segmentation Via Multi Dimensional Color Transform and Consensus Based Region Merging

Fast Semantic Image Segmentation with High Order Context and Guided Filtering.

Automatic Object Cosegmentation In Sparse Multiview Images

Salient Region Detection and Segmentation for General Object Recognition and Image Understanding

Deep Object Co-segmentation via Spatial-Semantic Network Modulation