Abstract:In the dynamic landscape of saliency detection, convolutional neural networks have emerged as catalysts for innovation, but remain largely tailored for RGB imagery, falling short in the context of infrared images, particularly in memory-restricted environments. These existing approaches tend to overlook the wealth of contour information vital for a nuanced analysis of infrared images. Addressing this notable gap, we introduce the novel Two-branch Edge Guided Lightweight Network (TBENet), designed explicitly for the robust analysis of infrared image saliency detection. The main contributions of this paper are as follows. First, we formulate the saliency detection task as two subtasks, contour enhancement and foreground segmentation. Therefore, the TBENet is divided into two specialized branches: a contour prediction branch for extracting target contour and a saliency map generation branch for separating the foreground from the background. The first branch employs an encoder–decoder architecture to meticulously delineate object contours, serving as a guiding blueprint for the second branch. This latter segment adeptly integrates spatial and semantic data, creating a precise saliency map that is refined further by an innovative edge-weighted contour loss function. Second, to enhance feature integration capabilities, we propose depthwise multi-scale and multi-cue modules, facilitating sophisticated feature aggregation. Third, a high-level linear bottleneck module is devised to ensure the extraction of rich semantic information, and by replacing the standard convolution with the depthwise convolution, it is beneficial to reduce model complexity. Additional, we reduce the number of channels of the feature maps from each stage of the decoder to further enhance the lightweight of the model. Last, we construct a novel infrared ship dataset Small-IRShip to train and evaluate our proposed model. Experimental results on the homemade dataset Small-IRShip and two publicly available datasets, namely RGB-T and IRSTD-1k, demonstrate TBENet's superior performance over state-of-the-art methods, affirming its effectiveness in harnessing edge information and incorporating advanced feature integration strategies.

Two-B-Real Net: Two-Branch Network For Real-Time Salient Object Detection

Rethinking Two-B-Real Net for Real-Time Salient Object Detection

Dual-Branch Feature Fusion Network for Salient Object Detection

Salient Object Detection Based on Visual Perceptual Saturation and Two-Stream Hybrid Networks.

LARNet:Towards Lightweight, Accurate and Real-time Salient Object Detection

Real-Time One-Stream Semantic-Guided Refinement Network for RGB-Thermal Salient Object Detection

A Single Stream Network for Robust and Real-Time RGB-D Salient Object Detection

Bi-attention Network for Bi-Directional Salient Object Detection

ADNet: An Asymmetric Dual-Stream Network for RGB-T Salient Object Detection.

LA-U2Net: Location-Aware U2Net for Salient Object Detection

SAMNet: Stereoscopically Attentive Multi-Scale Network for Lightweight Salient Object Detection

U2-Net: Going deeper with nested U-structure for salient object detection

AWANet: Attentive-Aware Wide-Kernels Asymmetrical Network with Blended Contour Information for Salient Object Detection

A Two-branch Edge Guided Lightweight Network for infrared image saliency detection

Complementary Trilateral Decoder for Fast and Accurate Salient Object Detection.

M 2rnet: Multi-modal and Multi-Scale Refined Network for RGB-D Salient Object Detection

Real-time salient object detection with boundary information guidance

Dynamic Selective Network for RGB-D Salient Object Detection

Cross-modal refined adjacent-guided network for RGB-D salient object detection

Contour Knowledge Transfer For Salient Object Detection

Bilateral Attention Network for RGB-D Salient Object Detection