Abstract:In the dynamic landscape of saliency detection, convolutional neural networks have emerged as catalysts for innovation, but remain largely tailored for RGB imagery, falling short in the context of infrared images, particularly in memory-restricted environments. These existing approaches tend to overlook the wealth of contour information vital for a nuanced analysis of infrared images. Addressing this notable gap, we introduce the novel Two-branch Edge Guided Lightweight Network (TBENet), designed explicitly for the robust analysis of infrared image saliency detection. The main contributions of this paper are as follows. First, we formulate the saliency detection task as two subtasks, contour enhancement and foreground segmentation. Therefore, the TBENet is divided into two specialized branches: a contour prediction branch for extracting target contour and a saliency map generation branch for separating the foreground from the background. The first branch employs an encoder–decoder architecture to meticulously delineate object contours, serving as a guiding blueprint for the second branch. This latter segment adeptly integrates spatial and semantic data, creating a precise saliency map that is refined further by an innovative edge-weighted contour loss function. Second, to enhance feature integration capabilities, we propose depthwise multi-scale and multi-cue modules, facilitating sophisticated feature aggregation. Third, a high-level linear bottleneck module is devised to ensure the extraction of rich semantic information, and by replacing the standard convolution with the depthwise convolution, it is beneficial to reduce model complexity. Additional, we reduce the number of channels of the feature maps from each stage of the decoder to further enhance the lightweight of the model. Last, we construct a novel infrared ship dataset Small-IRShip to train and evaluate our proposed model. Experimental results on the homemade dataset Small-IRShip and two publicly available datasets, namely RGB-T and IRSTD-1k, demonstrate TBENet's superior performance over state-of-the-art methods, affirming its effectiveness in harnessing edge information and incorporating advanced feature integration strategies.

R-Net: A Novel Fully Convolutional Network–based Infrared Image Segmentation Method for Intelligent Human Behavior Analysis

Improved Pulse Coupled Neural Network for Target Segmentation in Infrared Images

Nv-Net: Efficient Infrared Image Segmentation with Convolutional Neural Networks in the Low Illumination Environment

NLFNet: Non-Local Fusion Towards Generalized Multimodal Semantic Segmentation Across RGB-Depth, Polarization, and Thermal Images

ISDNet: Integrating Shallow and Deep Networks for Efficient Ultra-high Resolution Segmentation

IMD-Net: Interpretable multi-scale detection network for infrared dim and small objects

Human segmentation of infrared image for mobile robot search

IrisDenseNet: Robust Iris Segmentation Using Densely Connected Fully Convolutional Networks in the Images by Visible Light and Near-Infrared Light Camera Sensors

Image Segmentation for Night-Vision Surveillance Camera Based on Deep Learning

HCF-Net: Hierarchical Context Fusion Network for Infrared Small Object Detection

URTSegNet: A real-time segmentation network of unstructured road at night based on thermal infrared images for autonomous robot system

An Infrared Small Target Detection Method Using Segmentation Based Region Proposal and CNN

A Two-branch Edge Guided Lightweight Network for infrared image saliency detection

RISTDnet: Robust Infrared Small Target Detection Network

R2RNet: Low-light Image Enhancement via Real-low to Real-normal Network

An Improved U-Net Infrared Small Target Detection Algorithm Based on Multi-Scale Feature Decomposition and Fusion and Attention Mechanism

Infrared Image Segmentation for Photovoltaic Panels Based on Res-UNet

YOLO-CIR: The network based on YOLO and ConvNeXt for infrared object detection

RDCa-Net: Residual Dense Channel Attention Symmetric Network for Infrared and Visible Image Fusion

Dense Nested Attention Network for Infrared Small Target Detection

LW-IRSTNet: Lightweight Infrared Small Target Segmentation Network and Application Deployment