Abstract:In recent years, Transformers have been gradually applied in salient object detection tasks with good results. However, the Transformer’s global modeling capabilities can lead to the loss of local details that are important in salient object detection tasks. A feature extraction backbone based on a convolutional neural network (CNN) is good at extracting local detail features due to the gradual expansion of the receptive field but is limited by the size of the receptive field, resulting in an insufficient ability to extract global semantic features. Therefore, this paper combines the Transformer with a CNN and presents a dual-branch encoder to ensure that the features extracted contain rich global semantic information as well as local detail features. In addition, due to the different features extracted by the Transformer and CNN, noise may be introduced in the fusion of the two features, so different features need to be processed correspondingly during fusion. The fusion enhancement module (FEM) we propose fuses the features of the two branches step by step. A hybrid attention mechanism is used to carry out weighted fusion of different features. This progressive approach minimizes the differences between the features of the two branches so that the merged features retain the semantic and detail features extracted by the two branches to the greatest extent. Considering the loss of detailed information caused by repeated downsampling, we propose an edge refinement module (ERM) to address the need for accurate outline prediction. This module leverages salient features to obtain edge features and gradually refines the prediction results by incorporating these edge features. It makes full use of the connection between salient features and edge features and does not introduce additional edges to extract branches. Extensive experimental evaluations conducted on five benchmark tests demonstrate the superior performance of our method compared to other existing approaches. Code can be found at https://github.com/gfq1605694825/DSRNet-main.

When CNN meet with ViT: decision-level feature fusion for camouflaged object detection

A Transformer-Based Object Detector with Coarse-Fine Crossing Representations

CFANet: A Cross-layer Feature Aggregation Network for Camouflaged Object Detection

Double-Branch Camouflaged Object Detection Method Based on Intra-Layer and Inter-Layer Information Integration

Ternary symmetric fusion network for camouflaged object detection

A Vision Enhancement and Feature Fusion Multiscale Detection Network

A bioinspired three-stage model for camouflaged object detection

Combining transformer global and local feature extraction for object detection

Camouflaged Object Detection via Context-Aware Cross-Level Fusion

IFTSDNet: An Interact-Feature Transformer Network With Spatial Detail Enhancement Module for Change Detection

A Simple yet Effective Network based on Vision Transformer for Camouflaged Object and Salient Object Detection

Edge-Guided Camouflaged Object Detection Via Multi-Level Feature Integration.

Salient object detection with dual-branch stepwise feature fusion and edge refinement

Cross-Modality Fusion Transformer for Multispectral Object Detection

FTC-Net: Fusion of Transformer and CNN Features for Infrared Small Target Detection

Lightweight camouflaged object detection model based on multilevel feature fusion

TFIENet: Transformer Fusion Information Enhancement Network for Multi-Model 3D Object Detection

Towards Accurate Camouflaged Object Detection with Mixture Convolution and Interactive Fusion

HDCTfusion: Hybrid Dual-Branch Network Based on CNN and Transformer for Infrared and Visible Image Fusion

Transformers and CNNs Fusion Network for Salient Object Detection

Detecting Camouflaged Objects via Multi-Stage Coarse-to-Fine Refinement