Abstract:The transformer networks are particularly good at modeling long-range dependencies within a long sequence. In this paper, we conduct research on applying the transformer networks for salient object detection (SOD). We adopt the dense transformer backbone for fully supervised RGB image based SOD, RGB-D image pair based SOD, and weakly supervised SOD within a unified framework based on the observation that the transformer backbone can provide accurate structure modeling, which makes it powerful in learning from weak labels with less structure information. Further, we find that the vision transformer architectures do not offer direct spatial supervision, instead encoding position as a feature. Therefore, we investigate the contributions of two strategies to provide stronger spatial supervision through the transformer layers within our unified framework, namely deep supervision and difficulty-aware learning. We find that deep supervision can get gradients back into the higher level features, thus leads to uniform activation within the same semantic object. Difficulty-aware learning on the other hand is capable of identifying the hard pixels for effective hard negative mining. We also visualize features of conventional backbone and transformer backbone before and after fine-tuning them for SOD, and find that transformer backbone encodes more accurate object structure information and more distinct semantic information within the lower and higher level features respectively. We also apply our model to camouflaged object detection (COD) and achieve similar observations as the above three SOD tasks. Extensive experimental results on various SOD and COD tasks illustrate that transformer networks can transform SOD and COD, leading to new benchmarks for each related task. The source code and experimental results are available via our project page: this https URL.

OAFormer: Occlusion Aware Transformer for Camouflaged Object Detection

A Transformer-Based Object Detector with Coarse-Fine Crossing Representations

OBhunter: An ensemble spectral-angular based transformer network for occlusion detection

OAFormer: Learning Occlusion Distinguishable Feature for Amodal Instance Segmentation

CamoFormer: Masked Separable Attention for Camouflaged Object Detection

Target-aware transformer tracking with hard occlusion instance generation

OcTr: Octree-based Transformer for 3D Object Detection

Feature Shrinkage Pyramid for Camouflaged Object Detection with Transformers.

Transformer Transforms Salient Object Detection and Camouflaged Object Detection

Feature Completion Transformer for Occluded Person Re-identification

Uncertainty-Guided Transformer Reasoning for Camouflaged Object Detection.

OSFormer: One-Stage Camouflaged Instance Segmentation with Transformers.

A bioinspired three-stage model for camouflaged object detection

Boosting Camouflaged Object Detection with Dual-Task Interactive Transformer

ORFormer: Occlusion-Robust Transformer for Accurate Facial Landmark Detection

GhostFormer: Efficiently amalgamated CNN-transformer architecture for object detection

Object Detection of Occlusion Point Cloud based on Transformer.

YOLO-Former: Marrying YOLO and Transformer for Foreign Object Detection

Deep Texton-Coherence Network for Camouflaged Object Detection

A Simple yet Effective Network based on Vision Transformer for Camouflaged Object and Salient Object Detection