Abstract:The transformer networks are particularly good at modeling long-range dependencies within a long sequence. In this paper, we conduct research on applying the transformer networks for salient object detection (SOD). We adopt the dense transformer backbone for fully supervised RGB image based SOD, RGB-D image pair based SOD, and weakly supervised SOD within a unified framework based on the observation that the transformer backbone can provide accurate structure modeling, which makes it powerful in learning from weak labels with less structure information. Further, we find that the vision transformer architectures do not offer direct spatial supervision, instead encoding position as a feature. Therefore, we investigate the contributions of two strategies to provide stronger spatial supervision through the transformer layers within our unified framework, namely deep supervision and difficulty-aware learning. We find that deep supervision can get gradients back into the higher level features, thus leads to uniform activation within the same semantic object. Difficulty-aware learning on the other hand is capable of identifying the hard pixels for effective hard negative mining. We also visualize features of conventional backbone and transformer backbone before and after fine-tuning them for SOD, and find that transformer backbone encodes more accurate object structure information and more distinct semantic information within the lower and higher level features respectively. We also apply our model to camouflaged object detection (COD) and achieve similar observations as the above three SOD tasks. Extensive experimental results on various SOD and COD tasks illustrate that transformer networks can transform SOD and COD, leading to new benchmarks for each related task. The source code and experimental results are available via our project page: this https URL.

Transformer text recognition with deep learning algorithm

Scene Text Recognition via Transformer

Research Status and Prospect of Transformer in Speech Recognition

Transformer Component Recognition in Pictures Taken by Submersible Robots

Transforming Scene Text Detection and Recognition: A Multi-Scale End-to-End Approach With Transformer Framework

Pure Transformer with Integrated Experts for Scene Text Recognition

Scene text recognition based on two-stage attention and multi-branch feature fusion module

DPNet: Scene text detection based on dual perspective CNN-transformer

An Improved YOLOv5 for Transformer Nameplate Text Detection

Research on Transformer Equipment Identification Based on Improved Fast RCNN Algorithm

STDFormer: Transformer-Based Network for Arbitrary-Shaped Text Detection in Natural Scenes

Dual-Branch Network Based on Transformer for Texture Recognition

TrOCR: Transformer-Based Optical Character Recognition with Pre-trained Models

STN-OCR: A single Neural Network for Text Detection and Text Recognition

Transformer Voiceprint Feature Extraction and Fault Recognition Based on MFCC and Deep Learning

DPTNet: A Dual-Path Transformer Architecture for Scene Text Detection

High-resolution power equipment recognition based on improved self-attention

Cow Face Recognition with Noise Labels Using Vision Transformer

Transformer-Convolution Network for Arbitrary Shape Text Detection

Transformer Transforms Salient Object Detection and Camouflaged Object Detection

A Transformer Network for CAPTCHA Recognition.