Abstract:Object detection technology plays a crucial role in people's everyday lives, as well as enterprise production and modern national defense. Most current object detection networks, such as YOLOX, employ convolutional neural networks instead of a Transformer as a backbone. However, these techniques lack a global understanding of the images and may lose meaningful information, such as the precise location of the most active feature detector. Recently, a Transformer with larger receptive fields showed superior performance to corresponding convolutional neural networks in computer vision tasks. The Transformer splits the image into patches and subsequently feeds them to the Transformer in a sequence structure similar to word embeddings. This makes it capable of global modeling of entire images and implies global understanding of images. However, simply using a Transformer with a larger receptive field raises several concerns. For example, self-attention in the Swin Transformer backbone will limit its ability to model long range relations, resulting in poor feature extraction results and low convergence speed during training. To address the above problems, first, we propose an important region-based Reconstructed Deformable Self-Attention that shifts attention to important regions for efficient global modeling. Second, based on the Reconstructed Deformable Self-Attention, we propose the Swin Deformable Transformer backbone, which improves the feature extraction ability and convergence speed. Finally, based on the Swin Deformable Transformer backbone, we propose a novel object detection network, namely, Swin Deformable Transformer-BiPAFPN-YOLOX. experimental results on the COCO dataset show that the training period is reduced by 55.4%, average precision is increased by 2.4%, average precision of small objects is increased by 3.7%, and inference speed is increased by 35%.

One-Stage Detection Model Based on Swin Transformer

A Transformer-Based Object Detector with Coarse-Fine Crossing Representations

An Extendable, Efficient and Effective Transformer-based Object Detector

ViDT: An Efficient and Effective Fully Transformer-based Object Detector

Object Detection Based on Swin Deformable Transformer-BiPAFPN-YOLOX

Efficient Decoder-Free Object Detection with Transformers

CvT-ASSD: Convolutional vision-Transformer Based Attentive Single Shot MultiBox Detector

ST-YOLOX: a Lightweight and Accurate Object Detection Network Based on Swin Transformer

Swin Transformer: Hierarchical Vision Transformer using Shifted Windows

SwinVid: Enhancing Video Object Detection Using Swin Transformer

A Transformer-Based Framework for Tiny Object Detection

YotoR-You Only Transform One Representation

Self-Supervised Learning with Swin Transformers

A Simple Single-Scale Vision Transformer for Object Localization and Instance Segmentation

SwinNet: Swin Transformer drives edge-aware RGB-D and RGB-T salient object detection

Ship object detection in one-stage framework based on Swin-Transformer.

SwinSOD: Salient object detection using swin-transformer

Cas-VSwin transformer: A variant swin transformer for surface-defect detection

EDSD: Efficient Driving Scenes Detection Based on Swin Transformer

Fully Transformer Detector with Multiscale Encoder and Dynamic Decoder