Abstract:Despite Convolutional Neural Networks (CNNs) based approaches have been successful in objects detection, they predominantly focus on positioning discriminative regions while overlooking the internal holistic part-whole associations within objects. This would ultimately lead to the neglect of feature relationships between object and its parts as well as among those parts, both of which are significantly helpful for detecting discriminative parts. In this paper, we propose to "look insider the objects" by digging into part-whole feature correlations and take the attempts to leverage those correlations endowed by the Capsule Network (CapsNet) for robust object detection. Actually, highly correlated capsules across adjacent layers share high familiarity, which will be more likely to be routed together. In light of this, we take such correlations between different capsules of the preceding training samples as an awareness to constrain the subsequent candidate voting scope during the routing procedure, and a Feature Correlation-Steered CapsNet (FCS-CapsNet) with Locally-Constrained Expectation-Maximum (EM) Routing Agreement (LCEMRA) is proposed. Different from conventional EM routing, LCEMRA stipulates that only those relevant low-level capsules (parts) meeting the requirement of quantified intra-object cohesiveness can be clustered to make up high-level capsules (objects). In doing so, part-object associations can be dug by transformation weighting matrixes between capsules layers during such "part backtracking" procedure. LCEMRA enables low-level capsules to selectively gather projections from a non-spatially-fixed set of high-level capsules. Experiments on VOC2007, VOC2012, HKU-IS, DUTS, and COCO show that FCS-CapsNet can achieve promising object detection effects across multiple evaluation metrics, which are on-par with state-of-the-arts.

Feature Transform Correlation Network for Object Detection.

A Transformer-Based Object Detector with Coarse-Fine Crossing Representations

Combining transformer global and local feature extraction for object detection

CLT-Det: Correlation Learning Based on Transformer for Detecting Dense Objects in Remote Sensing Images

Cross-Modality Global Correlational-based Visual Transformer for RGB-D Salient Object Detection

EBiDA-FPN: Enhanced Bi-Directional Attention Feature Pyramid Network for Object Detection

CNN-transformer mixed model for object detection

CTIF-Net: A CNN-Transformer Iterative Fusion Network for Salient Object Detection

Feature Correlation-Steered Capsule Network for Object Detection.

Transformed Dynamic Feature Pyramid for Small Object Detection

CTAFFNet: CNN–Transformer Adaptive Feature Fusion Object Detection Algorithm for Complex Traffic Scenarios

FTC-Net: Fusion of Transformer and CNN Features for Infrared Small Target Detection

MPTC-FPN: A Multilayer Progressive FPN With Transformer-CNN Based Encoder for Salient Object Detection

High-Performance Transformer Tracking

TFIENet: Transformer Fusion Information Enhancement Network for Multi-Model 3D Object Detection

TFIENet: Transformer Fusion Information Enhancement Network for Multimodel 3-D Object Detection.

TFPN: Twin Feature Pyramid Networks for Object Detection.

Complementary Feature Pyramid Network for Object Detection

CR-FPN: channel relation feature pyramid network for object detection

Transformer-based Cross Reference Network for Video Salient Object Detection

Correlation-Based Transformer Tracking