Abstract:Despite Convolutional Neural Networks (CNNs) based approaches have been successful in objects detection, they predominantly focus on positioning discriminative regions while overlooking the internal holistic part-whole associations within objects. This would ultimately lead to the neglect of feature relationships between object and its parts as well as among those parts, both of which are significantly helpful for detecting discriminative parts. In this paper, we propose to "look insider the objects" by digging into part-whole feature correlations and take the attempts to leverage those correlations endowed by the Capsule Network (CapsNet) for robust object detection. Actually, highly correlated capsules across adjacent layers share high familiarity, which will be more likely to be routed together. In light of this, we take such correlations between different capsules of the preceding training samples as an awareness to constrain the subsequent candidate voting scope during the routing procedure, and a Feature Correlation-Steered CapsNet (FCS-CapsNet) with Locally-Constrained Expectation-Maximum (EM) Routing Agreement (LCEMRA) is proposed. Different from conventional EM routing, LCEMRA stipulates that only those relevant low-level capsules (parts) meeting the requirement of quantified intra-object cohesiveness can be clustered to make up high-level capsules (objects). In doing so, part-object associations can be dug by transformation weighting matrixes between capsules layers during such "part backtracking" procedure. LCEMRA enables low-level capsules to selectively gather projections from a non-spatially-fixed set of high-level capsules. Experiments on VOC2007, VOC2012, HKU-IS, DUTS, and COCO show that FCS-CapsNet can achieve promising object detection effects across multiple evaluation metrics, which are on-par with state-of-the-arts.

CapsNet based on Encoder and Decoder for Object Detection

CapsNets Algorithm

Feature Correlation-Steered Capsule Network for Object Detection.

Deformable Capsules for Object Detection

Modified Capsule Network For Object Classification

Cv-CapsNet: Complex-Valued Capsule Network

The Analysis Between Traditional Convolution Neural Network and CapsuleNet

RS-CapsNet: an Advanced Capsule Network.

Matrix Capsule Convolutional Projection for Deep Feature Learning.

Adaptive Capsule Network

A Context-aware Capsule Network for Multi-label Classification

Employing Deep Part-Object Relationships For Salient Object Detection

Orthogonal Capsule Networks With Positional Information Preservation and Lightweight Feature Learning

Ddrm-Capsnet: Capsule Network Based On Deep Dynamic Routing Mechanism For Complex Data

DR-CapsNet with CAEMRA: Looking deep inside instance for boosting object detection effect

Capsule-inferenced Object Detection for Remote Sensing Images.

A lightweight capsule network via channel-space decoupling and self-attention routing

FSC-CapsNet: Fractionally-Strided Convolutional Capsule Network for Complex Data.

DE-CapsNet: A Diverse Enhanced Capsule Network with Disperse Dynamic Routing

Capsule Dynamic Network-Based Object Detection Algorithm

VideoCapsuleNet: A Simplified Network for Action Detection