Abstract:Despite Convolutional Neural Networks (CNNs) based approaches have been successful in objects detection, they predominantly focus on positioning discriminative regions while overlooking the internal holistic part-whole associations within objects. This would ultimately lead to the neglect of feature relationships between object and its parts as well as among those parts, both of which are significantly helpful for detecting discriminative parts. In this paper, we propose to "look insider the objects" by digging into part-whole feature correlations and take the attempts to leverage those correlations endowed by the Capsule Network (CapsNet) for robust object detection. Actually, highly correlated capsules across adjacent layers share high familiarity, which will be more likely to be routed together. In light of this, we take such correlations between different capsules of the preceding training samples as an awareness to constrain the subsequent candidate voting scope during the routing procedure, and a Feature Correlation-Steered CapsNet (FCS-CapsNet) with Locally-Constrained Expectation-Maximum (EM) Routing Agreement (LCEMRA) is proposed. Different from conventional EM routing, LCEMRA stipulates that only those relevant low-level capsules (parts) meeting the requirement of quantified intra-object cohesiveness can be clustered to make up high-level capsules (objects). In doing so, part-object associations can be dug by transformation weighting matrixes between capsules layers during such "part backtracking" procedure. LCEMRA enables low-level capsules to selectively gather projections from a non-spatially-fixed set of high-level capsules. Experiments on VOC2007, VOC2012, HKU-IS, DUTS, and COCO show that FCS-CapsNet can achieve promising object detection effects across multiple evaluation metrics, which are on-par with state-of-the-arts.

Capsule Dynamic Network-Based Object Detection Algorithm

3D-SSD: Learning Hierarchical Features from RGB-D Images for Amodal 3D Object Detection

Feature Correlation-Steered Capsule Network for Object Detection.

Deformable Capsules for Object Detection

Object Detection Based on Faster R-CNN Algorithm with Skip Pooling and Fusion of Contextual Information

SSD: Single Shot MultiBox Detector

Scale-invariant Convolutional Capsule Network

Employing Deep Part-Object Relationships For Salient Object Detection

TDFSSD: Top-Down Feature Fusion Single Shot MultiBox Detector

Object Detection Based on the Improved Single Shot MultiBox Detector

ML-CapsNet meets VB-DI-D: A novel distortion-tolerant baseline for

Spatial Enhanced-SSD For Multiclass Object Detection in Remote Sensing Images

Inception Single Shot MultiBox Detector for Object Detection

CapsNet based on Encoder and Decoder for Object Detection

Spatial Self-Distillation for Object Detection with Inaccurate Bounding Boxes

DSSD : Deconvolutional Single Shot Detector

RGB-D salient object detection via convolutional capsule network based on feature extraction and integration

Object Detection Using Deep Learning: Single Shot Detector with a Refined Feature-fusion Structure

Capsule Defect Detection Method Based on Improved Faster RCNN

RGB-D Salient Object Detection Based on Feature Extraction and Integration Convolutional Capsule Network

TCDCaps: Visual Tracking via Cascaded Dense Capsules.