Abstract:Capsule networks promise significant benefits over convolutional networks by storing stronger internal representations, and routing information based on the agreement between intermediate representations' projections. Despite this, their success has been limited to small-scale classification datasets due to their computationally expensive nature. Though memory efficient, convolutional capsules impose geometric constraints that fundamentally limit the ability of capsules to model the pose/deformation of objects. Further, they do not address the bigger memory concern of class-capsules scaling up to bigger tasks such as detection or large-scale classification. In this study, we introduce a new family of capsule networks, deformable capsules (\textit{DeformCaps}), to address a very important problem in computer vision: object detection. We propose two new algorithms associated with our \textit{DeformCaps}: a novel capsule structure (\textit{SplitCaps}), and a novel dynamic routing algorithm (\textit{SE-Routing}), which balance computational efficiency with the need for modeling a large number of objects and classes, which have never been achieved with capsule networks before. We demonstrate that the proposed methods efficiently scale up to create the first-ever capsule network for object detection in the literature. Our proposed architecture is a one-stage detection framework and it obtains results on MS COCO which are on par with state-of-the-art one-stage CNN-based methods, while producing fewer false positive detection, generalizing to unusual poses/viewpoints of objects.

Curvature-Driven Deformable Convolutional Networks for End-To-End Object Detection

An Efficient Compressive Convolutional Network for Unified Object Detection and Image Compression

Adaptive deformable convolutional network

Improving object detection with deep convolutional networks via Bayesian optimization and structured prediction

DSN: A New Deformable Subnetwork for Object Detection

Deformable ConvNet with Aspect Ratio Constrained NMS for Object Detection in Remote Sensing Imagery

An improved object detection algorithm based on multi-scaled and deformable convolutional neural networks

Object Detection in VHR Image Using Transfer Learning with Deformable Convolution

C-FCN: Corners-based Fully Convolutional Network for Visual Object Detection

DCNet: A Deformable Convolutional Cloud Detection Network for Remote Sensing Imagery

DIGCN: A Dynamic Interaction Graph Convolutional Network Based on Learnable Proposals for Object Detection

C-CNN: Cascaded convolutional neural network for small deformable and low contrast object localization

End-to-End Object Detection with Fully Convolutional Network

DeepID-Net: Deformable Deep Convolutional Neural Networks for Object Detection

High-Quality R-CNN Object Detection Using Multi-Path Detection Calibration Network

Contour deformation network for instance segmentation

Deep Convolutional Feature Enhancement for Remote Sensing Object Detection

Deformable Capsules for Object Detection

Untangling Local and Global Deformations in Deep Convolutional Networks for Image Classification and Sliding Window Detection

Entire Deformable ConvNets for semantic segmentation

DeepID-Net: multi-stage and deformable deep convolutional neural networks for object detection