Abstract:Capsule networks were proposed as an alternative approach to Convolutional Neural Networks (CNNs) for learning object-centric representations, which can be leveraged for improved generalization and sample complexity. Unlike CNNs, capsule networks are designed to explicitly model part-whole hierarchical relationships by using groups of neurons to encode visual entities, and learn the relationships between those entities. Promising early results achieved by capsule networks have motivated the deep learning community to continue trying to improve their performance and scalability across several application areas. However, a major hurdle for capsule network research has been the lack of a reliable point of reference for understanding their foundational ideas and motivations. The aim of this survey is to provide a comprehensive overview of the capsule network research landscape, which will serve as a valuable resource for the community going forward. To that end, we start with an introduction to the fundamental concepts and motivations behind capsule networks, such as equivariant inference in computer vision. We then cover the technical advances in the capsule routing mechanisms and the various formulations of capsule networks, e.g. generative and geometric. Additionally, we provide a detailed explanation of how capsule networks relate to the popular attention mechanism in Transformers, and highlight non-trivial conceptual similarities between them in the context of representation learning. Afterwards, we explore the extensive applications of capsule networks in computer vision, video and motion, graph representation learning, natural language processing, medical imaging and many others. To conclude, we provide an in-depth discussion regarding the main hurdles in capsule network research, and highlight promising research directions for future work.

A Survey on Capsule Networks: Evolution, Application, and Future Development

Learning with Capsules: A Survey

Capsule Network with Its Limitation, Modification, and Applications—A Survey

Object-centric Learning with Capsule Networks: A Survey

The Analysis Between Traditional Convolution Neural Network and CapsuleNet

Capsule networks for computer vision applications: a comprehensive review

Capsule networks for image classification: A review

Overview of Capsule Neural Networks

Examining the Benefits of Capsule Neural Networks

Capsule Network Performance on Complex Data

Pushing the Limits of Capsule Networks

Capsule Networks against Medical Imaging Data Challenges

Adaptive Capsule Network

COMPARATIVE STUDY OF CAPSULE NEURAL NETWORK IN VARIOUS APPLICATIONS

A Context-aware Capsule Network for Multi-label Classification

CapsNets Algorithm

RS-CapsNet: an Advanced Capsule Network.

DeepCaps: Going Deeper With Capsule Networks

A Novel Capsule Network Based on Multi-Order Descartes Extension Transformation

CARNet: Densely Connected Capsules with Capsule-Wise Attention Routing

A lightweight capsule network via channel-space decoupling and self-attention routing