Abstract:In recent years, the CNNs have achieved great successes in the image processing tasks, e.g., image recognition and object detection. Unfortunately, traditional CNN's classification is found to be easily misled by increasingly complex image features due to the usage of pooling operations, hence unable to preserve accurate position and pose information of the objects. To address this challenge, a novel neural network structure called Capsule Network has been proposed, which introduces equivariance through capsules to significantly enhance the learning ability for image segmentation and object detection. Due to its requirement of performing a high volume of matrix operations, CapsNets have been generally accelerated on modern GPU platforms that provide highly optimized software library for common deep learning tasks. However, based on our performance characterization on modern GPUs, CapsNets exhibit low efficiency due to the special program and execution features of their routing procedure, including massive unshareable intermediate variables and intensive synchronizations, which are very difficult to optimize at software level. To address these challenges, we propose a hybrid computing architecture design named \textit{PIM-CapsNet}. It preserves GPU's on-chip computing capability for accelerating CNN types of layers in CapsNet, while pipelining with an off-chip in-memory acceleration solution that effectively tackles routing procedure's inefficiency by leveraging the processing-in-memory capability of today's 3D stacked memory. Using routing procedure's inherent parallellization feature, our design enables hierarchical improvements on CapsNet inference efficiency through minimizing data movement and maximizing parallel processing in memory.

Data Hiding During Image Processing Using Capsule Networks.

Lossless Data Hiding Scheme Based on Adjacent Pixel Difference

Reversible data hiding scheme using reference pixel and multi-layer embedding

Hiding Data Hiding

A scheme of hiding large-size image into small-size image based on FCdDNet

A Novel High-Capacity Information Hiding Scheme Based on Improved U-Net.

An Enhanced Steganography Network for Concealing and Protecting Secret Image Data

A Larger Capacity Data Hiding Scheme Based on DNN

An Effective Method for Extracting Capsule by Color Image Processing

Image Data Hiding in Neural Compressed Latent Representations

HiDDeN: Hiding Data With Deep Networks

Image Hiding Based on Compressive Autoencoders and Normalizing Flow

Hiding Images in Deep Probabilistic Models

Hybrid Gromov-Wasserstein Embedding for Capsule Learning

Image data hiding with multi-scale autoencoder network

Enabling Highly Efficient Capsule Networks Processing Through A PIM-Based Architecture Design

HidingGAN: High Capacity Information Hiding with Generative Adversarial Network.

A novel dense capsule network based on dense capsule layers

A Simple and Efficient Data Hiding Method with Error Detection and Correction

Masked image: Visually protected image dataset privacy-preserving scheme for convolutional neural networks

An Improved Capsule Network Based on Capsule Filter Routing