Abstract:The process of learning good representations for machine learning tasks can be very computationally expensive. Typically, we facilitate the same backbones learned on the training set to infer the labels of testing data. Interestingly, This learning and inference paradigm, however, is quite different from the typical inference scheme of human biological visual systems. Essentially, neuroscience studies have shown that the right hemisphere of the human brain predominantly makes a fast processing of low-frequency spatial signals, while the left hemisphere more focuses on analyzing high-frequency information in a slower way. And the low-pass analysis helps facilitate the high-pass analysis via a feedback form. Inspired by this biological vision mechanism, this paper explores the possibility of learning a layer-skippable inference network. Specifically, we propose a layer-skippable network that dynamically carries out coarse-tofine object categorization. Such a network has two branches to jointly deal with both coarse and fine-grained classification tasks. The layer-skipping mechanism is proposed to learn a gating network by generating dynamic inference graphs, and reducing the computational cost by detouring the inference path from some layers. This adaptive path inference strategy endows the network with better flexibility and larger capacity and makes the high-performance deep networks with dynamic structures. To efficiently train the gating network, a novel ranking-based loss function is presented. Furthermore, the learned representations are enhanced by the proposed top-down feedback facilitation and feature-wise affine transformation, individually. The former one employs features of a coarse branch to help the finegrained object recognition task, while the latter one encodes the selected path to enhance the final feature representations. Extensive experiments are conducted on several widely used coarse-to-fine object categorization benchmarks, and promising results are achieved by our proposed model. Quite surprisingly, our layer-skipping mechanism improves the network robustness to adversarial attacks. The codes and models are released on https://github.com/avalonstrel/DSN.

Visual Representation and Classification by Learning Group Sparse Deep Stacking Network.

Sparse Deep Stacking Network for Image Classification

SVM-based Deep Stacking Networks

Hyperspectral Image Classification Based on Deep Stacking Network

Deep Stacking Network with Coarse Features for Hyperspectral Image Classification

Hierarchical Gate Network for Fine-Grained Visual Recognition.

Deep EEG feature learning via stacking common spatial pattern and support matrix machine

Stacking-based Deep Neural Network for Facial Expression Recognition

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Stacked Convolutional Sparse Auto-Encoders for Representation Learning

Stacking-Based Deep Neural Network: Deep Analytic Network for Pattern Classification

Sparse Deep Stacking Network for Fault Diagnosis of Motor

Dynamic Stacked Generalization for Node Classification on Networks

Learning Layer-Skippable Inference Network

Stacked Sparse Auto-Encoder for Deep Clustering.

Sparse kernel deep stacking networks

Stacked Hybrid-Attention and Group Collaborative Learning for Unbiased Scene Graph Generation

GDN: A Stacking Network Used for Skin Cancer Diagnosis

Remote Sensing Imagery Scene Classification Based on Spiking Neural Network.

Dense Deep Stochastic Configuration Network with Hybrid Training Mechanism.

Brain-inspired Hierarchical Spiking Neural Network Using Unsupervised STDP Rule for Image Classification