Abstract:A number of recent studies have shown that a Deep Convolutional Neural Network (DCNN) pretrained on a large dataset can be adopted as a universal image description which leads to astounding performance in many visual classification tasks. Most of these studies, if not all, adopt activations of the fully-connected layer of a DCNN as the image or region representation and it is believed that convolutional layer activations are less discriminative. This paper, however, advocates that if used appropriately convolutional layer activations can be turned into a powerful image representation which enjoys many advantages over fully-connected layer activations. This is achieved by adopting a new technique proposed in this paper called cross-convolutional-layer pooling. More specifically, it extracts subarrays of feature maps of one convolutional layer as local features and pools the extracted features with the guidance of feature maps of the successive convolutional layer. Compared with exising methods that apply DCNNs in the local feature setting, the proposed method is significantly faster since it requires much fewer times of DCNN forward computation. Moreover, it avoids the domain mismatch issue which is usually encountered when applying fully connected layer activations to describe local regions. By applying our method to four popular visual classification tasks, it is demonstrated that the proposed method can achieve comparable or in some cases significantly better performance than existing fully-connected layer based image representations while incurring much lower computational cost.

Multi-Proxy Wasserstein Classifier for Image Classification

Wasserstein Pooling for Image Classification

Image Classification Method by Combining Multi-features and Sparse Coding

Research on Image Classification Method of Features of Combinatorial Convolution

Proxy-Based Deep Learning Framework for Spectral–Spatial Hyperspectral Image Classification: Efficient and Robust

Coarse-to-fine Trained Multi-Scale Convolutional Neural Networks for Image Classification.

Fusing Deep Local And Global Features For Remote Sensing Image Scene Classification

Image Classification Method Rationally Utilizing Spatial Information of the Image

Multiactivation Pooling Method in Convolutional Neural Networks for Image Recognition.

Hcp: A Flexible Cnn Framework for Multi-Label Image Classification

CNN: Single-label to Multi-label

Multi-proxy Feature Learning for Robust Fine-Grained Visual Recognition

The Treasure Beneath Convolutional Layers: Cross-Convolutional-Iayer Pooling For Image Classification

Multi-layer Weight-Aware Bilinear Pooling for Fine-Grained Image Classification

Multi-branch Aggregate Convolutional Neural Network for Image Classification.

Scene Classification by Coupling Convolutional Neural Networks with Wasserstein Distance.

The Treasure beneath Convolutional Layers: Cross-convolutional-layer Pooling for Image Classification

Weight-sharing Multi-Stage Multi-Scale Ensemble Convolutional Neural Network.

Multi-scale and Discriminative Part Detectors Based Features for Multi-label Image Classification.

Multisource Remote Sensing Image Classification Based on Adaptive Pooling Transformer and Multilevel Correction

Multi-proxy based deep metric learning