Abstract:Recent works have shown that convolutional neural networks (CNNs) are now the most effective machine learning method for solving various computer vision problems. A key advantage of CNNs is that they extract features automatically; users do not need to know what features should be extracted for a certain task. It is typically believed that the deeper the CNNs are, the higher the features that can be extracted and the more powerfully the resulting representations networks will be. Therefore, present-day CNNs are becoming substantially deeper. Previous works have proven that not all features extracted by deep CNNs are useful. In this paper, we tentatively consider a question: how do we simply remove the useless features? We propose a simple pooling method called feature pooling to compress features extracted in deep CNNs. In contrast to traditional CNNs, which input feature maps from the previous layer directly to the next layer, feature pooling compresses features from the channel below, reconstructs feature maps and then sends them to the next layer. We evaluate feature pooling based on two tasks: image classification and image denoising. Each task has a distinct network architecture and uses several benchmarks. Promising results are achieved in both tasks, especially image denoising, in which we obtain state-of-the-art results. This finding verifies the previous proposition that feature pooling is a straightforward method to perform further feature compression in CNNs. We have also observed that feature pooling has several competitive advantages: it reduces the number of parameters, increases the compactness of the networks, and strengthens the representation power with both high effectiveness and wide applicability.

Enabling Efficient Bayesian Convolutional Neural Network with Feature Pre-extraction and Pre-pooling Strategies

Improving the Performance of Convolutional Neural Networks by Fusing Low-Level Features with Different Scales in the Preceding Stage

Feature Pooling - A Feature Compression Method Used in Convolutional Neural Networks.

Mixed Pooling For Convolutional Neural Networks

Efficient Computation Reduction in Bayesian Neural Networks Through Feature Decomposition and Memorization

A GPU-based high-performance optimization method of sparse convolutional neural networks

An Energy-Efficient Systolic Pipeline Architecture for Binary Convolutional Neural Network.

Enhanced Pooling Method for Convolutional Neural Networks Based on Optimal Search Theory

Efficient Bayesian CNN Model Compression using Bayes by Backprop and L1-Norm Regularization

Local Channel Transformation for Efficient Convolutional Neural Network.

BCNet: Searching for Network Width with Bilaterally Coupled Network

BitFlow-Net: Toward Fully Binarized Convolutional Neural Networks

Exploiting Near-Memory Processing Architectures for Bayesian Neural Networks Acceleration

TOWARDS MORE EFFICIENT AND EFFECTIVE INFERENCE: THE JOINT DECISION OF MULTI-PARTICIPANTS

Learning Channel-Wise Interactions for Binary Convolutional Neural Networks.

Depth-Wise Pooling: A Parameter-Less Solution for Channel Reduction of Feature-Map in Convolutional Neural Network

Generic Convolutional Neural Network with Random Pooling Area

An Efficient Sharing Grouped Convolution via Bayesian Learning

Learning Pooling for Convolutional Neural Network.

An efficient approach to escalate the speed of training convolution neural networks

Accelerating convolutional neural network by exploiting sparsity on GPUs