Abstract:Although group convolution operators are increasingly used in deep convolutional neural networks to improve the computational efficiency and to reduce the number of parameters, most existing methods construct their group convolution architectures by a predefined partitioning of the filters of each convolutional layer into multiple regular filter groups with an equal spatial group size and data-independence, which prevents a full exploitation of their potential. To tackle this issue, we propose a novel method of designing self-grouping convolutional neural networks, called SG-CNN, in which the filters of each convolutional layer group themselves based on the similarity of their importance vectors. Concretely, for each filter, we first evaluate the importance value of their input channels to identify the importance vectors, and then group these vectors by clustering. Using the resulting data-dependent centroids, we prune the less important connections, which implicitly minimizes the accuracy loss of the pruning, thus yielding a set of diverse group convolution filters. Subsequently, we develop two fine-tuning schemes, i.e. (1) both local and global fine-tuning and (2) global only fine-tuning, which experimentally deliver comparable results, to recover the recognition capacity of the pruned network. Comprehensive experiments carried out on the CIFAR-10/100 and ImageNet datasets demonstrate that our self-grouping convolution method adapts to various state-of-the-art CNN architectures, such as ResNet and DenseNet, and delivers superior performance in terms of compression ratio, speedup and recognition accuracy. We demonstrate the ability of SG-CNN to generalise by transfer learning, including domain adaption and object detection, showing competitive results. Our source code is available at <a href="https://github.com/QingbeiGuo/SG-CNN.git">https://github.com/QingbeiGuo/SG-CNN.git</a>.

Self-Representation Convolutional Neural Networks

NoUCSR: Efficient Super-Resolution Network Without Upsampling Convolution.

A Convolutional Neural Network with Sparse Representation

RSCNN: A CNN-Based Method to Enhance Low-Light Remote-Sensing Images

Convolutional recurrent neural networks: Learning spatial dependencies for image representation

FCN: Fully Channel-Concatenated Network for Single Image Super-Resolution

Image Super-Resolution Based on Dense Convolutional Network.

Convolutional Neural Networks Exploiting Attributes of Biological Neurons

RC-CNN: Representation-Consistent Convolutional Neural Networks for Achieving Transformation Invariance

Self-grouping convolutional neural networks

SCN: Self-Calibration Network for fast and accurate image super-resolution

A Novel Convolutional Neural Network Architecture for Image Super-Resolution Based on Channels Combination

Context-aware lightweight remote-sensing image super-resolution network

Deeper Interpretability of Deep Networks

Visualizing and Comparing Convolutional Neural Networks

Single Image Super-Resolution Using a Polymorphic Parallel CNN

IC Networks: Remodeling the Basic Unit for Convolutional Neural Networks

Lightweight Feature De-redundancy and Self-calibration Network for Efficient Image Super-resolution

Coarse-to-Fine CNN for Image Super-Resolution

RFCNet: Remote Sensing Image Super-Resolution Using Residual Feature Calibration Network

Dynamic image super-resolution via progressive contrastive self-distillation