Abstract:Deep neural networks have achieved impressive success in various applications, but they face challenges when deployed on mobile devices due to limited computational resources. One of the main reasons for this challenge is that these networks employ too many weight maps of convolution layers to generate redundant feature maps to ensure a thorough understanding of the input data, which leads to plenty of parameters and high computational costs. This paper proposes a method to exploit this redundancy efficiently and generate more lightweight convolutional neural networks. First, we employ the peak signal-to-noise ratio (PSNR) to quantitatively verify the similarity in feature maps of the convolution layer, which is also called redundancy. We also find the similarity correspondence between the feature maps and the weight maps. Second, inspired by the analysis, we propose a cost-efficient feature transform module (FTM) to generate redundant feature maps for replacing standard convolution layers and getting lightweight convolutional neural networks (CNNs). The FTM adopts a point-wise and a depth-wise convolution to obtain the prime weight maps which could extract distinguished feature maps based on the similarity correspondence. Then, these meaningful feature maps are broadcast by an efficient neighbor-1D convolution, ensuring the feature redundancy of the network information flow. Extensive experiments on image classification benchmark datasets (CIFAR-10, CIFAR-100, ImageNet) show that the FTM outperforms existing methods in terms of efficiency. In addition, if used as a drop-in replacement for standard architectures such as ResNet-50, the FTM variant could achieve a comparable score with only 21% parameters of the original layer. The code of the proposed method is available at: https://github.com/li-ju-bazhong/Efficient-feature-transform-module.

Self-Fusion Convolutional Neural Networks.

Lightweight Multi-Attention Fusion Network for Image Super-Resolution

Fusion that matters: convolutional fusion networks for visual recognition

A Novel Feature Fusion with Self-adaptive Weight Method Based on Deep Learning for Image Classification

PFFN: Progressive Feature Fusion Network for Lightweight Image Super-Resolution

UNIFusion: A Lightweight Unified Image Fusion Network

Φunit: A Lightweight Module for Feature Fusion Based on Their Dimensions

Efficient feature transform module

Lightweight Feature Fusion Network for Single Image Super-Resolution

A Lightweight Block with Information Flow Enhancement for Convolutional Neural Networks

An efficient parallel fusion structure of distilled and transformer-enhanced modules for lightweight image super-resolution

Lightweight Single Image Super-Resolution with Similar Feature Fusion Block

FusionGCN: Multi-focus image fusion using superpixel features generation GCN and pixel-level feature reconstruction CNN

Lightweight Feature De-redundancy and Self-calibration Network for Efficient Image Super-resolution

LAFFNet: A Lightweight Adaptive Feature Fusion Network for Underwater Image Enhancement

IFCNN: A General Image Fusion Framework Based on Convolutional Neural Network.

SFPFusion: An Improved Vision Transformer Combining Super Feature Attention and Wavelet-Guided Pooling for Infrared and Visible Images Fusion

Multiscale Low-Frequency Memory Network for Improved Feature Extraction in Convolutional Neural Networks

A fuzzy convolutional neural network for enhancing multi-focus image fusion

A Lightweight Pyramid Feature Fusion Network for Single Image Super-Resolution Reconstruction

A very lightweight and efficient image super-resolution network