Abstract:In recent years, with the rapid development of deep learning technology, a large number of excellent convolutional neural networks (CNNs) have been proposed, many of which are based on improvements to classical methods. Based on the Inception family of methods, depthwise separable convolution was applied to Xception to achieve lightweighting, and Inception-ResNet introduces residual connections to accelerate model convergence. However, existing improvements for the Inception module often neglect further enhancement of its receptive field, while increasing the receptive field of CNNs has been widely studied and proven to be effective in improving classification performance. Motivated by this fact, three effective expansion modules are proposed in this paper. The first expansion module, Inception expand (Inception-e) module, is proposed to improve the classification accuracy by concatenating more and deeper convolutional branches. To reduce the number of parameters for Inception e, this paper proposes a second expansion module—Equivalent Inception-e (Eception) module, which is equivalent to Inception-e in terms of feature extraction capability, but which suppresses the growth of the parameter quantity brought by the expansion by effectively reducing the redundant convolutional layers; on the basis of Eception, this paper proposes a third expansion module—Lightweight Eception (Lception) module, which crosses depthwise convolution with ordinary convolution to further effectively reduce the number of parameters. The three proposed modules have been validated on the Cifar10 dataset. The experimental results show that all these extensions are effective in improving the classification accuracy of the models, and the most significant effect is the Lception module, where Lception (rank = 4) on the Cifar10 dataset improves the accuracy by 1.5% compared to the baseline model (Inception module A) by using only 0.15 M more parameters.

Depthwise Multiception Convolution for Reducing Network Parameters without Sacrificing Accuracy

3D Depthwise Convolution: Reducing Model Parameters in 3D Vision Tasks

The Shallow End: Empowering Shallower Deep-Convolutional Networks through Auxiliary Outputs

XSepConv: Extremely Separated Convolution

XSepConv: Extremely Separated Convolution for Efficient Deep Networks with Large Kernels

Depth-wise Decomposition for Accelerating Separable Convolutions in Efficient Convolutional Neural Networks

Learning Efficient Convolutional Networks Through Network Slimming.

Channel-Modulated Multibranch Convolutional Neural Network

SlimConv: Reducing Channel Redundancy in Convolutional Neural Networks by Features Recombining

Network Decoupling: From Regular to Depthwise Separable Convolutions

The Expansion Methods of Inception and Its Application

Accelerating Convolutional Neural Networks by Removing Interspatial and Interkernel Redundancies.

InceptionNeXt: When Inception Meets ConvNeXt

FALCON: Lightweight and Accurate Convolution

Rethinking the Inception Architecture for Computer Vision

Deep Anchored Convolutional Neural Networks

Multi-scale Convolution Aggregation and Stochastic Feature Reuse for DenseNets

Depth-Wise Pooling: A Parameter-Less Solution for Channel Reduction of Feature-Map in Convolutional Neural Network

Efficient channel expansion and pyramid depthwise-pointwise-depthwise neural networks

A Pre-defined Sparse Kernel Based Convolution for Deep CNNs