Abstract:In recent years, with the rapid development of deep learning technology, a large number of excellent convolutional neural networks (CNNs) have been proposed, many of which are based on improvements to classical methods. Based on the Inception family of methods, depthwise separable convolution was applied to Xception to achieve lightweighting, and Inception-ResNet introduces residual connections to accelerate model convergence. However, existing improvements for the Inception module often neglect further enhancement of its receptive field, while increasing the receptive field of CNNs has been widely studied and proven to be effective in improving classification performance. Motivated by this fact, three effective expansion modules are proposed in this paper. The first expansion module, Inception expand (Inception-e) module, is proposed to improve the classification accuracy by concatenating more and deeper convolutional branches. To reduce the number of parameters for Inception e, this paper proposes a second expansion module—Equivalent Inception-e (Eception) module, which is equivalent to Inception-e in terms of feature extraction capability, but which suppresses the growth of the parameter quantity brought by the expansion by effectively reducing the redundant convolutional layers; on the basis of Eception, this paper proposes a third expansion module—Lightweight Eception (Lception) module, which crosses depthwise convolution with ordinary convolution to further effectively reduce the number of parameters. The three proposed modules have been validated on the Cifar10 dataset. The experimental results show that all these extensions are effective in improving the classification accuracy of the models, and the most significant effect is the Lception module, where Lception (rank = 4) on the Cifar10 dataset improves the accuracy by 1.5% compared to the baseline model (Inception module A) by using only 0.15 M more parameters.

Residual Inception: A New Module Combining Modified Residual with Inception to Improve Network Performance

Residual Feature-Reutilization Inception Network

Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning

Recursive Inception Network For Super-Resolution

Irsnet: An Inception-Resnet Feature Reconstruction Model For Building Segmentation

Improved Inception-Residual Convolutional Neural Network for Object Recognition

The Expansion Methods of Inception and Its Application

Deep pyramidal residual networks with inception sub-structure in image classification

Improved Residual Networks for Image and Video Recognition

GoogLe2Net: Going Transverse with Convolutions

Random Inception Module And Its Parallel Implementation

Residual Networks of Residual Networks: Multilevel Residual Networks

Residual Connections Encourage Iterative Inference

Double reuses based residual network

Rethinking the Usage of Batch Normalization and Dropout in the Training of Deep Neural Networks

RMNet: Equivalently Removing Residual Connection from Networks

InceptionNeXt: When Inception Meets ConvNeXt

More trainable inception-ResNet for face recognition

On the importance of network architecture in training very deep neural networks

Weighted Residuals for Very Deep Networks

Wide-residual-inception networks for real-time object detection