Abstract:Deep convolutional neural network (DCNN) is an influential tool for solving various problems in machine learning and computer vision. Recurrent connectivity is a very important component of visual information processing within the human brain. The idea of recurrent connectivity is rarely applied within convolutional layers, the exceptions being a couple of DCNN architectures including recurrent convolutional neural network (RCNN) in Liang and Hu (in: Proceedings of the IEEE conference on computer vision and pattern recognition, 2015) and Pinheiro and Collobert (in: ICML, 2014). On the other hand, the Inception network architecture has become popular among the computer vision community (Szegedy et al. in Inception-v4, Inception-ResNet and the impact of Residual connections on learning, 2016. <a href="http://arxiv.org/abs/1602.07261">arXiv:1602.07261</a>). In this paper, we introduce a deep learning architecture called the Inception Recurrent Convolutional Neural Network (IRCNN), which utilizes the power of an Inception network combined with recurrent convolutional layers. Although the inputs are static, the recurrent property plays a huge role in modeling the contextual information for object recognition tasks and thus improves overall training and testing accuracy. In addition, this proposed architecture generalizes both Inception and RCNN models. We have empirically evaluated the recognition performance of the proposed IRCNN model using different benchmark datasets such as MNIST, CIFAR-10, CIFAR-100, and SVHN. The experimental results show higher recognition accuracy when compared to most of the popular DCNNs including the RCNN. Furthermore, we have investigated IRCNN performance against equivalent Inception networks (EIN) and equivalent Inception–Residual networks (EIRN) using the CIFAR-100 dataset. When using the augmented CIFAR-100 dataset, we achieved about 3.5%, 3.47% and 2.54% improvement in classification accuracy compared to the RCNN, EIN, and EIRN respectively. We have also conducted experiment on Tiny ImageNet-200 dataset with IRCNN, EIN, EIRN, RCNN, DenseNet in Huang et al. (Densely connected convolutional networks, 2016. <a href="http://arxiv.org/abs/1608.06993">arXiv:1608.06993</a>), and DenseNet with Recurrent Convolution Layer, where the proposed model shows significantly better performance against baseline models.

Going deeper with convolutions

Very Deep Convolutional Networks for Large-Scale Image Recognition

Rethinking the Inception Architecture for Computer Vision

GoogLe2Net: Going Transverse with Convolutions

Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning

Xception: Deep Learning with Depthwise Separable Convolutions

Involution: Inverting the Inherence of Convolution for Visual Recognition

InceptionNeXt: When Inception Meets ConvNeXt

Deep Superpixel Convolutional Network for Image Recognition

Convolutional Networks with Dense Connectivity

The Expansion Methods of Inception and Its Application

Deep Convolution Neural Networks in Computer Vision: a Review

Deep Isometric Learning for Visual Recognition

ImageNet classification with deep convolutional neural networks

Return of the Devil in the Details: Delving Deep into Convolutional Nets

Fully Convolutional Networks for Semantic Segmentation

InceptionSSVEP: A Multi-Scale Convolutional Neural Network for Steady-State Visual Evoked Potential Classification

Convolution goes higher-order: a biologically inspired mechanism empowers image classification

Inception recurrent convolutional neural network for object recognition

Wider or Deeper: Revisiting the ResNet Model for Visual Recognition