Abstract:Deep Convolutional Neural Network (CNN) is a special type of Neural Networks, which has shown exemplary performance on several competitions related to Computer Vision and Image Processing. Some of the exciting application areas of CNN include Image Classification and Segmentation, Object Detection, Video Processing, Natural Language Processing, and Speech Recognition. The powerful learning ability of deep CNN is primarily due to the use of multiple feature extraction stages that can automatically learn representations from the data. The availability of a large amount of data and improvement in the hardware technology has accelerated the research in CNNs, and recently interesting deep CNN architectures have been reported. Several inspiring ideas to bring advancements in CNNs have been explored, such as the use of different activation and loss functions, parameter optimization, regularization, and architectural innovations. However, the significant improvement in the representational capacity of the deep CNN is achieved through architectural innovations. Notably, the ideas of exploiting spatial and channel information, depth and width of architecture, and multi-path information processing have gained substantial attention. Similarly, the idea of using a block of layers as a structural unit is also gaining popularity. This survey thus focuses on the intrinsic taxonomy present in the recently reported deep CNN architectures and, consequently, classifies the recent innovations in CNN architectures into seven different categories. These seven categories are based on spatial exploitation, depth, multi-path, width, feature-map exploitation, channel boosting, and attention. Additionally, the elementary understanding of CNN components, current challenges, and applications of CNN are also provided.

CNN Architectures: Alex Net, Le Net, VGG, Google Net, Res Net

A Survey of the Recent Architectures of Deep Convolutional Neural Networks

Advances in Convolutional Neural Networks

Refining Architectures of Deep Convolutional Neural Networks

CNN Variants for Computer Vision: History, Architecture, Application, Challenges and Future Scope

Theoretical Understanding of Convolutional Neural Network: Concepts, Architectures, Applications, Future Directions

Convolutional neural network: a review of models, methodologies and applications to object detection

Fundamental Concepts of Convolutional Neural Network

Understanding of Convolutional Neural Network (CNN): A Review

Convolutional Neural Network and its Applications in Artificial Intelligence

Automated CNN Architectural Design: A Simple and Efficient Methodology for Computer Vision Tasks

Moving Convolutional Neural Networks to Embedded Systems: The AlexNet and VGG-16 Case

Some New Layer Architectures for Graph CNN

CNN advancements and its applications in image recognition: A comprehensive analysis and future prospects

Deep Convolutional Neural Network (CNN) for Large-Scale Images Classification

Deep Learning Using Isotroping, Laplacing, Eigenvalues Interpolative Binding, and Convolved Determinants with Normed Mapping for Large-Scale Image Retrieval

An Introduction to Convolutional Neural Networks

DEEP LEARNING ARCHITECTURE BASED ON CONVOLUTIONAL NEURAL NETWORK (CNN) IN IMAGE CLASSIFICATION

Convolutional Neural Networks Exploiting Attributes of Biological Neurons

A Taxonomy of Deep Convolutional Neural Nets for Computer Vision

Understanding of a convolutional neural network