Abstract:Training optimization plays a vital role in the development of convolution neural network (CNN). CNNs are hard to train because of the presence of multiple local minima. The optimization problem for a CNN is non-convex, hence, has multiple local minima. If any of the chosen hyper-parameters are not appropriate, it will end up at bad local minima, which leads to poor performance. Hence, proper optimization of the training algorithm for CNN is the key to converge to a good local minimum. Therefore, in this paper, we introduce an evolutionary convolution neural network (ModPSO-CNN) algorithm. The proposed algorithm results in the fusion of modified particle swarm optimization (ModPSO) along with backpropagation (BP) and convolution neural network (CNN). The training of CNN involves ModPSO along with backpropagation (BP) algorithm to encourage performance improvement by avoiding premature convergence and local minima. The ModPSO have adaptive, dynamic and improved parameters, to handle the issues in training CNN. The adaptive and dynamic parameters bring a proper balance between the global and local search ability, while an improved parameter keeps the diversity of the swarm. The proposed ModPSO algorithm is validated on three standard mathematical test functions and compared with three variants of the benchmark PSO algorithm. Furthermore, the performance of the proposed ModPSO-CNN is also compared with other training algorithms focusing on the analysis of computational cost, convergence and accuracy based on a standard problem specific to classification applications, such as CIFAR-10 dataset and face and skin detection dataset.

Unsupervised Pre-Trained Filter Learning Approach for Efficient Convolution Neural Network.

Advances in Convolutional Neural Networks

Face Recognition: A Novel Un-Supervised Convolutional Neural Network Method

Convolutional networks and applications in vision

Feature Learning For SAR Images Using Convolutional Neural Network.

Optimization of CNN through Novel Training Strategy for Visual Classification Problems

CSFL: A novel unsupervised convolution neural network approach for visual pattern classification.

Initialization of CNN Models for Training on a Small Dataset Using Importance of Filter Parameters

ModPSO-CNN: an Evolutionary Convolution Neural Network with Application to Visual Recognition

Learning Versatile Filters for Efficient Convolutional Neural Networks.

Training Interpretable Convolutional Neural Networks by Differentiating Class-specific Filters

Learning Scalable Dynamic Filter in Convolutional Networks.

An Efficient and Effective Deep Convolutional Kernel Pseudoinverse Learner with Multi-Filter.

Optimisation-based training of evolutionary convolution neural network for visual classification applications

On filter design in deep convolutional neural network

Learning to Prune Filters in Convolutional Neural Networks

Learning Versatile Convolution Filters for Efficient Visual Recognition

Pay Attention to Convolution Filters: Towards Fast and Accurate Fine-Grained Transfer Learning

A Simple Convolutional Transfer Neural Networks In Vision Tasks

Competitive Learning Enriches Learning Representation and Accelerates the Fine-tuning of CNNs

A New Convolution Network Based on Laplacian Eigenmap