Abstract:Objective Deep learning has been widely used in computer vision and possesses increased number of network layers,which is its major difference from shallow learning.Deep learning can learn data through multi-level networks,construct a complex nonlinear function model to extract data features,combine low-level features into high-level features,and complete the classification and recognition of data.Deep learning can extract accurate features and avoid the subjectivity and randomness of artificial selection without human participation in the process of feature extraction.Convolutional neural network (CNN) is an important model of deep learning and is widely used in image classification and recognition tasks.Improving the convergence speed and recognition rate can promote the application development of CNN.CNN possesses strong robustness because of its convolution and pooling operation during the feature extraction phase.It also exhibits powerful capability of learning owing to its multiple layers and rich parameters.Many researchers have improved the CNN for its application in different fields.In this study,an adaptively enhanced CNN algorithm is proposed to improve the convergence speed and recognition accuracy of the CNN,reduce the difficulty of training,optimize the convergence effect,and enhance the generalization capability.Method CNN mainly includes forward and back propagations for classifying and recognizing images.Forward propagation includes feature extraction and target classification,and back propagation includes feedback of classification error and updating of weights.The proposed algorithm is aimed at adding an error adaptively enhanced process between forth and back propagations,building the adaptively enhanced model,constructing the CNN on the basis of the adaptively enhanced model,analyzing the causes of error classification and error feedback pattern during the process of CNN classification and recognition,and training the classification error purposefully.The two largest values in the classification results are extracted as features,and their corresponding errors are enhanced whereas other error values remain unchanged.The classification features and weights of the CNN can be enhanced adaptively with iterations,and the results of classification can accelerate the convergence of the CNN and improve the recognition rate.The optimization degree of adaptively enhanced model for convergence speed,recognition accuracy,and convergence effect as well as generalization capability of the CNN are compared with those of other algorithms.The performance of adaptively enhanced CNN in terms of generalization capability is validated on various datasets.Notably,computing each algorithm is time consuming.Result The experiments are carried out on datasets of handwritten digital numbers,handwritten characters,and hyperspectral images,and the results of different image recognition and optimization algorithms based on CNN on these datasets are compared.The contrast experimental results show that the adaptively enhanced CNN algorithm can improve the convergence speed and recognition rate in a large extent and can optimize the convergence effect and generalization capability.The error rate of recognition can be reduced by 20.93％ on handwritten digital numbers,11.82％ on handwritten characters,and 15.12％ on hyper spectral images when it converges.The adaptively enhanced CNN presents no increase in time cost.The proposed algorithm also possesses better recognition effect than that of other CNN optimization algorithms.For example,the error rate of recognition can be reduced by 58.29％ and 43.50％ atnost compared with the rates obtained by dynamic adaptive pooling algorithm and dual optimization algorithm.The proposed algorithm can improve the effect of different gradient optimization algorithms by reducing the error rate of recognition by 33.11％ at most.This algorithm also presents different improvements in recognition rate compared with other image recognition algorithms.Conclusion The adaptively enhanced CNN can enhance the classification feature adaptively.Improvements in convergence speed,recognition rate,and optimization of convergence effect are demonstrated.The CNN can be improved effectively by the adaptively enhanced model without increasing the cost of time.In addition,the proposed algorithm can achieve the optimization effect by use of the different gradient descent algorithms and can be further optimized on the basis of the gradient descent algorithms.The adaptively enhanced CNN exhibits good generalization capability.This algorithm can be further extended to other deep learning algorithms related to CNN.

Hyperparameters Optimization of Convolutional Neural Network Based on Local Autonomous Competition Harmony Search Algorithm

Application of Metaheuristic Algorithms for Determining the Structure of a Convolutional Neural Network with a Small Dataset

A Surrogate-Assisted Highly Cooperative Coevolutionary Algorithm for Hyperparameter Optimization in Deep Convolutional Neural Networks

Convolution Neural Network Hyperparameter Optimization Using Simplified Swarm Optimization

Adaptively enhanced convolutional neural network algorithm for image recognition

Optimization of Convolutional Neural Network Using the Linearly Decreasing Weight Particle Swarm Optimization

Metaheuristic Algorithms for Convolution Neural Network

Improving classification accuracy of fine-tuned CNN models: Impact of hyperparameter optimization

Efficient Hyperparameter Optimization in Deep Learning Using a Variable Length Genetic Algorithm

Fuzzy Cerebellar Model Articulation Controller Network Optimization Via Self-Adaptive Global Best Harmony Search Algorithm

Cpso-Cnn: an Efficient PSO-based Algorithm for Fine-Tuning Hyper-Parameters of Convolutional Neural Networks.

A Lpso-Sgd Algorithm For The Optimization Of Convolutional Neural Network

Optimization of Convolutional Neural Network using Microcanonical Annealing Algorithm

A Hybrid Training Method of Convolution Neural Networks Using Adaptive Cooperative Particle Swarm Optimiser.

Automatic CNN Compression Based on Hyper-parameter Learning.

Optimal Parameter Selection In Hyperspectral Classification Based On Convolutional Neural Network

MO-CNN: Multiobjective Optimization of Convolutional Neural Networks for Hyperspectral Image Classification

Efficient adaptive learning rate for convolutional neural network based on quadratic interpolation egret swarm optimization algorithm

Chinese Sentiment Analysis Based on Parameter Optimization of Convolutional Neural Network

The Optimisation of Speech Recognition Based on Convolutional Neural Network

Hyperparameter Recommendation Integrated With Convolutional Neural Network