Abstract:Convolutional neural network (CNN) is one of the most frequently used deep learning techniques. Various forms of models have been proposed and im-proved for learning at CNN. When learning with CNN, it is necessary to determine the optimal hyperparameters. However, the number of hyperparameters is so large that it is difficult to do it manually, so much research has been done on automation. A method that uses metaheuristic algorithms is attracting attention in research on hyperparameter optimization. Metaheuristic algorithms are naturally inspired and include evolution strategies, genetic algorithms, antcolony optimization and particle swarm optimization. In particular, particle swarm optimization converges faster than genetic algorithms, and various models have been proposed. In this paper, we pro-pose CNN hyperparameter optimization with linearly decreasing weight particle swarm optimization (LDWPSO). In the experiment, the MNIST data set and CIFAR-10 data set, which are often used as benchmark data sets, are used. By opti-mizing CNN hyperparameters with LDWPSO, learning the MNIST and CIFAR-10 datasets, we compare the accuracy with a standard CNN based on LeNet-5. As a result, when using the MNIST dataset, the baseline CNN is 94.02% at the 5th epoch, compared to 98.95% for LDWPSO CNN, which improves accuracy. When using the CIFAR-10 dataset, the Baseline CNN is 28.07% at the 10th epoch, compared to 69.37% for the LDWPSO CNN, which greatly improves accuracy. This paper is presented at the 36th Annual Conference of the Japanese Society for Artificial In-telligence. The final version is available at the following URL: <a class="link-external link-https" href="https://doi.org/10.11517/pjsai.JSAI2022.0_2S4IS2b03" rel="external noopener nofollow">this https URL</a>

Particle swarm optimization performance improvement using deep learning techniques

Empirical Study Of Particle Swarm Optimizer With An Increasing Inertia Weight

A New Approach To Improve Particle Swarm Optimization

The Particle Swarm Optimization Algorithm Improved Based on Multiple Strategies Including Adaptive Nonlinear Weights

Modified particle swarm optimization with dynamic performance

An improved particle swarm optimization algorithm based on dynamically changing nonlinear inertia weight factor and partially regenerate particles

Numerical analyses of three inertia-weight-improvement-based particle swarm optimization algorithms

An Improved Inertia Weight Mutation Particle Swarm Optimization

DCWPSO: particle swarm optimization with dynamic inertia weight updating and enhanced learning strategies

A New Adaptive Inertia Weight Strategy in Particle Swarm Optimization.

An Improved Inertia Weight Mean Particle Swarm Optimization Algorithm

Improved Particle Swarm Optimization with Adaptive Inertia Weight

A dynamic inertia weight particle swarm optimization algorithm

Improved Particle Swarm Optimizer Based on Nonlinear Inertia Weight Dynamic Changing

Optimization of Convolutional Neural Network Using the Linearly Decreasing Weight Particle Swarm Optimization

Parameters Optimization of Deep Learning Models using Particle Swarm Optimization

Modified particle swarm optimizer with dynamic nonlinear inertia weight

A Modified Particle Swarm Optimizer with Dynamical Inertia Weight.

Simplified Particle Swarm Optimization Algorithm Based on Improved Inertia Weight

An Efficient and Improved Particle Swarm Optimization Algorithm for Swarm Robots System.

Hybrid Particle Swarm Optimization Algorithm Based on Dynamic Adjustment of Inertia Weight