Abstract:Within neural networks, it is considered a difficult task to find optimal values for the number of hidden neurons and connection weights simultaneously. This is because altering the hidden neurons significantly affects a neural network's structure and increases the difficulty of the training process which needs special considerations. Particle swarm optimization (PSO) is one of the most important metaheuristic algorithms due to its convergence speed and its simplicity of implementation. Multi-verse optimization (MVO) based on Lévy flight is a recent and fast algorithm and can avoid premature convergence and can achieve a better balance between exploration and exploitation. This paper presents a new training method based on hybrid particle swarm optimization with Multi-verse optimization based on Lévy flight (PLMVO) to optimize the number of hidden neurons and connection weights simultaneously in feedforward neural networks (FFNN). The hybrid algorithm is utilized to search better in solution space which proves its efficiency in reducing the problems of trapping in local minima. To evaluate the proposed algorithm we used three experimental series. In the first one, the proposed PLMVO algorithm is compared with the MVO and PSO algorithms to solve a set of 15 benchmark functions to find the global solution. Meanwhile, in the second experiment, the performance of the proposed approach was compared with five evolutionary techniques and the standard momentum backpropagation and adaptive learning rate. The comparison was benchmarked and evaluated using nine bio-medical datasets. The results of the comparative study show that PLMVO outperformed other training methods in most datasets and can be an alternative to other training methods. In the third experiment, the proposed PLMVO-MLP is used to predict malicious executable Linux files. The implemented model achieved very promising results with very high accuracy of 1.0, and an average f-measure of 1.0.

Neural Network Training Based on Object-Oriented Adaptive Particle Swarm Optimization

Asynchronous particle swarm optimizer with relearning strategy

Particle Swarm Optimization Based Algorithm for Neural Network Learning

Evolving Neural Networks Using the Hybrid of Ant Colony Optimization and Bp Algorithms

Based on Mix GA-PSO Nerve Network Algorithm

Neural Network Training Algorithm Based on Particle Swarm Optimization

Neural Networks Learning Using Vbest Model Particle Swarm Optimisation

Neural Network Classification with Optimization by Genetic Algorithms for Remote Sensing Imagery

Particle swarm optimization neural network for research on artificial intelligence college English classroom teaching framework

A Novel Hybrid Evolutionary Algorithm Based on Pso and Afsa for Feedforward Neural Network Training

Particle Swarm Optimisation In Feedforward Neural Network

Research on Neural Networks Learning Algorithm Based on Pso and Coa

Survival Density Particle Swarm Optimization for Neural Network Training

A Study of Application of An Improved PSO Algorithm in BP Network

Training RBF neural network with hybrid particle swarm optimization

Neural Architecture Search using Particle Swarm and Ant Colony Optimization

A new stochastic PSO technique for neural network training

Particle Swarm Optimisation for Evolving Artificial Neural Network

Automatic selection of hidden neurons and weights in neural networks for data classification using hybrid particle swarm optimization, multi-verse optimization based on Lévy flight

Training neural networks without backpropagation using particles