Abstract:Perhaps one of the best-known machine learning models is the artificial neural network, where a number of parameters must be adjusted to learn a wide range of practical problems from areas such as physics, chemistry, medicine, etc. Such problems can be reduced to pattern recognition problems and then modeled from artificial neural networks, whether these problems are classification problems or regression problems. To achieve the goal of neural networks, they must be trained by appropriately adjusting their parameters using some global optimization methods. In this work, the application of a recent global minimization technique is suggested for the adjustment of neural network parameters. In this technique, an approximation of the objective function to be minimized is created using artificial neural networks and then sampling is performed from the approximation function and not the original one. Therefore, in the present work, learning of the parameters of artificial neural networks is performed using other neural networks. The new training method was tested on a series of well-known problems, a comparative study was conducted against other neural network parameter tuning techniques, and the results were more than promising. From what was seen after performing the experiments and comparing the proposed technique with others that have been used for classification datasets as well as regression datasets, there was a significant difference in the performance of the proposed technique, starting with 30% for classification datasets and reaching 50% for regression problems. However, the proposed technique, because it presupposes the use of global optimization techniques involving artificial neural networks, may require significantly higher execution time than other techniques.

A Neural Network Transformation based Global Optimization Algorithm

Neural Network Solution for General Nonlinear Optimization Problems

A new global optimization algorithm based upon gradient search

Deterministic global optimization with a neighbourhood determination algorithm based on neural networks

Distributed Stochastic Algorithm for Global Optimization in Networked System

Hybridizing Grey Wolf Optimization with Neural Network Algorithm for Global Numerical Optimization Problems

An Enhanced Neural Network Algorithm with Quasi-Oppositional-Based and Chaotic Sine-Cosine Learning Strategies

Training Artificial Neural Networks Using a Global Optimization Method That Utilizes Neural Networks

A Neural Network Learning-based Global Optimization Approach for Aero-engine Transient Control Schedule

Effective Neural Network Training with a New Weighting Mechanism-Based Optimization Algorithm.

Learning to be Global Optimizer

Novel hybrid genetic algorithm for global optimization problems

A Novel Global Hybrid Algorithm for Feedforward Neural Networks

Hybrid Teaching-Learning-based Optimization and Neural Network Algorithm for Engineering Design Optimization Problems.

A Global Neural Network Learning Machine

Globally Convergent Neural Networks

Large-scale global optimization of ultra-high dimensional non-convex landscapes based on generative neural networks

A New Global Optimizing Algorithm for Fuzzy Neural Networks

A Novel Global Training Algorithm and Its Convergence Theorem for Fuzzy Neural Networks

Global Deterministic Optimization with Artificial Neural Networks Embedded

A Novel Hybrid Meta-Heuristic Algorithm Based on the Cross-Entropy Method and Firefly Algorithm for Global Optimization