Abstract:Perhaps one of the best-known machine learning models is the artificial neural network, where a number of parameters must be adjusted to learn a wide range of practical problems from areas such as physics, chemistry, medicine, etc. Such problems can be reduced to pattern recognition problems and then modeled from artificial neural networks, whether these problems are classification problems or regression problems. To achieve the goal of neural networks, they must be trained by appropriately adjusting their parameters using some global optimization methods. In this work, the application of a recent global minimization technique is suggested for the adjustment of neural network parameters. In this technique, an approximation of the objective function to be minimized is created using artificial neural networks and then sampling is performed from the approximation function and not the original one. Therefore, in the present work, learning of the parameters of artificial neural networks is performed using other neural networks. The new training method was tested on a series of well-known problems, a comparative study was conducted against other neural network parameter tuning techniques, and the results were more than promising. From what was seen after performing the experiments and comparing the proposed technique with others that have been used for classification datasets as well as regression datasets, there was a significant difference in the performance of the proposed technique, starting with 30% for classification datasets and reaching 50% for regression problems. However, the proposed technique, because it presupposes the use of global optimization techniques involving artificial neural networks, may require significantly higher execution time than other techniques.

Relationship Between a Fuzzy Logic and a Steepest Descent Approach to Optimize a Feedforward Artificial Neural Network Configuration.

On the Design of Neural-Fuzzy Control System

Neural Networks Designing Neural Networks: Multi-Objective Hyper-Parameter Optimization

Strategies for Optimizing Feed Rate of Fed-Batch Yeast Fermentation by Fuzzy-Neural Network

A design methodology for an intelligent controller using fuzzy logic and artificial neural networks

In-Depth Case Study on Artificial Neural Network Weights Optimization Using Meta-Heuristic and Heuristic Algorithmic Approach

OPTIMUM DESIGN OF MLP NETWORK STRUCTURE USING FUZZY LOGIC APPROACH

A Neural Network For Constrained Fuzzy Convex Optimization Problems

Raoga-Based Fuzzy Neural Network Model Of Design Evaluation

Modeling and Optimization in Complex Systems Based on Computational Intelligence.

An Optimization Technique for Solving a Class of Ridge Fuzzy Regression Problems

A Smooth Optimisation Perspective on Designing and Training Feedforward Multilayer Perceptrons

A New Global Optimizing Algorithm for Fuzzy Neural Networks

GA&LS-based Fuzzy Neural Network control

Optimal Algorithm for a Multilayer Feedforward Net and Its Application

Messy Genetic Algorithm Based New Learning Method for Structurally Optimised Neurofuzzy Controllers

A structure optimisation algorithm for feedforward neural network construction

A perspective and critique of adaptive neurofuzzy systems used for modelling and control applications

Training Artificial Neural Networks Using a Global Optimization Method That Utilizes Neural Networks

Fractional-Neuro-Optimizer: A Neural-Network-Based Optimization Method

Optimization Algorithm Inspired Deep Neural Network Structure Design