Abstract:Perhaps one of the best-known machine learning models is the artificial neural network, where a number of parameters must be adjusted to learn a wide range of practical problems from areas such as physics, chemistry, medicine, etc. Such problems can be reduced to pattern recognition problems and then modeled from artificial neural networks, whether these problems are classification problems or regression problems. To achieve the goal of neural networks, they must be trained by appropriately adjusting their parameters using some global optimization methods. In this work, the application of a recent global minimization technique is suggested for the adjustment of neural network parameters. In this technique, an approximation of the objective function to be minimized is created using artificial neural networks and then sampling is performed from the approximation function and not the original one. Therefore, in the present work, learning of the parameters of artificial neural networks is performed using other neural networks. The new training method was tested on a series of well-known problems, a comparative study was conducted against other neural network parameter tuning techniques, and the results were more than promising. From what was seen after performing the experiments and comparing the proposed technique with others that have been used for classification datasets as well as regression datasets, there was a significant difference in the performance of the proposed technique, starting with 30% for classification datasets and reaching 50% for regression problems. However, the proposed technique, because it presupposes the use of global optimization techniques involving artificial neural networks, may require significantly higher execution time than other techniques.

Determination of minimal artificial neural network based on decision tree algorithm

A Method for Estimating the Number of Hidden Neurons in Feed-Forward Neural Networks Based on Information Entropy

An Improved Minimum Distance Method Based on Artificial Neural Networks

Minimum number of neurons in fully connected layers of a given neural network (the first approximation)

Neural Networks are Decision Trees

Searching for Minimal Optimal Neural Networks

Design Neural Network Based on Decision Tree Rules and Its Application Research

TWD-SFNN: Three-way decisions with a single hidden layer feedforward neural network

Using Two-Phase Approach to Extract Knowledge from Artificial Neural Networks

On the approximation of the solution of partial differential equations by artificial neural networks trained by a multilevel Levenberg-Marquardt method

A Gentle Introduction to Artificial Neural Networks

Cognitive Computational Model Using Machine Learning Algorithm in Artificial Intelligence Environment

Training Artificial Neural Networks Using a Global Optimization Method That Utilizes Neural Networks

Distilling a Neural Network Into a Soft Decision Tree

A New Method for Decision on the Structure of RBF Neural Network

Mini-max Initialization for Function Approximation.

Module Combination Based on Decision Tree in Min-Max Modular Network

Automatic Induction of Neural Network Decision Tree Algorithms

Decision-making Modeling Method Based on Artificial Neural Network and Data Envelopment Analysis

Rule Extraction using Artificial Neural Networks

Lower bounds for artificial neural network approximations: A proof that shallow neural networks fail to overcome the curse of dimensionality