Abstract:Perhaps one of the best-known machine learning models is the artificial neural network, where a number of parameters must be adjusted to learn a wide range of practical problems from areas such as physics, chemistry, medicine, etc. Such problems can be reduced to pattern recognition problems and then modeled from artificial neural networks, whether these problems are classification problems or regression problems. To achieve the goal of neural networks, they must be trained by appropriately adjusting their parameters using some global optimization methods. In this work, the application of a recent global minimization technique is suggested for the adjustment of neural network parameters. In this technique, an approximation of the objective function to be minimized is created using artificial neural networks and then sampling is performed from the approximation function and not the original one. Therefore, in the present work, learning of the parameters of artificial neural networks is performed using other neural networks. The new training method was tested on a series of well-known problems, a comparative study was conducted against other neural network parameter tuning techniques, and the results were more than promising. From what was seen after performing the experiments and comparing the proposed technique with others that have been used for classification datasets as well as regression datasets, there was a significant difference in the performance of the proposed technique, starting with 30% for classification datasets and reaching 50% for regression problems. However, the proposed technique, because it presupposes the use of global optimization techniques involving artificial neural networks, may require significantly higher execution time than other techniques.

Mini-max Initialization for Function Approximation.

A Neural Network Model For General Minimax Problem

Learning Bayesian Network Parameters Via Minimax Algorithm

MinMax Networks

Training Artificial Neural Networks Using a Global Optimization Method That Utilizes Neural Networks

Optimal Neural Network Approximation for High-Dimensional Continuous Functions

Improving Deep Neural Network Performance by Integrating Kernelized Min-Max Objective

A Mean-Field Analysis of Neural Stochastic Gradient Descent-Ascent for Functional Minimiax Optimization

A Mean-Field Analysis of Neural Stochastic Gradient Descent-Ascent for Functional Minimax Optimization

Self-adaptive deep neural network: Numerical approximation to functions and PDEs

Max and Coincidence Neurons in Neural Networks

Function Approximation with Randomly Initialized Neural Networks for Approximate Model Reference Adaptive Control

Convergence Rates of Training Deep Neural Networks Via Alternating Minimization Methods.

Optimal Deep Neural Networks by Maximization of the Approximation Power

Maximum-and-Concatenation Networks

Theory and Learning Algorithm of Multi-Dimensional Function Approximation Based on Functional Networks

Optimal function approximation with ReLU neural networks

Random Vector Functional Link Networks for Function Approximation on Manifolds

A Generalized Neural Network for Solving A Class of Minimax Optimization Problems with Linear Constraints