Abstract:In the field of global optimization, finding the global optimum for complex problems remains a significant challenge. Traditional optimization methods often struggle to escape local minima and achieve global solutions, particularly when the initial solutions are far from the global optimum. This study addresses these challenges by introducing a novel algorithm called neural network transformation based global optimization. Our approach transforms original decision variables into higher-dimensional neural network parameters and constructs an empirical loss function using multiple sample points. By employing stochastic gradient descent for training, our approach effectively navigates the optimization landscape, escaping local minima and reaching low-loss solutions with high probability, even from distant starting points. We also propose a hybrid optimization method that combines the strength of metaheuristic strategies. The experimental results show that our hybrid method surpasses traditional global optimization algorithms, achieving an average 5% improvement in the success rate across benchmark functions. In practical applications, such as the B-spline curve approximation, our method reduces the fitting error by at least 10% compared with conventional approaches, delivering more accurate results. This study contributes a new gradient-based algorithm to the global optimization field, particularly effective for complex real-world problems where the initial points are far from the global minima.

A collaborative neurodynamic approach with two-timescale projection neural networks designed via majorization-minimization for global optimization and distributed global optimization

Two-timescale projection neural networks in collaborative neurodynamic approaches to global optimization and distributed optimization

Two-timescale recurrent neural networks for distributed minimax optimization

Accelerated Primal-Dual Projection Neurodynamic Approach With Time Scaling for Linear and Set Constrained Convex Optimization Problems

Neural Network Solution for General Nonlinear Optimization Problems

A Two-Timescale Duplex Neurodynamic Approach to Mixed-Integer Optimization

Distributed Stochastic Algorithm for Global Optimization in Networked System

Neurodynamic approaches for multi-agent distributed optimization

A Neural Network Transformation based Global Optimization Algorithm

A Collaborative Neurodynamic Optimization Approach to Distributed Nash-Equilibrium Seeking in Multicluster Games With Nonconvex Functions

Decentralized stochastic subgradient projection optimization algorithms over random networks

A nonautonomous-differential-inclusion neurodynamic approach for nonsmooth distributed optimization on multi-agent systems

A Collaborative Neurodynamic Optimization Approach to Distributed Chiller Loading

Capacitated Clustering via Majorization-Minimization and Collaborative Neurodynamic Optimization

Binary matrix factorization via collaborative neurodynamic optimization

Sparse Bayesian Learning Based on Collaborative Neurodynamic Optimization

Nonlinear Collaborative Scheme for Deep Neural Networks.

Inverse-free distributed neurodynamic optimization algorithms for sparse reconstruction

Distributed Nonsmooth Convex Optimization over Markovian Switching Random Networks with Two Step-Sizes

A Novel Neural Network for Nonlinear Convex Programming

A high-dimensional optimization method combining projection correlation-based Kriging and multimodal parallel computing