Using Genetic Algorithm to Optimize BP Neural Network

Ma Qiang,Ma Shaohua,Mao Zonglei

DOI: https://doi.org/10.3969/j.issn.1671-4792.2008.12.072

2008-01-01

Abstract:The article introduced Back propagation and Genetic algorithm,involved their merits and de- fects,then discussed how to optimize BP Neural Network by using genetic algorithm,and gave an example to explain.The results of emulation shows that this method has practical value.

What problem does this paper attempt to address?

Genetic Algorithm for Optimization of Neural Network Model of Pipe Network

陈磊,张土乔,吕谋,何小香

DOI: https://doi.org/10.3321/j.issn:1000-4602.2003.05.002

2003-01-01

Abstract:A macroscopic state model for water distribution n etwork in Hangzhou City based on BP neural network was established. In response to the slow conver g ence of traditional BP network and the difficulty in choosing neural network, ge netic algorithm was introduced to optimize the topological structure of the impr oved BP neural network, so that the result of model prediction became more satis factory.
Optimization Study of BP Neural Network Based on Genetic Algorithm

Zhuye Zhou,Yongheng Cai,Zehui Li

DOI: https://doi.org/10.1109/ICEACE60673.2023.10442575

2023-12-29

Abstract:In today's era of big data, neural networks play a pivotal role in fields such as image recognition and natural language processing. However, traditional Backpropagation (BP) neural networks often encounter challenges when dealing with complex problems, including slow convergence and getting stuck in local optima. To address these issues, this study employs a genetic algorithm as an optimization technique to optimize the weights and thresholds of BP neural networks. Training is conducted on a set of highly nonlinear mapping datasets to obtain the optimal weight and threshold configurations for the GA-BP model. Experimental results demonstrate that compared to traditional BP neural networks, the GA-BP model exhibits a 19.8% improvement in prediction accuracy, an approximately 9.20% increase in the coefficient of determination (R2), a reduction of approximately 62.50% in mean squared error (MSE), and a decrease of about 38.76% in root mean squared error (RMSE). Furthermore, the GA-BP model displays significantly accelerated convergence. The contribution of this research lies in proposing an optimization method that combines genetic algorithms with BP neural networks. This model not only enhances prediction accuracy compared to the standalone BP neural network but also significantly strengthens its generalization capabilities. As a result, it demonstrates substantial practical application potential across diverse datasets and application scenarios.

Computer Science
An optimizing BP neural network algorithm based on genetic algorithm

Shifei Ding,Chunyang Su,Junzhao Yu

DOI: https://doi.org/10.1007/s10462-011-9208-z

IF: 9.588

2011-02-18

Artificial Intelligence Review

Abstract:A back-propagation (BP) neural network has good self-learning, self-adapting and generalization ability, but it may easily get stuck in a local minimum, and has a poor rate of convergence. Therefore, a method to optimize a BP algorithm based on a genetic algorithm (GA) is proposed to speed the training of BP, and to overcome BP’s disadvantage of being easily stuck in a local minimum. The UCI data set is used here for experimental analysis and the experimental result shows that, compared with the BP algorithm and a method that only uses GA to learn the connection weights, our method that combines GA and BP to train the neural network works better; is less easily stuck in a local minimum; the trained network has a better generalization ability; and it has a good stabilization performance.

computer science, artificial intelligence
Evolving Neural Networks Using the Hybrid of Ant Colony Optimization and Bp Algorithms

Yan-Peng Liu,Ming-Guang Wu,Ji-Xin Qian

DOI: https://doi.org/10.1007/11759966_105

2006-01-01

Abstract:Ant colony optimization (ACO) algorithm has the powerful ability of searching the global optimal solution, and backpropagation (BP) algorithm has the feature of rapid convergence on the local optima. The proper hybrid of the two algorithms (ACO-BP) may accelerate the evolving speed of neural networks and improve the forecasting precision of the well-trained networks. ACO-BP scheme adopts ACO to search the optimal combination of weights in the solution space, and then uses BP algorithm to obtain the accurate optimal solution quickly. The ACO-BP and BP algorithms were applied to the problems of function approaching and modeling quantitative structure-activity relationships of Herbicides. Experiment results show that the proposed ACO-BP scheme is more efficient and effective than BP algorithm. Furthermore, ACO-BP reliably performs well when the number of hidden nodes varies.
Research and Application on BP Neural Network Algorithm

Yan Zhao

DOI: https://doi.org/10.2991/IIICEC-15.2015.321

2015-03-12

Abstract:In the artificial neural network, BP neural network is a multilayer feedforward neural network which is used widely. BP neural network uses a classic BP algorithm, and it is in accordance with the error back-propagation algorithm for learning and training. This paper first analyzes the basic idea of BP algorithm, and using BP neural network model and the flow chart to illustrate; then, introduces the disadvantage of BP algorithm, has slow convergence and easy to fall into local minimum point and other defects, and describes the current improvements methods, such as adding momentum item, introduce variable step method and other optimization methods, which effectively improve the convergence of BP algorithm, to avoid falling into local minimum point; finally, describes in detail the application of BP neural network in face recognition. Effective research on BP neural network, which can be further development and application of BP networks play an important role.

Computer Science
Genetic Algorithms and its use with back-propagation network

Ayman M. Bahaa-Eldin,A. M. A. Wahdan,H. M. K. Mahdi,A.M.A. Wahdan,H.M.K. Mahdi

DOI: https://doi.org/10.48550/arXiv.1401.5246

2014-01-21

Neural and Evolutionary Computing

Abstract:Genetic algorithms are considered as one of the most efficient search techniques. Although they do not offer an optimal solution, their ability to reach a suitable solution in considerably short time gives them their respectable role in many AI techniques. This work introduces genetic algorithms and describes their characteristics. Then a novel method using genetic algorithm in best training set generation and selection for a back-propagation network is proposed. This work also offers a new extension to the original genetic algorithms
Application of BP Neural Network Based on Genetic Algorithm Optimization in Evaluation of Power Grid Investment Risk

Qin Jiang,Ruanming Huang,Yichao Huang,Shujuan Chen,Yuqing He,Li Lan,Cong Liu

DOI: https://doi.org/10.1109/access.2019.2944609

IF: 3.9

2019-01-01

IEEE Access

Abstract:The artificial intelligence calculation method can effectively solve various nonlinear mapping relationships. The strength of these nonlinear solvers is exploited for the evaluation of power grid investment risk using back propagation (BP) neural network optimized by genetic algorithm. The mathematical model of the problem is constructed by selecting the transfer function of the neural network and defining the fitness function of genetic algorithm. BP neural network has good ability of self-learning, self-adaptation and generalization, which can overcome the drawbacks of traditional evaluation methods relying on experts' experience. For the characteristics of genetic algorithm global optimization, the genetic algorithm is used to optimize the weight and threshold of BP neural network, and BP neural network is trained to obtain the optimal evaluation model. The model fully exploits the local search ability of BP neural network and the global search ability of genetic algorithm. It has obtained good evaluation accuracy for the processing of multi-dimensional influence factor problem. And the model can be adapted to different power grids by changing the training data. However, the method cannot describe the specific relationship between each impact factor and the investment risk of the grid. The case study shows that the method can accurately and effectively evaluate power grid investment risk and improve the fault tolerance of the power grid investment risk evaluation.

computer science, information systems,telecommunications,engineering, electrical & electronic
Optimize Bp Neural Network Structure on Car Sales Forecasts Based on Genetic Algorithm

Tang Jun,Wu Qing

DOI: https://doi.org/10.2991/iiicec-15.2015.18

2015-01-01

Abstract:In order to improve the ability of BP neural network to fit complex functions, we improve the structure of the BP neural network and optimize the weights and thresholds of structure of the BP neural network based on genetic algorithm, then, training the BP neural network model to improve its capability, so, we can apply the model to the automobile sales forecasting system. We compare the prediction accuracy with the traditional BP neural algorithm, it shows that this method obviously fits the data better and has higher prediction accuracy to dates with significant linear correlation.
Genetic Algorithm Based on New Evaluation Function and Mutation Model for Training of BPNN

周祥,何小荣,陈丙珍

2012-01-01

Tsinghua Science & Technology

Abstract:A local minimum is frequently encountered in the training of back propagation neural networks (BPNN), which sharply slows the training process. In this paper, an analysis of the formation of local minima is presented, and an improved genetic algorithm (GA) is introduced to overcome local minima. The Sigmoid function is generally used as the activation function of BPNN nodes. It is the flat characteristic of the Sigmoid function that results in the formation of local minima. In the improved GA, pertinent modifications are made to the evaluation function and the mutation model. The evaluation of the solution is associated with both the training error and gradient. The sensitivity of the error function to network parameters is used to form a self adapting mutation model. An example of industrial application shows the advantage of the improved GA to overcome local minima. 
Parameter Optimization and State Evaluation of Basketball Teaching Based on BPNN

Zhanqi Wang

DOI: https://doi.org/10.1155/2022/4327356

2022-08-02

Mobile Information Systems

Abstract:BPNN is a multi-layer network with forward and backward error algorithms. It is currently the most widely used NN. Especially when it is applied to the basketball teaching scene, it can improve the research on the parameter optimization and state evaluation of the BP neural network in the teaching scene. This paper is mainly to study how to optimize the parameters of basketball teaching scene to improve the teaching effect and to evaluate the state. This paper improves the BPNN technology to study the basketball teaching scene and then proposes a genetic algorithm on the basis of the BPNN. It optimizes the parameters of basketball teaching scene through genetic algorithm and then analyzes the experimental data. The experimental results of this paper show that the BPNN is not as good as the BPNN based on the genetic algorithm in optimizing the parameters of the basketball teaching scene. The BPNN based on genetic algorithm has a successful recognition rate of more than 93% for basketball dribbling and shooting, which is 7-8% higher than that of the BPNN.

computer science, information systems,telecommunications
Short-term forecasting of traffic flow based on genetic algorithm and bp neural network

Junwei Gao,Ziwen Leng,Bin Zhang,Guoqiang Cai,

DOI: https://doi.org/10.1007/978-3-642-38524-7_82

2013-01-01

Abstract:This paper focuses on the short-term traffic flow forecasting which plays an important role in traffic control and guidance system. To improve the efficiency and precision of short-term forecasting, the method of BP neural network optimized by genetic algorithm (GA) is put forward. Considering the shortcomings of traditional BP neural network, genetic algorithm is used to optimize the weight and threshold of BP neural network by training sample, then the optimized network is tested by testing sample and the network conducts short-term forecasting for 30 min by means of the rolling forecasting. The validity and accuracy of GA-BP forecasting model is tested on the basis of traffic flow. The simulation results demonstrate that the proposed model has higher superiority in convergence rate and forecasting precision.
Brief Introduction of Back Propagation (BP) Neural Network Algorithm and Its Improvement

Jing Li,Ji-hang Cheng,Jing-yuan Shi,Fei Huang

DOI: https://doi.org/10.1007/978-3-642-30223-7_87

2012-01-01

Abstract:The back propagation (BP) neural network algorithm is a multi-layer feedforward network trained according to error back propagation algorithm and is one of the most widely applied neural network models. BP network can be used to learn and store a great deal of mapping relations of input-output model, and no need to disclose in advance the mathematical equation that describes these mapping relations. Its learning rule is to adopt the steepest descent method in which the back propagation is used to regulate the weight value and threshold value of the network to achieve the minimum error sum of square. This paper focuses on the analysis of the characteristics and mathematical theory of BP neural network and also points out the shortcomings of BP algorithm as well as several methods for improvement.
Optimizing the Laser-Cutting Parameters by Using Improved Artificial Neural Network

LIU Jun,GUO Qiu-dong,WANG Yin-hui

DOI: https://doi.org/10.3969/j.issn.0253-2743.2007.06.037

2007-01-01

Abstract:The parameters for laser-cutting play an significant role in determining the quality of cutting.This paper adopts the artificial neural network into optimizing the laser-cutting parameters.Nowadays,the most popular artificial neural network algorithm is BP(Back Propagation),and BP algorithm has some defects,such as converging slowly and immersing in local vibration frequently.In order to improve the BP,the EGA(Extended Genetic Algorithm) has been intro- duced into the BP algorithm and the new EGA-RPROP model is been tested by a mount of experimental samples.The experiments proved the new EGA- RPROP in finding the best set of parameters for laser-cutting has the better effects and it can overcome the drawbacks of right-cross way and the shortcoming of traditional BP neural networks such as slow speed and local traps.
A constrained optimization method based on BP neural network

Li Zhang,Fulin Wang,Ting Sun,Bing Xu

DOI: https://doi.org/10.1007/s00521-016-2455-9

2016-07-29

Neural Computing and Applications

Abstract:AbstractA constrained optimization method based on back-propagation (BP) neural network is proposed in this paper. Taking the maximization of output for example, using unipolar sigmoid function as transfer function, the method presents a general mathematical expression of BP neural network constrained optimization and derives the partial derivative of output with respect to input. On this basis, the fundamental idea, algorithms and related models are given in this article. When BP neural network is on the basis of fitting, this method can adjust the input values of BP neural network to make the output values maximal or minimal. Therefore, with this method the application of BP neural network is expanded by combining BP network’s fitting with optimization. At the same time, the article also provides a new method to study the black-box problem. The experiments show that the constrained optimization method is effective.

computer science, artificial intelligence
Application of BP neural network algorithm in visualization system of sports training management

Zhao, Yinghui

DOI: https://doi.org/10.1007/s00500-023-08116-w

IF: 3.732

2023-04-08

Soft Computing

Abstract:When constructing the algorithm model of sports training action classification, the accuracy of action classification has an important impact on the algorithm model. How to improve the algorithm model to improve the accuracy of sports training action classification needs further research. Based on BP neural network algorithm, this paper carries out the modeling of BP neural network signal classification algorithm and the construction of BP neural network, and deduces the BP algorithm in detail. Firstly, this paper applies genetic algorithm to the initial parameter selection of BP algorithm to avoid the local optimization problem. When carrying out chromosome coding, binary coding is easy to cause the problem of too long coding string, which also needs to be restored and decoded. The algorithm runs too long and the learning accuracy is not high. Therefore, this paper uses real coding. Through simulation analysis, it can be seen that the classification accuracy of the improved algorithm model is significantly higher than that of the simple BP algorithm. In addition, this paper analyzes the requirements of the sports training management visualization system, introduces the system structure framework and network topology, describes in detail the functions of the user information management module, the training plan management module, the training test management module, the competition information management module and the scientific research information management module, and tests the visualization function of the system. Finally, this paper analyzes the problems existing in the current sports training management, and puts forward the development strategy of sports training management based on this, which lays a theoretical foundation for the scientific development of sports training.

computer science, artificial intelligence, interdisciplinary applications
Coal Mine Safety Alert System: Refining BP Neural Network with Genetic Algorithm Optimization

Jiabin Luo,Hanzhe Pan

2024-11-21

Abstract:In response to the persistent safety challenges within coal mines, this study proposes a novel approach integrating a three-layer feedforward backpropagation artificial neural network with a genetic algorithm (GA-BP) for establishing a safety early warning system. Focused on a coal mine in Shandong, China, the model's effectiveness is evaluated using relevant data for training and analysis. Results indicate the superiority of the GA-BP model over traditional BP neural networks, offering enhanced capability for identifying potential safety risks promptly. This advancement enables coal mine management to implement timely interventions, ensuring the safety of miners. The findings present valuable insights for engineering applications in similar contexts.

Neural and Evolutionary Computing
A PSO-BP Model for Nonlinear Fitting of Phyllostachys edulis' Thermal Conductivity

Wu Shuci,Liu Shuai,Li Jianjun,Shen Xuejie,Wang Chuanli

2012-01-01

Abstract:By applying PSO(particle swarm optimization)algorithm to train BP(back propagation)neural network,this article puts forward a PSO-BP model of Phyllostachys edulis' thermal conductivity and regards the process of neural network learning as that of iterative optimization for particle swarm,with the purpose of optimizing neural network weights and thresholds.The research results show that the PSO-BP model of Phyllostachys edulis' thermal conductivity is superior to the standard BP network model in several aspects,such as generalization performance,fitting precision,training,error validation,etc.,which provides a new method for the application of intelligent information processing technology in bamboo material analyses.
Genetic Algorithm and BP Neural Network for College Physical Education Teaching Evaluation

Shuxin Wang

DOI: https://doi.org/10.1155/2021/9921960

2021-05-31

Scientific Programming

Abstract:Physical education is considered as the essential part of health plan and also reflects the higher education system. A teacher with physical education is accountable to teach physical education and/or health education to the students. This study has proposed a new approach for teaching evaluation with college physical education in universities. By combining neural network with genetic algorithm (GA), the approach that we proposed can improve the general traditional BP network, such as global convergence and training time. The model uses MATLAB software for empirical research work. According to MATLAB simulation and experiments, it was revealed that the combining neural network with GA algorithm has effective application prospects for the teaching evaluation with college physical education in universities.

computer science, software engineering
Genetic algorithm for neural network architecture optimization

M. Ettaouil,Y. Ghanou,H. Ramchoun,M. J. Idrissi

DOI: https://doi.org/10.1109/GOL.2016.7731699

2016-05-23

Abstract:The optimization of architecture of feed-forward neural networks is a complex task of high importance in supervised learning because it has a great impact on the convergence of learning methods. In this paper, we propose a multi-objective mathematical formulation in order to determine the optimal number of hidden layers, the number of neurons in each layer and good values of weights. We will solve our mathematical modeling using a hybridation of the famous genetic algorithm and the back-prop training algorithm. For evaluating our approach, we apply it to benchmark classification problems data-iris, seed, and wine. The obtained results demonstrated the effectiveness of the proposed approach.

Mathematics,Computer Science
Genetic algorithms and artificial neural network. (1) Training artificial neural network with extended genetic algorithms

Fangze Chen,Bingzhen Chen,XiaoRong He

1996-01-01

Abstract:IN order to overcome a local optimal solution which often occurs in the training process of artificial neural networks, a new algorithm called EGA is proposed. An adaptive multipoint mutation operator, which can effectively extinguish the swing problem in convergent process, is proposed in this algorithm. So the speed of BP training is improved. A reasonable mutation factor range is found. As a result, the speed and accuracy of training artificial neural networks are much improved.

Using Genetic Algorithm to Optimize BP Neural Network

Genetic Algorithm for Optimization of Neural Network Model of Pipe Network

Optimization Study of BP Neural Network Based on Genetic Algorithm

An optimizing BP neural network algorithm based on genetic algorithm

Evolving Neural Networks Using the Hybrid of Ant Colony Optimization and Bp Algorithms

Research and Application on BP Neural Network Algorithm

Genetic Algorithms and its use with back-propagation network

Application of BP Neural Network Based on Genetic Algorithm Optimization in Evaluation of Power Grid Investment Risk

Optimize Bp Neural Network Structure on Car Sales Forecasts Based on Genetic Algorithm

Genetic Algorithm Based on New Evaluation Function and Mutation Model for Training of BPNN

Parameter Optimization and State Evaluation of Basketball Teaching Based on BPNN

Short-term forecasting of traffic flow based on genetic algorithm and bp neural network

Brief Introduction of Back Propagation (BP) Neural Network Algorithm and Its Improvement

Optimizing the Laser-Cutting Parameters by Using Improved Artificial Neural Network

A constrained optimization method based on BP neural network

Application of BP neural network algorithm in visualization system of sports training management

Coal Mine Safety Alert System: Refining BP Neural Network with Genetic Algorithm Optimization

A PSO-BP Model for Nonlinear Fitting of Phyllostachys edulis' Thermal Conductivity

Genetic Algorithm and BP Neural Network for College Physical Education Teaching Evaluation

Genetic algorithm for neural network architecture optimization

Genetic algorithms and artificial neural network. (1) Training artificial neural network with extended genetic algorithms