Abstract:Artificial Neural Networks (ANNs) are the nonlinear and adaptive information processing systems which are combined by numerous processing units, with the characteristics of self-adapting, self-organizing and real- time learning, and play an important in pattern recognition, machine learning and data mining. But we've encountered many problems, such as the selection of the structure and the parameters of the networks, the selection of the learning samples, the selection of the initial values, the convergence of the learning algorithms and so on. Genetic algorithms (GA) is a kind of random search algorithm, on one hand, it simulates the nature selection and evolution, on the other, it has the advantages of good global search abilities and learning the approximate optimal solution without the gradient information of the error functions. In this paper, some optimization algorithms for ANNs with GA are studied. Firstly, an optimizing BP neural network is set up. It is using GA to optimize the connection weights of the neural network, and using GA to optimize both the connection weights and the architecture. Secondly, an optimizing RBF neural network is proposed. It used hybrid encoding method, that is, to encode the network by binary encoding and the weights by real encoding, the network architecture is self-adapted adjusted, the weights are learned, and the network is further adjusted by pseudo- inverse method or LMS method. Then they are used in real world classification tasks, and compared with the modified BP algorithm with adaptive learning rate. Experiments prove that the network got by this method has a better architecture and stronger classification ability, and the time of constructing the network artificially is saved. The algorithm is a self-adapted and intelligent learning algorithm.

An optimization method for neural network based on GA and TS algorithm

Parallel adaptive hybrid genetic optimization algorithm and its application

Studies on Optimization Algorithms for Some Artificial Neural Networks Based on Genetic Algorithm (GA)

Neural Network Classification with Optimization by Genetic Algorithms for Remote Sensing Imagery

Two-Times Training Algorithm of Neural Network Based on GA

Optimization by genetic algorithms for remote sensing imagery

Optimization of Backpropagation Neural Network under the Adaptive Genetic Algorithm

Application of Simulated Annealing Genetic Algorithm-Optimized Back Propagation (BP) Neural Network in Fault Diagnosis.

Using Genetic Algorithms to Optimize Artificial Neural Networks

An optimizing BP neural network algorithm based on genetic algorithm

A hybrid training algorithm based on gradient descent and evolutionary computation

Training Artificial Neural Networks Using a Global Optimization Method That Utilizes Neural Networks

A Neural Network Controller Based on Genetic Algorithms

Optimization Study of BP Neural Network Based on Genetic Algorithm

Heterogeneous Double Populations Based Hybrid Genetic Algorithm Design For Training Feedforward Neural Networks

Optimization of System with Non-Mechanism Model Based on NN-GA Approach

Genetic-tabu Hybrid Algorithm for Optimization of Unit Commitment

The Study on Neural Network Intelligent Method Based on Genetic Algorithm

Using an improved genetic algorithm to solve global optimization problem

An Optimized BP Neuron Network Algorithm Based on GASA Hybrid Learning Strategy