Abstract:Artificial Neural Networks (ANNs) are the nonlinear and adaptive information processing systems which are combined by numerous processing units, with the characteristics of self-adapting, self-organizing and real- time learning, and play an important in pattern recognition, machine learning and data mining. But we've encountered many problems, such as the selection of the structure and the parameters of the networks, the selection of the learning samples, the selection of the initial values, the convergence of the learning algorithms and so on. Genetic algorithms (GA) is a kind of random search algorithm, on one hand, it simulates the nature selection and evolution, on the other, it has the advantages of good global search abilities and learning the approximate optimal solution without the gradient information of the error functions. In this paper, some optimization algorithms for ANNs with GA are studied. Firstly, an optimizing BP neural network is set up. It is using GA to optimize the connection weights of the neural network, and using GA to optimize both the connection weights and the architecture. Secondly, an optimizing RBF neural network is proposed. It used hybrid encoding method, that is, to encode the network by binary encoding and the weights by real encoding, the network architecture is self-adapted adjusted, the weights are learned, and the network is further adjusted by pseudo- inverse method or LMS method. Then they are used in real world classification tasks, and compared with the modified BP algorithm with adaptive learning rate. Experiments prove that the network got by this method has a better architecture and stronger classification ability, and the time of constructing the network artificially is saved. The algorithm is a self-adapted and intelligent learning algorithm.

Study on Learning Algorithm of a Kind of Multi-Neural Networks Hybrid Model

Multiplayer Recurrent Fuzzy Neural Network Modeling Based on Hybrid Chaotic Search Method

Hybrid optimization algorithm for load model parameter identification

Cuckoo Search Algorithm with Membrane Communication Mechanism for Modeling Overhead Crane Systems Using RBF Neural Networks.

Fuzzy Neural Network Based on Hybrid Learning Algorithm and Its Application to Soft Sensor

Application study of a kind of novel neural networks models

Evolving Neural Networks Using the Hybrid of Ant Colony Optimization and Bp Algorithms

Hybrid Neural Network Architecture for On-Line Learning

Hybrid Internal Model Control and Proportional Control of Chaotic Dynamical Systems.

An integrated state space partition and optimal control method of multi-model for nonlinear systems based on hybrid systems

A Hybrid Modeling Method Based on Mechanism Analysis,Identification and Rbf Neural Networks

Nonlinear adaptive control based on RBF networks and multi-model method

Study on Hybrid Modeling Method for Complex System Based on Neural Network

Hybrid Optimized Algorithm for Learning Bayesian Network Structure

Multiobjective Optimization of Neural Network.

Genetic Algorithms for MLP Neural Network parameters optimization

Research on safety simulation model and algorithm of dynamic system based on artificial neural network

Studies on Optimization Algorithms for Some Artificial Neural Networks Based on Genetic Algorithm (GA)

A Hybrid Algorithm Based on Attention Model

A New Method of Determining the Initial Weights of a Neural Network

Research on Neural Networks Learning Algorithm Based on Pso and Coa