Abstract:Neural network is one of the mainstream interests in artificial intelligence research. However, neurons in most artificial neural networks are in a fixed connection with each other at this stage, making it impossible to achieve self-learning ability. In this paper, we present our approach to build a self-growing and self-organizing neural network. We try to imitate the way in biological neural network, where neurons would form connections as a response to external stimulates, and evolve, thus to build a self-growing, self-organizing neural network. The neuron model in our work is built based on Leaky I&F model [1]. The inputs of our model are digital pulse signals. A counter was added into the neuron model, so that it could calculate the changing rate of outputs, called the output intensity of a neuron. Only when the output intensity of a neuron meets a certain condition, it can exchange information with other neurons. The distance of the forming connection is decided by the output intensity. While the target of connection is picked through calculation of a Probability Matrix C, the values in which are generated by training. Matrix C could learn from the input data, thus to optimize the generation of neural networks. We verify the generated neural network with different inputs. Those could generate different outputs with respect to different inputs would be treated as successful ones. Redundant connections is then deleted. We have exploited a CPU+GPU way to build the simulation environment. CPU is used to control, while GPU is used for all the computation of neurons. 2-bits input is first used to stimulate the network, and prompted it to grow. After verification and optimization, those generated seeds are used to build more complex ones. The result shows that, neural network built by our method can self-grow and selforganize as the complexity of the input external signals increase. Also our neural network can show some level of intelligence.

Exploration Of A Mechanism To Form Bionic, Self-Growing And Self-Organizing Neural Network

Exploration of a mechanism to form bionic, self-growing and self-organizing neural network

Exploration of bionic self-growing and self-organizing neuron network

Neural networks grown and self-organized by noise

Implementing Artificial Neural Networks Through Bionic Construction

Characterizing Self-Developing Biological Neural Networks: A First Step Towards their Application To Computing Systems

Towards Self-Assembling Artificial Neural Networks through Neural Developmental Programs

Self-organization of multi-layer spiking neural networks

Biologically Inspired Structure Learning with Reverse Knowledge Distillation for Spiking Neural Networks

Research on Algorithms of Neural Network Based on Self-Growing of Neuron

A New Hybrid Neural System Interfacing Neurons and Silicon Hardware for Fast Signal Recognition

Correlation Analysis-Based Neural Network Self-Organizing Genetic Evolutionary Algorithm

IC Neuron: an Efficient Unit to Construct Neural Networks

AGN: A Power-Adaptive and Growth-Capable Neuron Model and Circuit Implementation

A Modular Spiking Neural Network-Based Neuro-Robotic System for Exploring Embodied Intelligence*

Brain-inspired Evolutionary Architectures for Spiking Neural Networks

MODELING NEURAL PATHWAY USING NEURAL NETWORK

Growing Artificial Neural Networks for Control: the Role of Neuronal Diversity

Silicon Modeling of Spiking Neurons with Diverse Dynamic Behaviors

Hybrid Neural State Machine for Neural Network

Research and implementation of computer simulation system for neural networks