Abstract:Neural network is one of the mainstream interests in artificial intelligence research. However, neurons in most artificial neural networks are in a fixed connection with each other at this stage, making it impossible to achieve self-learning ability. In this paper, we present our approach to build a self-growing and self-organizing neural network. We try to imitate the way in biological neural network, where neurons would form connections as a response to external stimulates, and evolve, thus to build a self-growing, self-organizing neural network. The neuron model in our work is built based on Leaky I&F model [1]. The inputs of our model are digital pulse signals. A counter was added into the neuron model, so that it could calculate the changing rate of outputs, called the output intensity of a neuron. Only when the output intensity of a neuron meets a certain condition, it can exchange information with other neurons. The distance of the forming connection is decided by the output intensity. While the target of connection is picked through calculation of a Probability Matrix C, the values in which are generated by training. Matrix C could learn from the input data, thus to optimize the generation of neural networks. We verify the generated neural network with different inputs. Those could generate different outputs with respect to different inputs would be treated as successful ones. Redundant connections is then deleted. We have exploited a CPU+GPU way to build the simulation environment. CPU is used to control, while GPU is used for all the computation of neurons. 2-bits input is first used to stimulate the network, and prompted it to grow. After verification and optimization, those generated seeds are used to build more complex ones. The result shows that, neural network built by our method can self-grow and selforganize as the complexity of the input external signals increase. Also our neural network can show some level of intelligence.

AGN: A Power-Adaptive and Growth-Capable Neuron Model and Circuit Implementation

A Power-Adaptive Neuron Model and Circuit Implementation

Adaptive Biomimetic Neuronal Circuit System Based on Myelin Sheath Function

Activity-dependent Neuron Model for Noise Resistance

Power-efficient neural network with artificial dendrites

Design of Artificial Neurons of Memristive Neuromorphic Networks Based on Biological Neural Dynamics and Structures

55 Nm CMOS Mixed-Signal Neuromorphic Circuits for Constructing Energy-Efficient Reconfigurable SNNs

Highly Compact Artificial Memristive Neuron with Low Energy Consumption.

Ultra-Low Power Silicon Neuron Circuit for Extreme-Edge Neuromorphic Intelligence

Adaptive cognition implemented with a context-aware and flexible neuron for next-generation artificial intelligence

An Adiabatic Capacitive Artificial Neuron with RRAM-based Threshold Detection for Energy-Efficient Neuromorphic Computing

Exploiting Inherent Error-Resiliency of Neuromorphic Computing to achieve Extreme Energy-Efficiency through Mixed-Signal Neurons

Design and Performance Analysis of an Ultra-Low Power Integrate-and-Fire Neuron Circuit Using Nanoscale Side-contacted Field Effect Diode Technology

Progress and Benchmark of Spiking Neuron Devices and Circuits

Sparsity-Aware In-Memory Neuromorphic Computing Unit With Configurable Topology of Hybrid Spiking and Artificial Neural Network

Artificial Neuronal Devices Based on Emerging Materials: Neuronal Dynamics and Applications

Exploration Of A Mechanism To Form Bionic, Self-Growing And Self-Organizing Neural Network

The Artificial Neuron: Built From Nanosheet Transistors to Achieve Ultra Low Power Consumption

Modeling Neuromorphic Persistent Firing Networks

CMOS-based area-and-power-efficient neuron and synapse circuits for time-domain analog spiking neural networks

Engineering Spiking Neurons Using Threshold Switching Devices for High-Efficient Neuromorphic Computing