A REINFORCEMENT LEARNING MODEL TO SIMULATE INSECT'S CHOICE BEHAVIOR FACING VISUAL CUES

马奇,张立明
DOI: https://doi.org/10.3321/j.issn:1000-6737.2008.03.007
2008-01-01
ACTA BIOPHYSICA SINICA
Abstract:Choice behavior based on visual cues is a very complicated information process of brain.Biological experiments showed that learning of insects or animals in the environment is controlled by value system which affects their choice behavior.This study is significant to reveal the mechanism of human brain.A neural network model was proposed to simulate the choice behavior of insects facing visual cues based on biological facts of Guo’s group.The proposed model introduces value system and a reinforcement learning algorithm based on the value system.It can learn input visual images under the reward or punishment and establish a value system,which simulates choice behavior based on dopamine and mushroom body circuit in the brain of insects.The simulation results show that the proposed model can simulate the development of value system and choice behavior of drosophila.The simulating curves accord with biological experiments.This model provides a basis for the further application on robot auto-control system facing visual cues.
What problem does this paper attempt to address?