Cortex Inspired In-Place Learning Networks For General Invariance And Multi-Tasks

Juyang Weng,Tianyu Luwang,Hong Lu,Xiangyang Xue

2009-01-01

Abstract:There is a lack. of general-purpose in-place learning networks that model feature layers in the cortex Currently. It means that a general yet adaptive high-dimensional function approximator is lacked. Here, in-place learning is a biological concept rooted in the genomic equivalence principle. In another word, in-place learning means that each neuron is fully responsible for its own learning in its environment and there is no need for an external learner. In this chapter, we present the multilayer In-place Learning Network (MILN) for this ambitious goal. Computationally, in-place learning provides unusually efficient learning algorithms whose simplicity, low computational complexity, and generality are set apart from typical conventional learning algorithms. Based on the neuroscience literature, and in the 6-layer laminar cortex, we model the layer 4 and layer 2/3 as the feature layers, where layer 4 uses unsupervised learning and layer 2/3 uses supervised learning. As a requirement for autonomous mental development, MILN generates invariant neurons in different layers, with increasing invariance from earlier to later layers and the total invariance in the last motor layer. Such self-generated invariant representation is enabled mainly by descending (top-down) connections. The self-generated invariant representation is used as intermediate representation for learning later tasks in open-ended development. Also, this in-place learning engine can incrementally learn multiple tasks. It Is important for tasks of robotics Such as auto-navigation task and object recognition task through complex motor and sensory interactions. Experimental results demonstrate the effectiveness and efficacy of the proposed modal.