TheMultilayer In-Place Learning NetworkfortheDevelopment of GeneralInvariances Andmulti-Task Learning

Xiangyang Xue
2007-01-01
Abstract:thereisa lackofgeneral-purpose inplacelearning engines thatincrementally learnmultiple tasks, todevelop soft multi-task-shared invariances intheintermediate internal representation whilea developmental robot interacts withitsenvironment. Computationally, biologically inspired in-place learning provides unusually efficient learning algorithms whosesimplicity, lowcomputational complexity, and generality aresetapartfromtypical conventional learning algorithms. We present inthis papertheMultiple-layer In-place Learning Network(MILN)forthisambitious goal. Asa key requirement forautonomous mentaldevelopment, thenetwork enables bothunsupervised andsupervised learning tooccur concurrently, depending onwhether motorsupervision signals areavailable ornotatthemotorend(the last layer) during the agent's interactions withtheenvironment. We present principles basedonwhichMILNautomatically develops invariant neurons indifferent layers andwhysuchinvariant neuronal clusters are important forlearning later tasks inopen-ended development. I.INTRODUCTION Examples ofpopular artificial networks include FeedForward, Networks (FFN)withback-propagation learning, RadialBasisFunctions (RBF), Self-Organization Maps
What problem does this paper attempt to address?