Abstract:Developing cognition is difficult to achieve yet crucial for robots. Infants can gradually improve their cognition through parental guidance and self-exploration. However, conventional learning methods for robots often focus on a single modality and train a pre-defined model by large datasets in an offline way. In this paper, we propose a hierarchical autonomous cognitive architecture for robots to learn object concepts online by interacting with humans. Two pathways for audio-visual information are devised. Each pathway has three layers based on the self-organizing incremental neural networks. Visual features and names of objects are incrementally learned and self-organized in an unsupervised way in sample layers, respectively, in which we propose a dynamically adjustable similarity threshold strategy to allow the network itself to control cluster rather than using a pre-defined threshold. Two symbol layers abstract the cluster results from the corresponding sample layer to form concise symbols and transmit them to an associative layer. An associative relationship between two modalities can be built in real time by binding activated visual and auditory symbols simultaneously in the associative layer. In this layer, a top-down response strategy is proposed to let robots autonomously recall another associative modality, solve conflicting associative relationships, and adjust learned knowledge from the top down. The experimental results on two objects datasets and a real task show that our architecture is efficient to learn and associate object view and name in an online way. What is more, the robot can autonomously improve its cognitive level by utilizing its own experience without enquiring with humans.

An Incremental Time-delay Neural Network for Dynamical Recurrent Associative Memory

A Novel Neural Network for Associative Memory Via Dynamical Systems

An associative memory system for incremental learning and temporal sequence

A Spiking Neural Network Model For Associative Memory Using Temporal Codes

An Autonomous Developmental Cognitive Architecture Based on Incremental Associative Neural Network with Dynamic Audiovisual Fusion

Vision-Action Semantic Associative Learning Based on Spiking Neural Networks for Cognitive Robot.

A Spiking Neural Network With Dynamic Memory For A Real Autonomous Mobile Robot In Dynamic Environment

Neuroevolution of a Recurrent Neural Network for Spatial and Working Memory in a Simulated Robotic Environment

Learning a World Model With Multitimescale Memory Augmentation

Improved Dynamical Model For Neural Network And The Stabilization Of Associative Memory

Dynamic modelling and time-series prediction by incremental growth of lateral delay neural networks

Triple-Memory Networks: A Brain-Inspired Method for Continual Learning

Temporal Coding in Recurrent Spiking Neural Networks with Synaptic Delay-Weight Plasticity

Harnessing Neural Unit Dynamics for Effective and Scalable Class-Incremental Learning

A Self-Organizing Developmental Cognitive Architecture with Interactive Reinforcement Learning.

A Hierarchical Autonomous Robot Controller for Learning and Memory: Adaptation in a Dynamic Environment.

Incremental Self-Organization of Spatio-Temporal Spike Pattern Detection

Incremental Concept Learning via Online Generative Memory Recall

Memory-Augmented Temporal Dynamic Learning for Action Recognition

Memory Recall: A Simple Neural Network Training Framework Against Catastrophic Forgetting

Incremental Learning of Structured Memory via Closed-Loop Transcription