Abstract:Neurally inspired robotics already has a long history that includes reactive systems emulating reflexes, neural oscillators to generate movement patterns, and neural networks as trainable filters for high-dimensional sensory information. Neural inspiration has been less successful at the level of cognition. Decision-making, planning, building and using memories, for instance, are more often addressed in terms of computational algorithms than through neural process models. To move neural process models beyond reactive behavior toward cognition, the capacity to autonomously generate sequences of processing steps is critical. We review a potential solution to this problem that is based on strongly recurrent neural networks described as neural dynamic systems. Their stable states perform elementary motor or cognitive functions while coupled to sensory inputs. The state of the neural dynamics transitions to a new motor or cognitive function when a previously stable neural state becomes unstable. Only when a neural robotic system is capable of acting autonomously does it become a useful to a human user. We demonstrate how a neural dynamic architecture that supports autonomous sequence generation can engage in such interaction. A human user presents colored objects to the robot in a particular order, thus defining a serial order of color concepts. The user then exposes the system to a visual scene that contains the colored objects in a new spatial arrangement. The robot autonomously builds a scene representation by sequentially bringing objects into the attentional foreground. Scene memory updates if the scene changes. The robot performs visual search and then reaches for the objects in the instructed serial order. In doing so, the robot generalizes across time and space, is capable of waiting when an element is missing, and updates its action plans online when the scene changes. The entire flow of behavior emerges from a time-continuous neural dynamics without any controlling or supervisory algorithm.

A cortex-inspired episodic memory toward interactive 3D robotic vision.

Semantic Spatiotemporal Memory Toward 3D Robotic Vision

Cognitive Navigation by Neuro-Inspired Localization, Mapping, and Episodic Memory

Vision Enhanced Neuro-Cognitive Structure for Robotic Spatial Cognition

A Neuro-Cognitive System and Its Application in Robotics

Visual Episodic Memory-based Exploration

Vision-Action Semantic Associative Learning Based on Spiking Neural Networks for Cognitive Robot.

Intrinsic Motivation and Episodic Memories for Robot Exploration of High-Dimensional Sensory Spaces

Robotic Episodic Cognitive Learning Inspired by Hippocampal Spatial Cells

Vision-Motor Abstraction toward Robot Cognition

Cognitive Memory and Mapping in a Brain-Like System for Robotic Navigation

A Tree-Type Memory Formation by Sensorimotor Feedback: A Possible Approach to the Development of Robotic Cognition

Multi-Scale Extension in an Entorhinal-Hippocampal Model for Cognitive Map Building.

A neuro-cognitive robot for spatial navigation

A Neurobiologically Inspired Mapping and Navigating Framework for Mobile Robots

Vision-sensorimotor Abstraction and Imagination Towards Exploring Robot’s Inner World

Robotic Episodes Learning for Building Cognitive Experience Map

An Autonomous Developmental Cognitive Architecture Based on Incremental Associative Neural Network with Dynamic Audiovisual Fusion

Enhancing Robotic Perception through Synchronized Simulation and Physical Common-Sense Reasoning

Autonomous Sequence Generation for a Neural Dynamic Robot: Scene Perception, Serial Order, and Object-Oriented Movement

An Improved Bioinspired Cognitive Map-Building System Based on Episodic Memory Recognition