Abstract:In recent years, the interdisciplinary research between information science and neuroscience has been a hotspot. In this paper, based on recent biological findings, we proposed a new model to mimic visual information processing, motor planning and control in central and peripheral nervous systems of human. Main steps of the model are as follows: 1) Simulating "where" pathway in human: the Selective Search method is applied to simulate the function of human dorsal visual pathway to localize object candidates; 2) Simulating "what" pathway in human: a Convolutional Deep Belief Network is applied to simulate the hierarchical structure and function of human ventral visual pathway for object recognition; 3) Simulating motor planning process in human: habitual motion planning process in human is simulated, and motor commands are generated from the combination of control signals from past experiences; 4) Simulating precise movement control in human: calibrated control signals, which mimic the adjustment for movement from cerebellum in human, are generated and updated from calibration of movement errors in past experiences, and sent to the movement model to achieve high precision. The proposed framework mimics structures and functions of human recognition, visuomotor coordination and precise motor control. Experiments on object localization, recognition and movement control demonstrate that the new proposed model can not only accomplish visuomotor coordination tasks, but also achieve high precision movement with learning ability. Meanwhile, the results also prove the validity of the introduced mechanisms. Furthermore, the proposed model could be generalized and applied to other systems, such as mechanical and electrical systems in robotics, to achieve fast response, high precision movement with learning ability.

A Visual Perceiving and Eyeball-Motion Controlling Neural Network for Object Searching and Locating

GVGNet: Gaze-Directed Visual Grounding for Learning Under-Specified Object Referring Intention

PerimetryNet: A Multiscale Fine Grained Deep Network for Three-Dimensional Eye Gaze Estimation Using Visual Field Analysis

Searching Eye Centers Using a Context-Based Neural Network

Energy-Efficient Visual Search by Eye Movement and Low-Latency Spiking Neural Network

A Navigation Cognitive System Driven by Hierarchical Spiking Neural Network.

A Neuro-Cognitive System and Its Application in Robotics

A neural network based on biological vision learning and its application on robot

VBNet: A Visually-Aware Biomimetic Network for Simulating the Human Eye's Visual System

Spatial Relationship Representation for Visual Object Searching

Biologically inspired model simulating visual pathways and cerebellum function in human - Achieving visuomotor coordination and high precision movement with learning ability

Vision Enhanced Neuro-Cognitive Structure for Robotic Spatial Cognition

Object detection and tracking algorithms using brain-inspired model and deep neural networks

Neuro-Eye: Decoding of High-Temporal Resolution Eye Movements via Functional Magnetic Resonance Imaging

A brain-inspired object-based attention network for multiobject recognition and visual reasoning

Robot Target Localization and Visual Navigation Based on Neural Network

Top–Down Gaze Movement Control in Target Search Using Population Cell Coding of Visual Context

Modelling Human Visual Motion Processing with Trainable Motion Energy Sensing and a Self-attention Network

Complex environment perception and positioning based visual information retrieval

Unidirectional brain-computer interface: Artificial neural network encoding natural images to fMRI response in the visual cortex

Artificial Visual Network with Fully Modeled Retinal Direction-Selective Neural Pathway for Motion Direction Detection in Grayscale Scenes