Abstract:In recent years, the interdisciplinary research between information science and neuroscience has been a hotspot. In this paper, based on recent biological findings, we proposed a new model to mimic visual information processing, motor planning and control in central and peripheral nervous systems of human. Main steps of the model are as follows: 1) Simulating "where" pathway in human: the Selective Search method is applied to simulate the function of human dorsal visual pathway to localize object candidates; 2) Simulating "what" pathway in human: a Convolutional Deep Belief Network is applied to simulate the hierarchical structure and function of human ventral visual pathway for object recognition; 3) Simulating motor planning process in human: habitual motion planning process in human is simulated, and motor commands are generated from the combination of control signals from past experiences; 4) Simulating precise movement control in human: calibrated control signals, which mimic the adjustment for movement from cerebellum in human, are generated and updated from calibration of movement errors in past experiences, and sent to the movement model to achieve high precision. The proposed framework mimics structures and functions of human recognition, visuomotor coordination and precise motor control. Experiments on object localization, recognition and movement control demonstrate that the new proposed model can not only accomplish visuomotor coordination tasks, but also achieve high precision movement with learning ability. Meanwhile, the results also prove the validity of the introduced mechanisms. Furthermore, the proposed model could be generalized and applied to other systems, such as mechanical and electrical systems in robotics, to achieve fast response, high precision movement with learning ability.

The planning and control of reaching movements

Future movement plans interact in sequential arm movements

On the nature of motor planning variables during arm pointing movement: Compositeness and speed dependence

Sequential Effects in Reaching Reveal Efficient Coding in Motor Planning

Motor, not visual, encoding of potential reach targets

Internal models in sensorimotor integration: perspectives from adaptive control theory

Signatures of internal feedback and trajectory control during goal-directed finger and whole-arm reaching movements

The role of inertial sensitivity in motor planning

Understanding upper-limb movements via neurocomputational models of the sensorimotor system and neurorobotics: where we stand

Visuomotor prediction during action planning in the human frontoparietal cortex and cerebellum

Neural Encoding of Direction and Distance across Reference Frames in Visually Guided Reaching

Planning and movement activities co-adapt in a motor-reference frame during 3D BCI-controlled reach adaptation in monkey frontal and parietal cortices

Reach Corrections Toward Moving Objects are Faster Than Reach Corrections Toward Instantaneously Switching Targets

Modelling the learning of biomechanics and visual planning for decision-making of motor actions

Hierarchical Control of Visually-Guided Movements in a 3D-Printed Robot Arm

Developing Robot Reaching Skill Via Look-ahead Planning

Biologically inspired model simulating visual pathways and cerebellum function in human - Achieving visuomotor coordination and high precision movement with learning ability

Modeling Basal Ganglia for Understanding Parkinsonian Reaching Movements

Bayesian Integration And Non-Linear Feedback Control In A Full-Body Motor Task