Abstract:Biological systems differ from the inanimate world in their behaviors ranging from simple movements to coordinated purposeful actions by large groups of muscles, to perception of the world based on signals of different modalities, to cognitive acts, and to the role of self-imposed constraints such as laws of ethics. Respectively, depending on the behavior of interest, studies of biological objects based on laws of nature (physics) have to deal with different salient sets of variables and parameters. Understanding is a high-level concept, and its analysis has been linked to other high-level concepts such as “mental model” and “meaning”. Attempts to analyze understanding based on laws of nature are an example of the top-down approach. Studies of the neural control of movements represent an opposite, bottom-up approach, which starts at the interface with classical physics of the inanimate world and operates with traditional concepts such as forces, coordinates, etc. There are common features shared by the two approaches. In particular, both assume organizations of large groups of elements into task-specific groups, which can be described with only a handful of salient variables. Both assume optimality criteria that allow the emergence of families of solutions to typical tasks. Both assume predictive processes reflected in anticipatory adjustments to actions (motor and non-motor). Both recognize the importance of generating dynamically stable solutions. The recent progress in studies of the neural control of movements has led to a theory of hierarchical control with spatial referent coordinates for the effectors. This theory, in combination with the uncontrolled manifold hypothesis, allows quantifying the stability of actions with respect to salient variables. This approach has been used in the analysis of motor learning, changes in movements with typical and atypical development and with aging, and impaired actions by patients with various neurological disorders. It has been developed to address issues of kinesthetic perception. There seems to be hope that the two counter-directional approaches will meet and result in a single theoretical scheme encompassing biological phenomena from figuring out the best next move in a chess position to activating motor units appropriate for implementing that move on the chessboard.

Hierarchical motor control in mammals and machines

Hierarchical visuomotor control of humanoids

Brain-inspired biomimetic robot control: a review

Hierarchical learning control for autonomous robots inspired by central nervous system

A Revised Computational Neuroanatomy for Motor Control

Neural probabilistic motor primitives for humanoid control

Hierarchical generative modelling for autonomous robots

Neural dynamics hierarchy in motor cortex and striatum across naturalistic behaviors

Hierarchical behavior control by a single class of interneurons

Hierarchical control of goal-directed action in the cortical–basal ganglia network

The Hierarchical Circuit for Executive Control of Movement

Brain-like neural dynamics for behavioral control develop through reinforcement learning

A Neuro-Cognitive System and Its Application in Robotics

Left/Right Brain, human motor control and the implications for robotics

Learning-based Hierarchical Control: Emulating the Central Nervous System for Bio-Inspired Legged Robot Locomotion

Exploring the effects of robotic design on learning and neural control

From Data-Fitting to Discovery: Interpreting the Neural Dynamics of Motor Control through Reinforcement Learning

The neuromechanics of animal locomotion: From biology to robotics and back

Hierarchical Control of Visually-Guided Movements in a 3D-Printed Robot Arm

Hierarchical Reinforcement Learning, Sequential Behavior, and the Dorsal Frontostriatal System

Understanding and Synergy: A Single Concept at Different Levels of Analysis?