Abstract:In human-robot interactions, eye movements play an important role in non-verbal communication. However, controlling the motions of a robotic eye that display similar performance as the human oculomotor system is still a major challenge. In this paper, we study how to control a realistic model of the human eye with a cable-driven actuation system that mimics the six degrees of freedom of the extra-ocular muscles. The biomimetic design introduces novel challenges to address, most notably the need to control the pretension on each individual muscle to prevent the loss of tension during motion, that would lead to cable slack and lack of control. We built a robotic prototype and developed a nonlinear simulator and two controllers. In the first approach, we linearized the nonlinear model, using a local derivative technique, and designed linear-quadratic optimal controllers to optimize a cost function that accounts for accuracy, energy expenditure, and movement duration. The second method uses a recurrent neural network that learns the nonlinear system dynamics from sample trajectories of the system, and a non-linear trajectory optimization solver that minimizes a similar cost function. We focused on the generation of rapid saccadic eye movements with fully unconstrained kinematics, and the generation of control signals for the six cables that simultaneously satisfied several dynamic optimization criteria. The model faithfully mimics the three-dimensional rotational kinematics and dynamics observed for human saccades. Our experimental results indicate that while both methods yielded similar results, the nonlinear method is more flexible for future improvements to the model, for which the calculations of the linearized model's position-dependent pretensions and local derivatives become particularly tedious.

Realistic 3D human saccades generated by a 6-DOF biomimetic robotic eye under optimal control

Design and Kinematic Analysis of a Novel Humanoid Robot Eye Using Pneumatic Artificial Muscles

Emergence of human oculomotor behavior from optimal control of a cable-driven biomimetic robotic eye

Emergence of human oculomotor behavior in a cable-driven biomimetic robotic eye using optimal control

Design Of A 2pam-1m Driven Robot Eye

Two degree-of-freedom robotic eye: design, modeling, and learning-based control in foveation and smooth pursuit

An ocular biomechanic model for dynamic simulation of different eye movements

Motion Control in Saccade and Smooth Pursuit for Bionic Eye Based on Three-dimensional Coordinates

Physically-based modeling and simulation of extraocular muscles

Design, Implementation, and Observer-based Output Control of a Super-coiled Polymer-Driven Two Degree-of-Freedom Robotic Eye

Multimodal Gaze Stabilization of a Humanoid Robot based on Reafferences

Dual STDP processes at Purkinje cells contribute to distinct improvements in accuracy and speed of saccadic eye movements

Estimation of Neural Inputs and Detection of Saccades and Smooth Pursuit Eye Movements by Sparse Bayesian Learning

A Stochastic Optimal Control Model with Internal Feedback and Velocity Tracking for Saccades

A Biologically Realistic Model of Saccadic Eye Control with Probabilistic Population Codes

A new oculomotor model demystifies "Remarkable Saccades"

Overview of Motion Control on Bionic Eyes

Design and Evaluation of a Bioinspired Tendon-Driven 3D-Printed Robotic Eye with Active Vision Capabilities

An Open-Source OpenSim Oculomotor Model for Kinematics and Dynamics Simulation

Simulating human saccadic scanpaths on natural images

An Eye Movement Simulator Based on 3-DOF Parallel Mechanism with Flexure Joint