Abstract:In human-robot interactions, eye movements play an important role in non-verbal communication. However, controlling the motions of a robotic eye that display similar performance as the human oculomotor system is still a major challenge. In this paper, we study how to control a realistic model of the human eye with a cable-driven actuation system that mimics the six degrees of freedom of the extra-ocular muscles. The biomimetic design introduces novel challenges to address, most notably the need to control the pretension on each individual muscle to prevent the loss of tension during motion, that would lead to cable slack and lack of control. We built a robotic prototype and developed a nonlinear simulator and two controllers. In the first approach, we linearized the nonlinear model, using a local derivative technique, and designed linear-quadratic optimal controllers to optimize a cost function that accounts for accuracy, energy expenditure, and movement duration. The second method uses a recurrent neural network that learns the nonlinear system dynamics from sample trajectories of the system, and a non-linear trajectory optimization solver that minimizes a similar cost function. We focused on the generation of rapid saccadic eye movements with fully unconstrained kinematics, and the generation of control signals for the six cables that simultaneously satisfied several dynamic optimization criteria. The model faithfully mimics the three-dimensional rotational kinematics and dynamics observed for human saccades. Our experimental results indicate that while both methods yielded similar results, the nonlinear method is more flexible for future improvements to the model, for which the calculations of the linearized model's position-dependent pretensions and local derivatives become particularly tedious.

3D Muscle-Controlled Eye Model

Anatomy-Based Modeling, Muscle-Based Animating and Math-Based Representing of Human Eyes

Design Of A 2pam-1m Driven Robot Eye

Design and Kinematic Analysis of a Novel Humanoid Robot Eye Using Pneumatic Artificial Muscles

3D muscle-controlled tongue and mouth model

Physically-based modeling and simulation of extraocular muscles

Simulation Method of Eye Movements and Expressions

Establishment of Three-dimensional Finite Element Model of Human Eye Based on Anatomical Data

An ocular biomechanic model for dynamic simulation of different eye movements

Virtual eye muscle surgery based upon biomechanical models

Quick Customization of Particular Human Face and Muscle-Driven Expression Animation

Collision and containment detection between biomechanically based eye muscle volumes

ShellNeRF: Learning a Controllable High‐resolution Model of the Eye and Periocular Region

Design and Evaluation of a Bioinspired Tendon-Driven 3D-Printed Robotic Eye with Active Vision Capabilities

Realistic 3D human saccades generated by a 6-DOF biomimetic robotic eye under optimal control

Emergence of human oculomotor behavior from optimal control of a cable-driven biomimetic robotic eye

Finite Element Modeling and Biomechanical Analysis of Eyeball and Extraocular Muscles

MuscleVAE: Model-Based Controllers of Muscle-Actuated Characters

A Novel Three-Dimensional Electric Ophthalmotrope for Improving the Teaching of Ocular Movements

Overview of Motion Control on Bionic Eyes

3D Motion Simulation of a Humanoid Robot Face