Abstract:When the magnitude of a gaze is too large, human beings change the orientation of their head or body to assist their eyes in tracking targets because saccade alone is insufficient to keep a target at the center region of the retina. To make a robot gaze at targets rapidly and stably (as a human does), it is necessary to design a body–head–eye coordinated motion control strategy. A robot system equipped with eyes and a head is designed in this paper. Gaze point tracking problems are divided into two sub-problems: in situ gaze point tracking and approaching gaze point tracking. In the in situ gaze tracking state, the desired positions of the eye, head and body are calculated on the basis of minimizing resource consumption and maximizing stability. In the approaching gaze point tracking state, the robot is expected to approach the object at a zero angle. In the process of tracking, the three-dimensional (3D) coordinates of the object are obtained by the bionic eye and then converted to the head coordinate system and the mobile robot coordinate system. The desired positions of the head, eyes and body are obtained according to the object's 3D coordinates. Then, using sophisticated motor control methods, the head, eyes and body are controlled to the desired position. This method avoids the complex process of adjusting control parameters and does not require the design of complex control algorithms. Based on this strategy, in situ gaze point tracking and approaching gaze point tracking experiments are performed by the robot. The experimental results show that body–head–eye coordination gaze point tracking based on the 3D coordinates of an object is feasible. This paper provides a new method that differs from the traditional two-dimensional image-based method for robotic body–head–eye gaze point tracking.

A Method for Moving Target Capture Using 3D Profile Information Based on Bionic Compound Eye

A Novel System for Moving Object Detection Using Bionic Compound Eyes

Moving Object Detection Based on Bionic Compound Eye

A Maneuvering Target Tracking Scheme for Mobile Robot

Accurate and Real-Time 3-D Tracking for the Following Robots by Fusing Vision and Ultrasonar Information

A New Method for Moving Object Detection Using Variable Resolution Bionic Compound Eyes

Imaging Mechanism Of Moving Object Detection With Bionic Compound Eye

A Synchronous Imaging System for Moving-Target Detection with Bionic Compound Eyes

Aviation video moving-target detection with inter-frame difference

A Ball-Shaped Target Development and Pose Estimation Strategy for a Tracking-Based Scanning System

Motion Control in Saccade and Smooth Pursuit for Bionic Eye Based on Three-dimensional Coordinates

Gaze Point Tracking Based on a Robotic Body–Head–Eye Coordination Method

Non-cooperative Spacecraft Pose Tracking Based on Point Cloud Feature

Exploring Multi-Target Tracking Method Using Spatially Multiplexed Superposition Imaging Technique

An Improved Real-Time Visual Tracking Method for Space Non-Cooperative Target

Cognitively Inspired 6D Motion Estimation of a Noncooperative Target Using Monocular RGB-D Images

Moving object detection algorithm and motion capture based on 3D LiDAR

Research on Moving Target Capture and Trajectory Reconstruction of Orthogonal Double Vision System

Development of neural‐network‐based stereo bionic compound eyes with fiber bundles

Mobile Grabbing Robot with Target Detection Using Quadric Fitting

A Systematic Solution for Moving-Target Detection and Tracking While Only Using a Monocular Camera