Abstract:In the modes of both object motion and camera motion, an enhanced Camshift algorithm, which is based on suppressing similar color features of background and on joint color probability density distribution image, is proposed to real-time track head in dynamic complex environment. The system consists of face detection module, head tracking module and camera control module. When tracking fails, a self-recovery mechanism is introduced. At first the Adaboost face detector based on Haar-like features is implemented to find frontal faces, the false positive is filtered according to the skin color criterion, and the true face is used to initialize the tracking module. In hue saturation value (HSV) colorspace, the hue-saturation (H-S) histogram of face skin and the saturation-value (S-V) histogram of hair are built to produce the joint color probability density distribution image, and this is intended to realize the head tracking with arbitrary pose. During tracking, region of interest (ROI) is introduced, and the color probability density distribution of a specified background area outside the ROI is learned, similar color features in the head are suppressed according to the learning result. The background suppression step is intended to resolve the problem that the tracker maybe fails when the head is distracted by backgrounds having similar colors with the head. A closed loop control model based on speed regulation is applied to drive an active camera to center the head. Once tracking drift or failure is detected, the system stops tracking and returns to the face detection module. Our experimental results show that the presented system is well suitable for tracking head with arbitrary pose in dynamic complex environments, also the active camera can track moving head smoothly and stably. The system is computationally efficient and can run in real-time completely.

Design and Dynamic Simulation of a Wide-Range Binocular Head-Eye Platform

Human-Computer Interaction System Based on Binocular Stereo Vision

Real-time Follow-Up Head Tracking in Dynamic Complex Environments

Dynamically Tunable Hemispherical Electronic Eye Camera System with Adjustable Zoom Capability

Design and Kinematic Analysis of a Novel Humanoid Robot Eye Using Pneumatic Artificial Muscles

Mechanics of Tunable Hemispherical Electronic Eye Camera Systems That Combine Rigid Device Elements with Soft Elastomers

Precise and Robust Binocular Camera Calibration Based on Multiple Constraints

Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision

Design of intelligent 3D collaborative manufacturing platform for non-holonomic mobile industrial robots based on improved binocular vision

A Hybrid Calibration Method for the Binocular Omnidirectional Vision System

P‐2.32: Six‐degree‐of‐freedom Platform Motion Anomaly Prediction Technology Based on Binocular Vision

Humanoid monocular stereo measuring system with two degrees of freedom using bionic optical imaging system

Optimal design of a parallel bionic eye mechanism

High-Precision Measurement of Binocular Telecentric Vision System With Novel Calibration and Matching Methods

Binocular stereovision omnidirectional motion handling robot

A Novel Measurement System Based on Binocular Fisheye Vision and its Application in Dynamic Environment

Design and Realization of Eye Control System for Small Ground Unmanned Platform

A novel multi-camera differential binocular vision sensor

A Binocular Stereo-Imaging-Perception System with a Wide Field-of-View and Infrared- and Visible Light-Dual-Band Fusion

The measurement of the variation in the surface strains of Achilles tendon grafts using imaging techniques.

A Platform for Computer Vision Development Based on Two Cameras