Abstract:In the modes of both object motion and camera motion, an enhanced Camshift algorithm, which is based on suppressing similar color features of background and on joint color probability density distribution image, is proposed to real-time track head in dynamic complex environment. The system consists of face detection module, head tracking module and camera control module. When tracking fails, a self-recovery mechanism is introduced. At first the Adaboost face detector based on Haar-like features is implemented to find frontal faces, the false positive is filtered according to the skin color criterion, and the true face is used to initialize the tracking module. In hue saturation value (HSV) colorspace, the hue-saturation (H-S) histogram of face skin and the saturation-value (S-V) histogram of hair are built to produce the joint color probability density distribution image, and this is intended to realize the head tracking with arbitrary pose. During tracking, region of interest (ROI) is introduced, and the color probability density distribution of a specified background area outside the ROI is learned, similar color features in the head are suppressed according to the learning result. The background suppression step is intended to resolve the problem that the tracker maybe fails when the head is distracted by backgrounds having similar colors with the head. A closed loop control model based on speed regulation is applied to drive an active camera to center the head. Once tracking drift or failure is detected, the system stops tracking and returns to the face detection module. Our experimental results show that the presented system is well suitable for tracking head with arbitrary pose in dynamic complex environments, also the active camera can track moving head smoothly and stably. The system is computationally efficient and can run in real-time completely.

Real-Time Accurate 3D Head Tracking and Pose Estimation with Consumer RGB-D Cameras

Recurrent Volume-based 3D Feature Fusion for Real-time Multi-view Object Pose Estimation

Real-time Follow-Up Head Tracking in Dynamic Complex Environments

Recurrent Volume-Based 3-D Feature Fusion for Real-Time Multiview Object Pose Estimation.

Efficient Multi-person Hierarchical 3D Pose Estimation for Autonomous Driving

Robust 3D Reconstruction with an RGB-D Camera

Real-time High-accuracy Three-Dimensional Reconstruction with Consumer RGB-D Cameras

Real-time Simultaneous 3D Head Modeling and Facial Motion Capture with an RGB-D camera

Robust 3D face modeling and tracking from RGB-D images

Detecting and tracking people in real time with RGB-D camera

Using a single RGB frame for real time 3D hand pose estimation in the wild

Real-time RGBD-based Extended Body Pose Estimation

Real-Time 3D Eye Performance Reconstruction for RGBD Cameras

Real-time 3D Deep Multi-Camera Tracking

Real-Time Facial Segmentation and Performance Capture from RGB Input

Fast and Efficient Integration of Human Upper-Body Detection and Orientation Estimation in RGB-D Video

Improving Real-Time Omnidirectional 3D Multi-Person Human Pose Estimation with People Matching and Unsupervised 2D-3D Lifting

Self-supervised CNN for Unconstrained 3D Facial Performance Capture from an RGB-D Camera.

Real-time human detection and tracking in complex environments using single RGBD camera

3D real-time human reconstruction with a single RGBD camera

Cross-View Tracking for Multi-Human 3D Pose Estimation at over 100 FPS