Abstract:In the modes of both object motion and camera motion, an enhanced Camshift algorithm, which is based on suppressing similar color features of background and on joint color probability density distribution image, is proposed to real-time track head in dynamic complex environment. The system consists of face detection module, head tracking module and camera control module. When tracking fails, a self-recovery mechanism is introduced. At first the Adaboost face detector based on Haar-like features is implemented to find frontal faces, the false positive is filtered according to the skin color criterion, and the true face is used to initialize the tracking module. In hue saturation value (HSV) colorspace, the hue-saturation (H-S) histogram of face skin and the saturation-value (S-V) histogram of hair are built to produce the joint color probability density distribution image, and this is intended to realize the head tracking with arbitrary pose. During tracking, region of interest (ROI) is introduced, and the color probability density distribution of a specified background area outside the ROI is learned, similar color features in the head are suppressed according to the learning result. The background suppression step is intended to resolve the problem that the tracker maybe fails when the head is distracted by backgrounds having similar colors with the head. A closed loop control model based on speed regulation is applied to drive an active camera to center the head. Once tracking drift or failure is detected, the system stops tracking and returns to the face detection module. Our experimental results show that the presented system is well suitable for tracking head with arbitrary pose in dynamic complex environments, also the active camera can track moving head smoothly and stably. The system is computationally efficient and can run in real-time completely.

An accelerated human motion tracking system based on voxel reconstruction under complex environments

Simultaneous 3-D Human-Motion Tracking and Voxel Reconstruction

Real-time Follow-Up Head Tracking in Dynamic Complex Environments

Fast-Tracker 2.0: Improving Autonomy of Aerial Tracking with Active Vision and Human Location Regression.

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Model-based 3D human motion tracking and voxel reconstruction from sparse views

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

Digitize Your Body and Action in 3-D at Over 10 FPS: Real Time Dense Voxel Reconstruction and Marker-less Motion Tracking via GPU Acceleration.

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

Markless Human Motion Capture by Voxel Labeling

A Two-Stage Scheme for Multi-View Human Pose Estimation

An efficient stochastic framework for 3D human motion tracking

Vox-Fusion++: Voxel-based Neural Implicit Dense Tracking and Mapping with Multi-maps

Tracking 3D Human Motion in Compact Base Space

Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representation

Faster VoxelPose: Real-time 3D Human Pose Estimation by Orthographic Projection.

RobustFusion: Human Volumetric Capture with Data-Driven Visual Cues Using a RGBD Camera

Observation and Analysis of High-Speed Human Motion with Frequent Occlusion in A Large Area

Accurate realtime full-body motion capture using a single depth camera

Towards Robust and Accurate Single-View Fast Human Motion Capture

Two-camera-based Human Motion Capture