Abstract:In the modes of both object motion and camera motion, an enhanced Camshift algorithm, which is based on suppressing similar color features of background and on joint color probability density distribution image, is proposed to real-time track head in dynamic complex environment. The system consists of face detection module, head tracking module and camera control module. When tracking fails, a self-recovery mechanism is introduced. At first the Adaboost face detector based on Haar-like features is implemented to find frontal faces, the false positive is filtered according to the skin color criterion, and the true face is used to initialize the tracking module. In hue saturation value (HSV) colorspace, the hue-saturation (H-S) histogram of face skin and the saturation-value (S-V) histogram of hair are built to produce the joint color probability density distribution image, and this is intended to realize the head tracking with arbitrary pose. During tracking, region of interest (ROI) is introduced, and the color probability density distribution of a specified background area outside the ROI is learned, similar color features in the head are suppressed according to the learning result. The background suppression step is intended to resolve the problem that the tracker maybe fails when the head is distracted by backgrounds having similar colors with the head. A closed loop control model based on speed regulation is applied to drive an active camera to center the head. Once tracking drift or failure is detected, the system stops tracking and returns to the face detection module. Our experimental results show that the presented system is well suitable for tracking head with arbitrary pose in dynamic complex environments, also the active camera can track moving head smoothly and stably. The system is computationally efficient and can run in real-time completely.

A Skeleton and Visual Tracking Fusion Based Person-Following System for Mobile Service Robots

Accurate and Real-Time 3-D Tracking for the Following Robots by Fusing Vision and Ultrasonar Information

Human Tracking and Following in Dynamic Environment for Service Robots

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

People Following System Based on LRF

An Efficient and Robust System for Human Following Scenario Using Differential Robot

Real-time Follow-Up Head Tracking in Dynamic Complex Environments

An Autonomous Robot for Collision-Free Person Following Through Model Predictive Control

Human Pose Tracking Algorithm Based on Skeleton-Texture Model

HSKP-CF Algorithm Based on Target Tracking for Mobile Following Robot

Real-time 3D Human Tracking for Mobile Robots with Multisensors

Human-Following of Mobile Robots Based on Object Tracking and Depth Vision

Tracking by segmentation with future motion estimation applied to person-following robots

Audio-Visual Bimodal Combination-Based Speaker Tracking Method for Mobile Robot

Mobile Robot Tracking Method Based on Improved YOLOv8 Pedestrian Detection Algorithm

Human Following for Wheeled Robot with Monocular Pan-tilt Camera

Advanced Multi-Sensor Person-Following System on a Mobile Robot: Design, Construction and Measurements

Real-Time Navigation In Dynamic Human Environments Using Optimal Reciprocal Collision Avoidance

A novel tracking system for human following robots with fusion of MMW radar and monocular vision

A Cascade Tracking Algorithm Based On Artificial Beacon And Hog Features