Abstract:This paper presents a robust, accurate and real-time model-based tracking method for markerless objects in complex environments to replace the conventional 3D tracking approach based on cooperative targets. A known 3D model of the object is projected onto a 2D plane and occlusion culling is performed with the precalibrated intrinsic parameters and initialized pose. The correspondences between a 3D object model and 2D image edges are commonly used to estimate the camera pose, so the pose optimization problem is transformed into 3D/2D model-to-image registration. For each visible model sample point, a one-dimensional search for putative image edge points is then performed along a direction perpendicular to its line by state-of-the-art methods. However, false correspondences always occur due to cluttered backgrounds or partial occlusion. To overcome this problem, a new search scheme for obtaining line correspondences instead of edge point correspondences is implemented. The outliers of 3D/2D line correspondences are then effectively detected and removed with algebraic outlier rejection, where the camera pose is iteratively optimized from correct correspondences of 3D/2D lines by minimizing the perpendicular distances from the endpoints of 3D model lines to their corresponding projection planes. The method presented in this paper has been validated on both synthetic images and real data. The experimental results show that the method is robust to strong noise, exquisite illumination changes and highly cluttered backgrounds. Meanwhile, it can easily satisfy the real time request.

Robust Depth-Based Object Tracking from a Moving Binocular Camera.

A Simple 3d Face Tracking Method Based On Depth Information

Tracking and Measuring a Moving Object with a Binocular Camera System

Multi-features Guided Robust Visual Tracking.

Object-Level Pseudo-3D Lifting for Distance-Aware Tracking

Binocular Based Moving Target Tracking for Mobile Robot

Robust Visual Tracking Based on Adaptive Depth-Color-cue Integration Using Range Sensor

Online Learning 3d Context for Robust Visual Tracking

Robust object tracking in crowd dynamic scenes using explicit stereo depth

Robust Visual Tracking Via Multiple Discriminative Models with Object Proposals

Depth Attention for Robust RGB Tracking

Robust Tracking Via Patch-Based Appearance Model and Local Background Estimation

Robust Object Tracking Via Multi-Cue Fusion.

Real-Time Tracking and Measuring of Moving Objects Based on Binocular Vision

Depth Assisted Occlusion Handling In Video Object Tracking

Robust Visual Tracking Via Two-Stage Binocular Sparse Learning

Combined Motion and Region-Based 3D Tracking in Active Depth Image Sequence

Robust Monocular Model-Based Pose Tracking of Markerless Rigid Objects

Moving Objects Tracking and Localization with Binocular Vision Based on Sequential Detection Mechanism

Robust Visual Tracking Based on Hierarchical Appearance Model.

Moving Target Tracking and Measurement with a Binocular Vision System