Abstract:A visual tracking system is essential as a basis for visual servoing, autonomous navigation, path planning, robot-human interaction and other robotic functions. To execute various tasks in diverse and ever-changing environments, a mobile robot requires high levels of robustness, precision, environmental adaptability and real-time performance of the visual tracking system. In keeping with the application characteristics of our amphibious spherical robot, which was proposed for flexible and economical underwater exploration in 2012, an improved RGB-D visual tracking algorithm is proposed and implemented. Given the limited power source and computational capabilities of mobile robots, compressive tracking (CT), which is the effective and efficient algorithm that was proposed in 2012, was selected as the basis of the proposed algorithm to process colour images. A Kalman filter with a second-order motion model was implemented to predict the state of the target and select candidate patches or samples for the CT tracker. In addition, a variance ratio features shift (VR-V) tracker with a Kalman estimation mechanism was used to process depth images. Using a feedback strategy, the depth tracking results were used to assist the CT tracker in updating classifier parameters at an adaptive rate. In this way, most of the deficiencies of CT, including drift and poor robustness to occlusion and high-speed target motion, were partly solved. To evaluate the proposed algorithm, a Microsoft Kinect sensor, which combines colour and infrared depth cameras, was adopted for use in a prototype of the robotic tracking system. The experimental results with various image sequences demonstrated the effectiveness, robustness and real-time performance of the tracking system.

A Visual Tracking System of a Humanoid Robot Based on two Computers

Motion Control System Design of a Humanoid Robot Based on Stereo Vision

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

Accurate and Real-Time 3-D Tracking for the Following Robots by Fusing Vision and Ultrasonar Information

A Haptic Shared Control Architecture for Tracking of a Moving Object.

A Computer Vision for Navigation of Mobile Robots

Visual Tracking of A Moving Object of A Robot Head with 3 Dof

Real-time Object Tracking of a Robot Head Based on Multiple Visual Cues Integration.

Location And Tracking Of Robot End-Effector Based On Stereo Vision

Distributed Control System for A Humanoid Robot

Human Following for Wheeled Robot with Monocular Pan-tilt Camera

Design and Object Tracking Research of a Humanoid Robot Head

Real-time Object Tracking Ofarobotheadbasedon Multiple Visual CuesIntegration

Audio-Visual Bimodal Combination-Based Speaker Tracking Method for Mobile Robot

Real-Time Visual Tracking and Identification for a Team of Homogeneous Humanoid Robots

Intelligent communication of two humanoid robots based on computer vison

A Kinect-Based Real-Time Compressive Tracking Prototype System for Amphibious Spherical Robots

Research on Robot Head's Visual Tracking

TP 391 A Real-time 3 D Human Tracking and Modeling System

Computer control system and walking pattern control for a humanoid robot