Abstract:Accurate tracking of transparent objects, such as glasses, plays a critical role in many robotic tasks such as robot-assisted living. Due to the adaptive and often reflective texture of such objects, traditional tracking algorithms that rely on general-purpose learned features suffer from reduced performance. Recent research has proposed to instill transparency awareness into existing general object trackers by fusing purpose-built features. However, with the existing fusion techniques, the addition of new features causes a change in the latent space making it impossible to incorporate transparency awareness on trackers with fixed latent spaces. For example, many of the current days transformer-based trackers are fully pre-trained and are sensitive to any latent space perturbations. In this paper, we present a new feature fusion technique that integrates transparency information into a fixed feature space, enabling its use in a broader range of trackers. Our proposed fusion module, composed of a transformer encoder and an MLP module, leverages key query-based transformations to embed the transparency information into the tracking pipeline. We also present a new two-step training strategy for our fusion module to effectively merge transparency features. We propose a new tracker architecture that uses our fusion techniques to achieve superior results for transparent object tracking. Our proposed method achieves competitive results with state-of-the-art trackers on TOTB, which is the largest transparent object tracking benchmark recently released. Our results and the implementation of code will be made publicly available at <a class="link-external link-https" href="https://github.com/kalyan0510/TOTEM" rel="external noopener nofollow">this https URL</a>.

Trans2k: Unlocking the Power of Deep Models for Transparent Object Tracking

A New Dataset and a Distractor-Aware Architecture for Transparent Object Tracking

Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

Explicitly Modeling the Discriminability for Instance-Aware Visual Object Tracking

TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wild

TRansPose: Large-Scale Multispectral Dataset for Transparent Object

Transparent Object Tracking with Enhanced Fusion Module

The Visual Object Tracking VOT2013 Challenge Results

TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baseline

DepthTrack : Unveiling the Power of RGBD Tracking

The Thermal Infrared Visual Object Tracking VOT-TIR2016 Challenge Results

The Visual Object Tracking VOT2014 Challenge Results

DIVOTrack: A Novel Dataset and Baseline Method for Cross-View Multi-Object Tracking in DIVerse Open Scenes

Cross-Modal Object Tracking: Modality-Aware Representations and a Unified Benchmark

Segmenting Transparent Object in the Wild with Transformer

Camouflaged Object Tracking: A Benchmark

SslTransT: Self-supervised pre-training visual object tracking with Transformers

TransNet: Transparent Object Manipulation Through Category-Level Pose Estimation

TROSD: A New RGB-D Dataset for Transparent and Reflective Object Segmentation in Practice

Digital Twin Tracking Dataset (DTTD): A New RGB+Depth 3D Dataset for Longer-Range Object Tracking Applications