Abstract:In the last decades, visual target tracking has been one of the primary research interests of the Robotics research community. The recent advances in Deep Learning technologies have made the exploitation of visual tracking approaches effective and possible in a wide variety of applications, ranging from automotive to surveillance and human assistance. However, the majority of the existing works focus exclusively on passive visual tracking, i.e., tracking elements in sequences of images by assuming that no actions can be taken to adapt the camera position to the motion of the tracked entity. On the contrary, in this work, we address visual active tracking, in which the tracker has to actively search for and track a specified target. Current State-of-the-Art approaches use Deep Reinforcement Learning (DRL) techniques to address the problem in an end-to-end manner. However, two main problems arise: i) most of the contributions focus only on discrete action spaces and the ones that consider continuous control do not achieve the same level of performance; and ii) if not properly tuned, DRL models can be challenging to train, resulting in a considerably slow learning progress and poor final performance. To address these challenges, we propose a novel DRL-based visual active tracking system that provides continuous action policies. To accelerate training and improve the overall performance, we introduce additional objective functions and a Heuristic Trajectory Generator (HTG) to facilitate learning. Through an extensive experimentation, we show that our method can reach and surpass other State-of-the-Art approaches performances, and demonstrate that, even if trained exclusively in simulation, it can successfully perform visual active tracking even in real scenarios.

Autonomous learning of features for control: Experiments with embodied and situated agents

Autonomous Driving with Human Guided Image Feature Extraction

Deep Reinforcement Learning for Autonomous Driving by Transferring Visual Features.

Unsupervised Control Through Non-Parametric Discriminative Rewards

Dual Models to Facilitate Learning of Policy Network

Artificial Neural Networks As Feature Extractors in Continuous Evolutionary Optimization.

Decoupling feature extraction from policy learning: assessing benefits of state representation learning in goal based robotics

Self-attention-based multi-agent continuous control method in cooperative environments

Learning Deep Features for Robotic Inference from Physical Interactions.

Robot Perception enables Complex Navigation Behavior via Self-Supervised Learning

Automating Feature Subspace Exploration via Multi-Agent Reinforcement Learning

Successor Feature Neural Episodic Control

Multi-Agent Exploration Via Self-Learning and Social Learning

Enhancing Continuous Control of Mobile Robots for End-to-End Visual Active Tracking

Multi-Object Navigation with dynamically learned neural implicit representations

Temporally extended successor feature neural episodic control

Learning Robust and Adaptive Real-World Continuous Control Using Simulation and Transfer Learning

Lifelong Learning of Spatiotemporal Representations with Dual-Memory Recurrent Self-Organization

Autonomous Navigation in Complex Environments

Explaining Autonomous Driving by Learning End-to-End Visual Attention

Learning to navigate efficiently and precisely in real environments