Abstract:Multi-object tracking (MOT) is a crucial component of situational awareness in military defense applications. With the growing use of unmanned aerial systems (UASs), MOT methods for aerial surveillance is in high demand. Application of MOT in UAS presents specific challenges such as moving sensor, changing zoom levels, dynamic background, illumination changes, obscurations and small objects. In this work, we present a robust object tracking architecture aimed to accommodate for the noise in real-time situations. Our work is based on the tracking-by-detection paradigm where an independent object detector is first applied to isolate all potential detections and an object tracking model is applied afterwards to link unique objects between frames. Object trajectories are constructed using multiple hypothesis tracking (MHT) framework that produces the best hypothesis based on the kinematic and visual scorings. We propose a kinematic prediction model, called Deep Extended Kalman Filter (DeepEKF), in which a sequence-to-sequence architecture is used to predict entity trajectories in latent space. DeepEKF utilizes a learned image embedding along with an attention mechanism trained to weight the importance of areas in an image to predict future states. For the visual scoring, we experiment with different similarity measures to calculate distance based on entity appearances, including a convolutional neural network (CNN) encoder, pre-trained using Siamese networks. In initial evaluation experiments, we show that our method, combining scoring structure of the kinematic and visual models within a MHT framework, has improved performance especially in edge cases where entity motion is unpredictable, or the data presents frames with significant gaps.

Environmental-Adaptive Trajectory Prediction of Multi-Object for UAV Networks with RGBD Camera

Flow-Guided Single Object Tracking Framework in UAV Aerial Video

A Vision-based UAV Tracker Aiming at Aerial Targets

Target Detection Formulti-Uavs Via Digital Pheromones and Navigation Algorithm in Unknownenvironments

Multi-object Detection, Tracking and Prediction in Rugged Dynamic Environments

A real-time dynamic obstacle tracking and mapping system for UAV navigation and collision avoidance with an RGB-D camera

Multitarget Real-Time Tracking Algorithm for UAV IoT

The Role of 5G Network Image Information Based on Deep Learning in UAV Prediction Target Trajectory Tracking

A Unified Environmental Network for Pedestrian Trajectory Prediction

Object Tracking in Unmanned Aerial Vehicle Videos via Multifeature Discrimination and Instance-Aware Attention Network

Drones Help Drones: A Collaborative Framework for Multi-Drone Object Trajectory Prediction and Beyond

Multi-Object Tracking Meets Moving UAV

Light-weight UAV object tracking network based on strategy gradient and attention mechanism

UCDNet: Multi-UAV Collaborative 3D Object Detection Network by Reliable Feature Mapping

Multi-object tracking with deep learning ensemble for unmanned aerial system applications

Control-Aware Trajectory Predictions for Communication-Efficient Drone Swarm Coordination in Cluttered Environments

Short-Term 4D Trajectory Prediction for UAV Based on Spatio-Temporal Trajectory Clustering

Eye in the Sky: Drone-Based Object Tracking and 3D Localization

Progressive Representation Learning for Real-Time UAV Tracking

Environment-Adaptive Multi-UAV Task Allocation and Path Planning

Dynamic Object Tracking on Autonomous UAV System for Surveillance Applications