Abstract:With the evolution and fusion of wireless sensor network and embedded camera technologies, distributed smart camera networks have emerged as a new class of systems for wide-area surveillance applications. Wireless networks, however, introduce a number of constraints to the system that need to be considered, notably the communication bandwidth constraints. Existing approaches for target tracking using a camera network typically utilize target handover mechanisms between cameras, or combine results from 2D trackers in each camera into 3D target estimation. Such approaches suffer from scale selection, target rotation, and occlusion, drawbacks typically associated with 2D tracking. In this paper, we present an approach for tracking multiple targets directly in 3D space using a network of smart cameras. The approach employs multi-view histograms to characterize targets in 3D space using color and texture as the visual features. The visual features from each camera along with the target models are used in a probabilistic tracker to estimate the target state. We introduce four variations of our base tracker that incur different computational and communication costs on each node and result in different tracking accuracy. We demonstrate the effectiveness of our proposed trackers by comparing their performance to a 3D tracker that fuses the results of independent 2D trackers. We also present performance analysis of the base tracker along Quality-of-Service (QoS) and Quality-of-Information (QoI) metrics, and study QoS vs. QoI trade-offs between the proposed tracker variations. Finally, we demonstrate our tracker in a real-life scenario using a camera network deployed in a building.

Information Submanifold Based on Spd Matrices and Its Applications to Sensor Networks

Spatial Information Aided Joint UL/DL Channel Tracking for Massive MIMO System in HST Environment

Tensor-Based Subspace Fusion for Direct Position Determination

Spectral Flow on the Manifold of SPD Matrices for Multimodal Data Processing

Kernel Methods on the Riemannian Manifold of Symmetric Positive Definite Matrices

Manifold Kernel Sparse Representation of Symmetric Positive-Definite Matrices and Its Applications

Networked Ultrasonic Sensors for Target Tracking: An Experimental Study

Wireless Sensor Networks Localization with Isomap.

On The Detection Of Sparse Signals With Sensor Networks Based On Subspace Pursuit

Linear and nonlinear filters based on statistical similarity measure for sensor network systems

Collaborative 3D Target Tracking in Distributed Smart Camera Networks for Wide-Area Surveillance

Visual Tracking Via Incremental Log-Euclidean Riemannian Subspace Learning

Efficient Sensor Management for Multitarget Tracking in Passive Sensor Networks via Cauchy-Schwarz Divergence

Matrix Manifold Neural Networks++

Kernel Clustering on Symmetric Positive Definite Manifolds Via Double Approximated Low Rank Representation

Sensor Management with Dynamic Clustering for Bearings-Only Multi-Target Tracking via Swarm Intelligence Optimization

On the Information Evolution and Sensor Deployment for Multispacecraft Cooperative Visual 3-D Sensing of Orbital Targets

Riemannian Self-Attention Mechanism for SPD Networks

Efficient Data Gathering in Wireless Sensor Networks Based on Matrix Completion and Compressive Sensing

An Arithmetic Geometric Mixed Average GM-PHD Algorithm for Decentralized Sensor Network With Limited Field of View

Geometry-aware Similarity Learning on SPD Manifolds for Visual Recognition