Abstract:Noncooperative micro unmanned aerial vehicles (UAVs) bring potential threats to public security and citizens' privacy. A system‐termed multimodal UAV 3D trajectory exposure system integrating a 64‐channel microphone array, a camera, and a lidar is devised to provide a wide range detection (90° × 360°) and high‐precision (<0.8° at 180 m) 3D tracking for UAVs. The increasing popularity of small drones has stressed the urgent need for an effective drone‐oriented surveillance system that can work day and night. Herein, an acoustic and optical sensor‐fusion‐based system‐termed multimodal unmanned aerial vehicle 3D trajectory exposure system (MUTES) is presented to detect and track drone targets. MUTES combines multiple sensor modules including microphone array, camera, and lidar. The 64‐channel microphone array provides semispherical surveillance with high signal‐to‐noise ratio of sound source estimation, while the long‐range lidar and the telephoto camera are capable of subsequent precise target localization in a narrower but higher definition field of view. MUTES employs a coarse‐to‐fine, passive‐to‐active localization strategy for wide‐range detection (semispherical) and high‐precision 3D tracking. To further increase the fidelity, an environmental denoising model is trained, which helps to select valid acoustic features from a drone target, thus overcomes the drawbacks of the traditional sound source localization approaches when facing noise interference. The effectiveness of the proposed sensor‐fusion approach is validated through field experiments. To the best of the knowledge, MUTES provides the farthest detection range, highest 3D position accuracy, strong anti‐interference capability, and acceptable cost for unverified drone intruders.

Air-to-Air Detection and Tracking of Non-Cooperative UAVs for 3D Reconstruction

A Vision-based UAV Tracker Aiming at Aerial Targets

Dynamic Target Tracking of Small UAVs in Unstructured Environment

UAVs cooperative target tracking under communication range constraints

Real-time Active Detection of Targets and Path Planning Using UAVs

Towards Real-time 3D Reconstruction using Consumer UAVs

Multi-UAV Cooperative and Continuous Path Planning for High-Resolution 3D Scene Reconstruction

Drone Detection and Tracking System Based on Fused Acoustical and Optical Approaches

3D Human Reconstruction in the Wild with Collaborative Aerial Cameras

Virtual Reality Aided High-Quality 3D Reconstruction by Remote Drones

Research on UAV Dynamic Target Tracking with Multi-sensor Position Feedback.

Real-Time Visual Tracking of Moving Targets Using a Low-Cost Unmanned Aerial Vehicle with a 3-Axis Stabilized Gimbal System

Multitarget Real-Time Tracking Algorithm for UAV IoT

Unsupervised UAV 3D Trajectories Estimation with Sparse Point Clouds

A Novel Real-Time Moving Target Tracking and Path Planning System for a Quadrotor UAV in Unknown Unstructured Outdoor Scenes

Integration of the 3D Environment for UAV Onboard Visual Object Tracking

Hybrid Iteration and Optimization-based Three-dimensional Reconstruction for Space Non-Cooperative Targets with Monocular Vision and Sparse Lidar Fusion

Design Of 3d Reconstruction System On Quadrotor Fusing Lidar And Camera

Multi-UAV Cooperative Target Tracking Based on Swarm Intelligence

Vision-Based Target Detection and Tracking System for a Quadcopter

A real-time dynamic obstacle tracking and mapping system for UAV navigation and collision avoidance with an RGB-D camera