Abstract:Noncooperative micro unmanned aerial vehicles (UAVs) bring potential threats to public security and citizens' privacy. A system‐termed multimodal UAV 3D trajectory exposure system integrating a 64‐channel microphone array, a camera, and a lidar is devised to provide a wide range detection (90° × 360°) and high‐precision (<0.8° at 180 m) 3D tracking for UAVs. The increasing popularity of small drones has stressed the urgent need for an effective drone‐oriented surveillance system that can work day and night. Herein, an acoustic and optical sensor‐fusion‐based system‐termed multimodal unmanned aerial vehicle 3D trajectory exposure system (MUTES) is presented to detect and track drone targets. MUTES combines multiple sensor modules including microphone array, camera, and lidar. The 64‐channel microphone array provides semispherical surveillance with high signal‐to‐noise ratio of sound source estimation, while the long‐range lidar and the telephoto camera are capable of subsequent precise target localization in a narrower but higher definition field of view. MUTES employs a coarse‐to‐fine, passive‐to‐active localization strategy for wide‐range detection (semispherical) and high‐precision 3D tracking. To further increase the fidelity, an environmental denoising model is trained, which helps to select valid acoustic features from a drone target, thus overcomes the drawbacks of the traditional sound source localization approaches when facing noise interference. The effectiveness of the proposed sensor‐fusion approach is validated through field experiments. To the best of the knowledge, MUTES provides the farthest detection range, highest 3D position accuracy, strong anti‐interference capability, and acceptable cost for unverified drone intruders.

Exploitation of Multipath Micro-Doppler Signatures for Drone Classification

A Drone Localization System Based On Multiple Time Delays Fusion

Classification of Drones Based on Micro-Doppler Radar Signatures Using Dual Radar Sensors

Classification Of Drones Based On Micro-Doppler Signatures With Dual-Band Radar Sensors

Aerial Target Recognition with Enhanced Micro-Doppler Dynamic Features Based on Frequency-Modulated Continuous-Wave Radar

RF Signal Classification-based Drone Identification with Multimodal Database.

Feature Extracted Doa Estimation Algorithm Using Acoustic Array For Drone Surveillance

Adaptive Switching Spatial-Temporal Fusion Detection for Remote Flying Drones

An Acoustic-Based Surveillance System for Amateur Drones Detection and Localization

Detection of Multiple Micro-Drones via Cadence Velocity Diagram Analysis

Exploring Radar Micro-Doppler Signatures for Recognition of Drone Types

Multi-Frequency Radar Micro-Doppler Based Classification of Micro-Drone Payload Weight

Radar Recognition of Multiple Micro‐drones Based on Their Micro‐doppler Signatures Via Dictionary Learning

Dictionary Learning for Radar Classification of Multiple Micro-Drones

Micro-Doppler-Coded Drone Identification

Flying Objects Classification Based on Micro–Doppler Signature Data From UAV Borne Radar

A new simulation methodology for generating accurate drone micro‐Doppler with experimental validation

Spectral-Kurtosis and Image-Embedding Approach for Target Classification in Micro-Doppler Signatures

Denoising of UAV Micro-Doppler Signatures Based on BEMD and Wavelet Transform

Drone Detection and Tracking System Based on Fused Acoustical and Optical Approaches

Mini-UAV Movement Classification Based on Sparse Decomposition of Micro-Doppler Signature