LWUAVDet: A Lightweight UAV Object Detection Network on Edge Devices

Xuanlin Min,Wei Zhou,Rui Hu,Yinyue Wu,Yiran Pang,Jun Yi
DOI: https://doi.org/10.1109/JIOT.2024.3388045
IF: 10.6
2024-07-01
IEEE Internet of Things Journal
Abstract:Real-time object detection on unmanned aerial vehicles (UAVs) poses a challenging issue due to the limited computing resources of edge devices. To address this problem, we propose a novel lightweight object detection network named LWUAVDet for real-time UAV applications. The detector comprises three core components: E-FPN, PixED Head, and Aux Head. First, we develop an extended and refined topology in the Neck layer, called E-FPN, to enhance the multiscale representation of each stage and alleviate the aliasing effect caused by the repetitive feature fusion of the Neck. Second, we propose a pixel encoder and decoder for dimension exchange between space and channel to achieve flexible and effective feature extraction in the Head layer, named PixED Head. Furthermore, Aux Head for the auxiliary task merely using the Head layer is presented for online distillation to enhance feature representation. Specially, in Aux Head, we introduce the weighted sum of Focal Loss and complete intersection over union loss for the cost matrix of the sample assigner to alleviate category imbalance and aspect ratio imbalance of the UAV data. The performance of our LWUAVDet is validated experimentally on the NVIDIA Jetson Xavier NX and Jetson Nano GPU devices. Extensive experiments demonstrate that the LWUAVDet models achieve a better tradeoff between accuracy and latency on VisDrone, UAVDT, and VOC2012 data sets compared to state-of-the-art lightweight models.
Engineering,Computer Science
What problem does this paper attempt to address?