Abstract:Vehicle detection with optical remote sensing images has become widely applied in recent years. However, the following challenges have remained unsolved during remote sensing vehicle target detection. These challenges include the dense and arbitrary angles at which vehicles are distributed and which make it difficult to detect them; the extensive model parameter (Param) that blocks real-time detection; the large differences between larger vehicles in terms of their features, which lead to a reduced detection precision; and the way in which the distribution in vehicle datasets is unbalanced and thus not conducive to training. First, this paper constructs a small dataset of vehicles, MiVehicle. This dataset includes 3000 corresponding infrared and visible image pairs, offering a more balanced distribution. In the infrared part of the dataset, the proportions of different vehicle types are as follows: cars, 48%; buses, 19%; trucks, 15%; freight, cars 10%; and vans, 8%. Second, we choose the rotated box mechanism for detection with the model and we build a new vehicle detector, ML-Det, with a novel multi-scale feature fusion triple cross-criss FPN (TCFPN), which can effectively capture the vehicle features in three different positions with an mAP improvement of 1.97%. Moreover, we propose LKC–INVO, which allows involution to couple the structure of multiple large kernel convolutions, resulting in an mAP increase of 2.86%. We also introduce a novel C2F_ContextGuided module with global context perception, which enhances the perception ability of the model in the global scope and minimizes model Params. Eventually, we propose an assemble–disperse attention module to aggregate local features so as to improve the performance. Overall, ML-Det achieved a 3.22% improvement in accuracy while keeping Params almost unchanged. In the self-built small MiVehicle dataset, we achieved 70.44% on visible images and 79.12% on infrared images with 20.1 GFLOPS, 78.8 FPS, and 7.91 M. Additionally, we trained and tested our model on the following public datasets: UAS-AOD and DOTA. ML-Det was found to be ahead of many other advanced target detection algorithms.

Multiscale Attention and Feature Decomposition Network for Surveillance Vehicle Detection

Multi-Task Feature Decoupling Network with clear division of labor for vehicle component detection

AMFF-Net: An Effective 3D Object Detector Based on Attention and Multi-Scale Feature Fusion

A Multi-Scale Feature Fusion Based Lightweight Vehicle Target Detection Network on Aerial Optical Images

3D Object Detection Based on Attention and Multi-Scale Feature Fusion

Mafe-Net:Multi-Scale Adaptive Feature Enhancement Network for Infrared Weak Vehicle Targets Detection

Remote Sensing Small Object Detection Network Based on Attention Mechanism and Multi-Scale Feature Fusion

Multi-layer feature fusion and attention enhancement for fine-grained vehicle recognition research

MFFSODNet: Multiscale Feature Fusion Small Object Detection Network for UAV Aerial Images

Attention feature fusion awareness network for vehicle target detection in SAR images

AMFEF-DETR: An End-to-End Adaptive Multi-Scale Feature Extraction and Fusion Object Detection Network Based on UAV Aerial Images

A lightweight vehicle mounted multi-scale traffic sign detector using attention fusion pyramid

A Task-Balanced Multiscale Adaptive Fusion Network for Object Detection in Remote Sensing Images

MTSDet: multi-scale traffic sign detection with attention and path aggregation

MFEFNet: A Multi-Scale Feature Information Extraction and Fusion Network for Multi-Scale Object Detection in UAV Aerial Images

MTA-Net: A One-Stage Detector Based on a Multiscale Task-Aligned Network for Catenary Support Components

EMDFNet: Efficient Multi-scale and Diverse Feature Network for Traffic Sign Detection

A Multi-Feature Fusion and Attention Network for Multi-Scale Object Detection in Remote Sensing Images

Channelwise and Spatially Guided Multimodal Feature Fusion Network for 3-D Object Detection in Autonomous Vehicles

Adaptive Feature Fusion With Attention-Guided Small Target Detection in Remote Sensing Images

MIAF-Net: A Multi-Information Attention Fusion Network for Field Traffic Sign Detection