Abstract:Vehicle detection with optical remote sensing images has become widely applied in recent years. However, the following challenges have remained unsolved during remote sensing vehicle target detection. These challenges include the dense and arbitrary angles at which vehicles are distributed and which make it difficult to detect them; the extensive model parameter (Param) that blocks real-time detection; the large differences between larger vehicles in terms of their features, which lead to a reduced detection precision; and the way in which the distribution in vehicle datasets is unbalanced and thus not conducive to training. First, this paper constructs a small dataset of vehicles, MiVehicle. This dataset includes 3000 corresponding infrared and visible image pairs, offering a more balanced distribution. In the infrared part of the dataset, the proportions of different vehicle types are as follows: cars, 48%; buses, 19%; trucks, 15%; freight, cars 10%; and vans, 8%. Second, we choose the rotated box mechanism for detection with the model and we build a new vehicle detector, ML-Det, with a novel multi-scale feature fusion triple cross-criss FPN (TCFPN), which can effectively capture the vehicle features in three different positions with an mAP improvement of 1.97%. Moreover, we propose LKC–INVO, which allows involution to couple the structure of multiple large kernel convolutions, resulting in an mAP increase of 2.86%. We also introduce a novel C2F_ContextGuided module with global context perception, which enhances the perception ability of the model in the global scope and minimizes model Params. Eventually, we propose an assemble–disperse attention module to aggregate local features so as to improve the performance. Overall, ML-Det achieved a 3.22% improvement in accuracy while keeping Params almost unchanged. In the self-built small MiVehicle dataset, we achieved 70.44% on visible images and 79.12% on infrared images with 20.1 GFLOPS, 78.8 FPS, and 7.91 M. Additionally, we trained and tested our model on the following public datasets: UAS-AOD and DOTA. ML-Det was found to be ahead of many other advanced target detection algorithms.

MEGF-Net: multi-exposure generation and fusion network for vehicle detection under dim light conditions

Low Illumination Enhancement for Object Detection in Self-Driving

Millimeter-Wave Radar and Vision Fusion Target Detection Algorithm Based on an Extended Network

Transformer fusion and histogram layer multispectral pedestrian detection network

Multiclass objects detection algorithm using DarkNet-53 and DenseNet for intelligent vehicles

GF-Detection: Fusion with GAN of Infrared and Visible Images for Vehicle Detection at Nighttime

Attention-Guided Multi-Scale Feature Fusion Network for Low-Light Image Enhancement

Multispectral Deep Neural Network Fusion Method for Low-Light Object Detection

A Multi-Scale Feature Fusion Based Lightweight Vehicle Target Detection Network on Aerial Optical Images

Attention‐based multi‐channel feature fusion enhancement network to process low‐light images

Adaptive Enhanced Detection Network for Low Illumination Object Detection

A multi-exposure generation and fusion method for low-light image enhancement

Global–Local Feature Fusion Network for Visible–Infrared Vehicle Detection

MTIE-Net: Multi-technology fusion of low-light image enhancement network

Low-light enhancement method with dual branch feature fusion and learnable regularized attention

Multi-exposure image fusion via deep perceptual enhancement

Light “You Only Look Once”: An Improved Lightweight Vehicle-Detection Model for Intelligent Vehicles under Dark Conditions

Graph-Based Progressive Fusion Network for Multi-Modality Vehicle Re-Identification

Multi-layer feature fusion and attention enhancement for fine-grained vehicle recognition research

MAFF-Net: Filter False Positive for 3D Vehicle Detection with Multi-modal Adaptive Feature Fusion

Multi-attribute Vehicle Recognition with Feature Fusion Using Muti-Gate Unit