Abstract:Vehicle detection with optical remote sensing images has become widely applied in recent years. However, the following challenges have remained unsolved during remote sensing vehicle target detection. These challenges include the dense and arbitrary angles at which vehicles are distributed and which make it difficult to detect them; the extensive model parameter (Param) that blocks real-time detection; the large differences between larger vehicles in terms of their features, which lead to a reduced detection precision; and the way in which the distribution in vehicle datasets is unbalanced and thus not conducive to training. First, this paper constructs a small dataset of vehicles, MiVehicle. This dataset includes 3000 corresponding infrared and visible image pairs, offering a more balanced distribution. In the infrared part of the dataset, the proportions of different vehicle types are as follows: cars, 48%; buses, 19%; trucks, 15%; freight, cars 10%; and vans, 8%. Second, we choose the rotated box mechanism for detection with the model and we build a new vehicle detector, ML-Det, with a novel multi-scale feature fusion triple cross-criss FPN (TCFPN), which can effectively capture the vehicle features in three different positions with an mAP improvement of 1.97%. Moreover, we propose LKC–INVO, which allows involution to couple the structure of multiple large kernel convolutions, resulting in an mAP increase of 2.86%. We also introduce a novel C2F_ContextGuided module with global context perception, which enhances the perception ability of the model in the global scope and minimizes model Params. Eventually, we propose an assemble–disperse attention module to aggregate local features so as to improve the performance. Overall, ML-Det achieved a 3.22% improvement in accuracy while keeping Params almost unchanged. In the self-built small MiVehicle dataset, we achieved 70.44% on visible images and 79.12% on infrared images with 20.1 GFLOPS, 78.8 FPS, and 7.91 M. Additionally, we trained and tested our model on the following public datasets: UAS-AOD and DOTA. ML-Det was found to be ahead of many other advanced target detection algorithms.

SDM-Car: A Dataset for Small and Dim Moving Vehicles Detection in Satellite Videos

Small Moving Vehicle Detection in a Satellite Video of an Urban Area

Vehicle Target Detection Method for Wide-Area SAR Images Based on Coarse-Grained Judgment and Fine-Grained Detection

Needles in a Haystack: Tracking City-Scale Moving Vehicles from Continuously Moving Satellite

Detecting Tiny Moving Vehicles in Satellite Videos

Nighttime vehicle detection based on illumination visibility recognition

SDAC: A Multimodal Synthetic Dataset for Anomaly and Corner Case Detection in Autonomous Driving

Vehicle Perception from Satellite

SATDark: A Satellite Video Low-light Tracking Benchmark for Dark and Weak Vehicles

Detecting and Tracking Small and Dense Moving Objects in Satellite Videos: A Benchmark

Real-Time Moving Vehicle Detection in Satellite Video Based on Historical Differential Information and Grouping Features

A Large-Scale Car Parts (LSCP) Dataset for Lightweight Fine-Grained Detection

Highly Efficient and Unsupervised Framework for Moving Object Detection in Satellite Videos

A Multi-Scale Feature Fusion Based Lightweight Vehicle Target Detection Network on Aerial Optical Images

Tiny Vehicle Detection for Mid-to-High Altitude UAV Images Based on Visual Attention and Spatial-Temporal Information

Moving Vehicle Detection in Satellite Video via Background Subtraction and Global–Local Features Fusion Faster R-CNN

SIVED: A SAR Image Dataset for Vehicle Detection Based on Rotatable Bounding Box

Vehicle Detection in Multisource Remote Sensing Images Based on Edge-Preserving Super-Resolution Reconstruction

Satellite Video Moving Vehicle Detection and Tracking Based on Spatiotemporal Characteristics

An Evaluation of Boosted Features for Vehicle Detection

SODA10M: A Large-Scale 2D Self/Semi-Supervised Object Detection Dataset for Autonomous Driving