Abstract:Vehicle detection with optical remote sensing images has become widely applied in recent years. However, the following challenges have remained unsolved during remote sensing vehicle target detection. These challenges include the dense and arbitrary angles at which vehicles are distributed and which make it difficult to detect them; the extensive model parameter (Param) that blocks real-time detection; the large differences between larger vehicles in terms of their features, which lead to a reduced detection precision; and the way in which the distribution in vehicle datasets is unbalanced and thus not conducive to training. First, this paper constructs a small dataset of vehicles, MiVehicle. This dataset includes 3000 corresponding infrared and visible image pairs, offering a more balanced distribution. In the infrared part of the dataset, the proportions of different vehicle types are as follows: cars, 48%; buses, 19%; trucks, 15%; freight, cars 10%; and vans, 8%. Second, we choose the rotated box mechanism for detection with the model and we build a new vehicle detector, ML-Det, with a novel multi-scale feature fusion triple cross-criss FPN (TCFPN), which can effectively capture the vehicle features in three different positions with an mAP improvement of 1.97%. Moreover, we propose LKC–INVO, which allows involution to couple the structure of multiple large kernel convolutions, resulting in an mAP increase of 2.86%. We also introduce a novel C2F_ContextGuided module with global context perception, which enhances the perception ability of the model in the global scope and minimizes model Params. Eventually, we propose an assemble–disperse attention module to aggregate local features so as to improve the performance. Overall, ML-Det achieved a 3.22% improvement in accuracy while keeping Params almost unchanged. In the self-built small MiVehicle dataset, we achieved 70.44% on visible images and 79.12% on infrared images with 20.1 GFLOPS, 78.8 FPS, and 7.91 M. Additionally, we trained and tested our model on the following public datasets: UAS-AOD and DOTA. ML-Det was found to be ahead of many other advanced target detection algorithms.

Occlusion-Aware Detection for Internet of Vehicles in Urban Traffic Sensing Systems

A Fusion Method Aiming at Environmental Perception of Autonomous Vehicle Based on Visual Scheme

An algorithm for highway vehicle detection based on convolutional neural network

Multiclass objects detection algorithm using DarkNet-53 and DenseNet for intelligent vehicles

3D Object Detection under Urban Road Traffic Scenarios Based on Dual-Layer Voxel Features Fusion Augmentation

Real-time multiple vehicles tracking with occlusion handling

3D Vehicle Detection Using Multi-Level Fusion From Point Clouds and Images

Vehicle Detection by Fusing Part Model Learning and Semantic Scene Information for Complex Urban Surveillance

Automatic Outer Contour Detection and Quantification of Vehicles Using Monocular Vision

An Integrated Approach For Vehicle Detection And Type Recognition

Multi-Task Vehicle Detection with Region-of-Interest Voting.

A Feature Fusion Deep-Projection Convolution Neural Network for Vehicle Detection in Aerial Images

Adaptive occlusion object detection algorithm based on OL-IoU

Attention-Mechanism-based Tracking Method for Intelligent Internet of Vehicles

3D Detection for Occluded Vehicles From Point Clouds

Enhancing YOLO for occluded vehicle detection with grouped orthogonal attention and dense object repulsion

Vehicle Detection Based on Separable Reverse Connected Network

Attention Mechanism and Detection Box Information Based Real-time Multi-Object Vehicle Detection

An Automated Learning Framework With Limited and Cross-Domain Data for Traffic Equipment Detection From Surveillance Videos

A Multi-Scale Feature Fusion Based Lightweight Vehicle Target Detection Network on Aerial Optical Images

Vehicle Detection in Multisource Remote Sensing Images Based on Edge-Preserving Super-Resolution Reconstruction