Abstract:Vehicle detection with optical remote sensing images has become widely applied in recent years. However, the following challenges have remained unsolved during remote sensing vehicle target detection. These challenges include the dense and arbitrary angles at which vehicles are distributed and which make it difficult to detect them; the extensive model parameter (Param) that blocks real-time detection; the large differences between larger vehicles in terms of their features, which lead to a reduced detection precision; and the way in which the distribution in vehicle datasets is unbalanced and thus not conducive to training. First, this paper constructs a small dataset of vehicles, MiVehicle. This dataset includes 3000 corresponding infrared and visible image pairs, offering a more balanced distribution. In the infrared part of the dataset, the proportions of different vehicle types are as follows: cars, 48%; buses, 19%; trucks, 15%; freight, cars 10%; and vans, 8%. Second, we choose the rotated box mechanism for detection with the model and we build a new vehicle detector, ML-Det, with a novel multi-scale feature fusion triple cross-criss FPN (TCFPN), which can effectively capture the vehicle features in three different positions with an mAP improvement of 1.97%. Moreover, we propose LKC–INVO, which allows involution to couple the structure of multiple large kernel convolutions, resulting in an mAP increase of 2.86%. We also introduce a novel C2F_ContextGuided module with global context perception, which enhances the perception ability of the model in the global scope and minimizes model Params. Eventually, we propose an assemble–disperse attention module to aggregate local features so as to improve the performance. Overall, ML-Det achieved a 3.22% improvement in accuracy while keeping Params almost unchanged. In the self-built small MiVehicle dataset, we achieved 70.44% on visible images and 79.12% on infrared images with 20.1 GFLOPS, 78.8 FPS, and 7.91 M. Additionally, we trained and tested our model on the following public datasets: UAS-AOD and DOTA. ML-Det was found to be ahead of many other advanced target detection algorithms.

Vehicle detection method based on deep learning and multi-layer feature fusion

High-resolution Remote Sensing Vehicle Automatic Detection Based on Feature Fusion Convolutional Neural Network

A Multi-view 3D Vehicle Detection Method Based On Novel 3D Proposal Generation Method

3D Vehicle Detection Using Multi-Level Fusion From Point Clouds and Images

Real-Time Vehicle Detection Framework Based on the Fusion of LiDAR and Camera

Deep Learning-Based Algorithm for Vehicle Detection in Intelligent Transportation Systems

Vehicle detection from complex scenes based on combination features and ELM

Fast Airplane Detection Based on Multi-Layer Feature Fusion of Fully Convolutional Networks

Fusion Strategy of Multi-sensor Based Object Detection for Self-driving Vehicles.

A Multi-Features Fusion Method Based on Convolutional Neural Network for Vehicle Recognition

A Method Based on Multi-Convolution Layers Joint and Generative Adversarial Networks for Vehicle Detection

Tiny Object Detection Using Multi-Feature Fusion

Object Detection Using Multi-Sensor Fusion Based on Deep Learning

A Block Object Detection Method Based on Feature Fusion Networks for Autonomous Vehicles

A Multi-Scale Feature Fusion Based Lightweight Vehicle Target Detection Network on Aerial Optical Images

3D car-detection based on a Mobile Deep Sensor Fusion Model and real-scene applications

Vehicle Detection in UAV Traffic Video Based on Convolution Neural Network

Real-Time Vehicle Object Detection Method Based on Multi-Scale Feature Fusion

Real-time Vehicle Detection under Complex Road Conditions

Vehicle Detection Based On Improved Multitask Cascaded Convolutional Neural Network And Mixed Image Enhancement

CMNet: A Connect-and-Merge Convolutional Neural Network for Fast Vehicle Detection in Urban Traffic Surveillance.