Abstract:Object detection and semantic segmentation are two main themes in object retrieval from high-resolution remote sensing images, which have recently achieved remarkable performance by surfing the wave of deep learning and, more notably, convolutional neural networks. In this paper, we are interested in a novel, more challenging problem of vehicle instance segmentation, which entails identifying, at a pixel level, where the vehicles appear as well as associating each pixel with a physical instance of a vehicle. In contrast, vehicle detection and semantic segmentation each only concern one of the two. We propose to tackle this problem with a semantic boundary-aware multitask learning network. More specifically, we utilize the philosophy of residual learning to construct a fully convolutional network that is capable of harnessing multilevel contextual feature representations learned from different residual blocks. We theoretically analyze and discuss why residual networks can produce better probability maps for pixelwise segmentation tasks. Then, based on this network architecture, we propose a unified multitask learning network that can simultaneously learn two complementary tasks, namely, segmenting vehicle regions and detecting semantic boundaries. The latter subproblem is helpful for differentiating “touching” vehicles that are usually not correctly separated into instances. Currently, data sets with a pixelwise annotation for vehicle extraction are the ISPRS data set and the IEEE GRSS DFC2015 data set over Zeebrugge, which specializes in a semantic segmentation. Therefore, we built a new, more challenging data set for vehicle instance segmentation, called the Busy Parking Lot Unmanned Aerial Vehicle Video data set, and we make our data set available at http://www.sipeo.bgu.tum.de/downloads so that it can be used to benchmark future vehicle instance segmentation algorithms.

Vehicle Detection Based on Separable Reverse Connected Network

Separable reverse connected network for efficient multi-scale vehicle detection

Efficient but Lightweight Network for Vehicle Re-Identification with Center-Constraint Loss

Multiclass objects detection algorithm using DarkNet-53 and DenseNet for intelligent vehicles

SINet: A Scale-Insensitive Convolutional Neural Network for Fast Vehicle Detection

DV3-IBi_YOLOv5s: A Lightweight Backbone Network and Multiscale Neck Network Vehicle Detection Algorithm

Vehicle Behavior Recognition using Multi-Stream 3D Convolutional Neural Network

An algorithm for highway vehicle detection based on convolutional neural network

Multi-Task Feature Decoupling Network with clear division of labor for vehicle component detection

A Vehicle Detection Method Based on an Improved U-YOLO Network for High-Resolution Remote-Sensing Images

Flexible Neural Network for Fast and Accurate Road Scene Perception.

Embedded and Real-Time Vehicle Detection System for Challenging On-Road Scenes

Vehicle Detection in Multisource Remote Sensing Images Based on Edge-Preserving Super-Resolution Reconstruction

Vehicle Instance Segmentation From Aerial Image and Video Using a Multitask Learning Residual Fully Convolutional Network

An Improved FBPN-Based Detection Network for Vehicles in Aerial Images.

Occlusion-Aware Detection for Internet of Vehicles in Urban Traffic Sensing Systems

Vehicle Instance Segmentation from Aerial Image and Video Using a Multi-Task Learning Residual Fully Convolutional Network

Cascade Evolving Network for Vehicle Detection of Highway

A FPN-Based Framework for Vehicle Detection in Aerial Images

A vehicle detection method based on disparity segmentation

Real-Time Detection Network SI-SSD for Weak Targets in Complex Traffic Scenarios