Abstract:Object detection and semantic segmentation are two main themes in object retrieval from high-resolution remote sensing images, which have recently achieved remarkable performance by surfing the wave of deep learning and, more notably, convolutional neural networks (CNNs). In this paper, we are interested in a novel, more challenging problem of vehicle instance segmentation, which entails identifying, at a pixel-level, where the vehicles appear as well as associating each pixel with a physical instance of a vehicle. In contrast, vehicle detection and semantic segmentation each only concern one of the two. We propose to tackle this problem with a semantic boundary-aware multi-task learning network. More specifically, we utilize the philosophy of residual learning (ResNet) to construct a fully convolutional network that is capable of harnessing multi-level contextual feature representations learned from different residual blocks. We theoretically analyze and discuss why residual networks can produce better probability maps for pixel-wise segmentation tasks. Then, based on this network architecture, we propose a unified multi-task learning network that can simultaneously learn two complementary tasks, namely, segmenting vehicle regions and detecting semantic boundaries. The latter subproblem is helpful for differentiating closely spaced vehicles, which are usually not correctly separated into instances. Currently, datasets with pixel-wise annotation for vehicle extraction are ISPRS dataset and IEEE GRSS DFC2015 dataset over Zeebrugge, which specializes in semantic segmentation. Therefore, we built a new, more challenging dataset for vehicle instance segmentation, called the Busy Parking Lot UAV Video dataset, and we make our dataset available at http://www.sipeo.bgu.tum.de/download so that it can be used to benchmark future vehicle instance segmentation algorithms.

Focal-Pyramid-Based Vehicle Segmentation in SAR Images

Attention feature fusion awareness network for vehicle target detection in SAR images

Vehicle Target Detection Method for Wide-Area SAR Images Based on Coarse-Grained Judgment and Fine-Grained Detection

Vehicle Localization Method in Complex SAR Images Based on Feature Reconstruction and Aggregation

Morphology-Based Feature Extraction Network for Arbitrary-Oriented SAR Vehicle Detection

SAR Vehicle Recognition Via Scale-Coupled Incep_Dense Network (Idnet)

SAR Image Segmentation Based on Hierarchical Visual Semantic and Adaptive Neighborhood Multinomial Latent Model

Vehicle Instance Segmentation from Aerial Image and Video Using a Multi-Task Learning Residual Fully Convolutional Network

FEMSFNet: Feature Enhancement and Multi-Scales Fusion Network for SAR Aircraft Detection

Leveraging Mixed Data Sources for Enhanced Road Segmentation in Synthetic Aperture Radar Images

Cross-Modality Features Fusion for Synthetic Aperture Radar Image Segmentation

SARNet: Spatial Attention Residual Network for pedestrian and vehicle detection in large scenes

MHRA-Net: Azimuth-Aware Multi-Head Residual Self-Attention Network for SAR Vehicle Recognition

A Multiscale Feature Pyramid SAR Ship Detection Network With Robust Background Interference

An Improved SAR Image Semantic Segmentation Deeplabv3+ Network Based on the Feature Post-Processing Module

A Scale-Aware Pyramid Network for Multi-Scale Object Detection in SAR Images

Object-Level Semantic Segmentation on the High-Resolution Gaofen-3 FUSAR-Map Dataset

Multi-Scale Convolutional Neural Network for SAR Image Semantic Segmentation

SEFRNet: An SAR Ship Target Detection Network With Effective Feature Representation

A deep deformable residual learning network for SAR images segmentation

A Mask Attention Interaction and Scale Enhancement Network for SAR Ship Instance Segmentation