Abstract:Road detection based on convolutional neural networks (CNNs) has achieved remarkable performances for very high resolution (VHR) remote sensing images. However, this approach relies on massive annotated samples, and the problem of limited generalization for unseen images still remains. The manual pixel-level labeling process is also extremely time-consuming, and the performance of CNNs degrades significantly when there is a domain gap between the training and test images. In this paper, to address this problem, a global-local adversarial learning (GOAL) framework is proposed for cross-domain road detection. On the one hand, considering the spatial information similarities between the source and target domains, feature space driven adversarial learning is applied to explore the shared features across domains. On the other hand, the complex background of VHR remote sensing images, such as the occlusions and shadows of trees and buildings, makes some roads easy to recognize, while others are much more difficult. However, the traditional global adversarial learning approach cannot guarantee local semantic consistency. Therefore, a local alignment operation is introduced, which adaptively adjusts the weight of the adversarial loss according to the road recognition difficulty. Extensive experiments were conducted on different road datasets, including two public competition road datasets-SpaceNet and DeepGlobe-and our own large-scale annotated images from four cities: Boston, Birmingham, Shanghai, and Wuhan. The experimental results show that the proposed GOAL framework can clearly improve the cross-domain road detection performance, without any annotation of the target domain images. For instance, taking SpaceNet road dataset as the source domain, compared with the no adaptation method, the IOU performance of GOAL framework is increased by 14.36%, 5.49%, 4.51%, 5.63% and 15.14% on DeepGlobe, Boston, Birmingham, Shanghai, and Wuhan images, respectively, which demonstrates its strong generalization capability.

Cross-Domain Traffic Scene Understanding: A Dense Correspondence-Based Transfer Learning Approach

Cross-domain Residual Deep NMF for Transfer Learning Between Different Hyperspectral Image Scenes.

A Benchmark for Cross-Weather Traffic Scene Understanding

Vehicle-Related Scene Understanding Using Deep Learning

A Review on Cross Weather Traffic Scene Understanding Using Transfer Learning for Intelligent Transport System

Cross-domain Road Detection Based on Global-Local Adversarial Learning Framework from Very High Resolution Satellite Imagery

A General Transitive Transfer Learning Framework for Cross-Optical Sensor Remote Sensing Image Scene Understanding

A Parallel Teacher for Synthetic-to-Real Domain Adaptation of Traffic Object Detection

Dense-ACSSD for End-to-end Traffic Scenes Recognition

Scene recognition under special traffic conditions based on deep multi‐task learning

Cross-Domain Ground-Based Cloud Classification Based on Transfer of Local Features and Discriminative Metric Learning

Cross-Modality Bridging and Knowledge Transferring for Image Understanding

Domain Adaptive Multigranularity Proposal Network for Text Detection under Extreme Traffic Scenes.

Cross-view object classification in traffic scene surveillance based on transductive transfer learning

Deep Integration: A Multi-Label Architecture for Road Scene Recognition

Enhancing road surface recognition via optimal transport and metric learning in task-agnostic intelligent driving environments

Traffic Prediction with Transfer Learning: A Mutual Information-based Approach

Multi-Task Learning for Automotive Foggy Scene Understanding via Domain Adaptation to an Illumination-Invariant Representation

Cross‐scene pavement distress detection by a novel transfer learning framework

Cross-Transfer Learning for Enhancing Object Detection in Remote Sensing Images

TrafficLoc: Localizing Traffic Surveillance Cameras in 3D Scenes