Abstract:Urban scenes refer to city blocks which are basic units of megacities, they play an important role in citizens’ welfare and city management. Remote sensing imagery with largescale coverage and accurate target descriptions, has been regarded as an ideal solution for monitoring the urban environment. However, due to the heterogeneity of remote sensing images, it is difficult to access their geographical content at the object level, let alone understanding urban scenes at the block level. Recently, deep learning-based strategies have been applied to interpret urban scenes with remarkable accuracies. However, the deep neural networks require a substantial number of training samples which are hard to satisfy, especially for high-resolution images. Meanwhile, the crowed-sourced Open Street Map (OSM) data provides rich annotation information about the urban targets but may encounter the problem of insufficient sampling (limited by the places where people can go). As a result, the combination of OSM and remote sensing images for efficient urban scene recognition is urgently needed. In this paper, we present a novel strategy to transfer existing OSM data to high-resolution images for semantic element determination and urban scene understanding. To be specific, the object-based convolutional neural network (OCNN) can be utilized for geographical object detection by feeding it rich semantic elements derived from OSM data. Then, geographical objects are further delineated into their functional labels by integrating points of interest (POIs), which contain rich semantic terms, such as commercial or educational labels. Lastly, the categories of urban scenes are easily acquired from the semantic objects inside. Experimental results indicate that the proposed method has an ability to classify complex urban scenes. The classification accuracies of the Beijing dataset are as high as 91% at the object-level and 88% at the scene level. Additionally, we are probably the first to investigate the object level semantic mapping by incorporating high-resolution images and OSM data of urban areas. Consequently, the method presented is effective in delineating urban scenes that could further boost urban environment monitoring and planning with high-resolution images.

Semantic segmentation of deep learning remote sensing images based on band combination principle: Application in urban planning and land use

Efficient Patch-Wise Semantic Segmentation for Large-Scale Remote Sensing Images

Semantic Segmentation of Very High-Resolution Remote Sensing Image Based on Multiple Band Combinations and Patchwise Scene Analysis

Evaluation Of Machine Learning-Based Urban Surface Mapping Using A New Moderate-Resolution Satellite Imagery Dataset

Semantic segmentation of urban land classes using a multi-scale dataset

Deep learning-based multi-feature semantic segmentation in building extraction from images of UAV photogrammetry

Semantic Segmentation for Remote Sensing Based on RGB Images and Lidar Data Using Model-Agnostic Meta-Learning and Partical Swarm Optimization

Simultaneous Extraction of Spatial and Attributional Building Information Across Large-Scale Urban Landscapes from High-Resolution Satellite Imagery

Land Use Classification Method of Remote Sensing Images for Urban and Rural Planning Monitoring Using Deep Learning

Semantic Segmentation of Land Cover in Urban Areas by Fusing Multisource Satellite Image Time Series

Research on semantic segmentation algorithm of multispectral remote sensing image based on deep learning

Semantic Segmentation for Urban-Scene Images

A Method for Extracting Building Information from Remote Sensing Images Based on Deep Learning

Evaluation of Deep Learning Semantic Segmentation for Land Cover Mapping on Multispectral, Hyperspectral and High Spatial Aerial Imagery

Deep Learning Segmentation and Classification for Urban Village Using a Worldview Satellite Image Based on U-Net

Multispectral LiDAR Point Cloud Segmentation for Land Cover Leveraging Semantic Fusion in Deep Learning Network

Land Use and Land Cover Mapping Using RapidEye Imagery Based on a Novel Band Attention Deep Learning Method in the Three Gorges Reservoir Area

Efficient Deep Semantic Segmentation for Land Cover Classification Using Sentinel Imagery

Category-sensitive Semi-Supervised Semantic Segmentation Framework for Land-Use/land-cover Mapping with Optical Remote Sensing Images

Exploring semantic elements for urban scene recognition: Deep integration of high-resolution imagery and OpenStreetMap (OSM)

Advancing high-resolution remote sensing: a compact and powerful approach to semantic segmentation