Abstract:Incorporating satellite imagery is crucial for remote sensing and computer vision in socio-economic studies. Machine learning techniques are typically used to extract valuable information from satellite images. This article presents an enhanced approach applying computer vision not only to satellite images but also to five different map sources, such as OpenStreetMap and building footprints. The goal is to determine if useful insights can be derived from simplified feature representations, improving the understanding of fundamental satellite imagery data. We conducted an experiment predicting the settlement patterns of university graduates in Vienna, using a convolutional neural network (CNN) to analyze grid cell images (250 m × 250 m) from satellites and five different maps. The model predicted five density classes of graduates, achieving an accuracy rate of 35.99% using building footprints, outperforming the 35.15% accuracy based on satellite images, while other map representations underperformed. These results suggest that building outlines and the open space between buildings contain vital predictive information. Our findings highlight the potential of this approach beyond socio-economic variables, demonstrating the capability of understanding maps via CNNs.

What problem does this paper attempt to address?

This paper aims to explore the impact of different map representations on socioeconomic predictions, especially beyond the scope of satellite imagery. The researchers not only used satellite images but also introduced five different map sources, including OpenStreetMap and building outlines, to analyze whether these simplified feature representations can provide valuable insights into socioeconomic factors. Through experiments on predicting the residential patterns of graduates from the University of Vienna, they utilized Convolutional Neural Networks (CNN) to analyze images of 250-meter by 250-meter grid cells, attempting to predict graduate distributions in five density levels. The results showed that the prediction accuracy based on building outlines reached 35.99%, surpassing the accuracy of 35.15% based on satellite imagery, while other map representations performed worse. This indicates the crucial role of information from building outlines and open spaces in predictions, highlighting the ability of CNN to understand maps and its potential applications beyond socioeconomic variable prediction. The paper compares various remote sensing representations, from high-resolution satellite imagery to abstract maps such as building outlines and OpenStreetMap's detailed street layout, to explore the effectiveness and impact of these representations in socioeconomic analysis. The study found that even the most simplified map representations, such as binary representations containing only building outlines, may contain sufficient information for computer vision algorithms to accurately predict variables in a socioeconomic context, such as educational levels or wealth distribution. Additionally, the study discusses how contrast, feature noise, and specific map elements (such as tram stations) affect prediction accuracy and points out the correlation between green space, building density, and the residential choices of the educated population. In summary, this paper emphasizes the importance of integrating multiple map data sources in socioeconomic predictions, particularly in identifying key geographic features related to demographic characteristics. It provides a new perspective for understanding the population structure of urban areas and also paves the way for future research in the field of map production and spatial data analysis.

Beyond satellite imagery: the influence of map representations on socio-economic prediction

High Spatial-Resolution Classification of Urban Surfaces Using a Deep Learning Method

Deep Learning-Based Crop Mapping in the Cloudy Season Using One-Shot Hyperspectral Satellite Imagery.

Identifying patterns in urban housing density in developing countries using convolutional networks and satellite imagery

A multi-glimpse deep learning architecture to estimate socioeconomic census metrics in the context of extreme scope variance

Beyond the First Law of Geography: Learning Representations of Satellite Imagery by Leveraging Point-of-Interests

Lightweight and Robust Representation of Economic Scales from Satellite Imagery

Socioeconomic correlations of urban patterns inferred from aerial images: interpreting activation maps of Convolutional Neural Networks

Granularity at Scale: Estimating Neighborhood Socioeconomic Indicators From High-Resolution Orthographic Imagery and Hybrid Learning

Crime Mapping from Satellite Imagery via Deep Learning

A Generalizable and Accessible Approach to Machine Learning with Global Satellite Imagery

Social sensing from street-level imagery: A case study in learning spatio-temporal urban mobility patterns

Mapping Missing Population in Rural India: A Deep Learning Approach with Satellite Imagery

Convolutional neural networks for global human settlements mapping from Sentinel-2 satellite imagery

Learning Representations of Satellite Imagery by Leveraging Point-of-Interests

Tackling the Accuracy-Interpretability Trade-off: Interpretable Deep Learning Models for Satellite Image-based Real Estate Appraisal

Predicting Neighborhood-Level Residential Carbon Emissions from Street View Images Using Computer Vision and Machine Learning

A Deep Learning Approach for Population Estimation from Satellite Imagery

Location, location, location: Satellite image-based real-estate appraisal

Predicting Multi-level Socioeconomic Indicators from Structural Urban Imagery

Using Satellite Imagery for Good: Detecting Communities in Desert and Mapping Vaccination Activities