SMAPGAN: Generative Adversarial Network-Based Semisupervised Styled Map Tile Generation Method

Xu Chen,Songqiang Chen,Tian Xu,Bangguo Yin,Jian Peng,Xiaoming Mei,Haifeng Li

DOI: https://doi.org/10.1109/tgrs.2020.3021819

IF: 8.2

2021-05-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Traditional online map tiles, which are widely used on the Internet, such as by Google Maps and Baidu Maps, are rendered from vector data. The timely updating of online map tiles from vector data, for which generation is time-consuming, is a difficult mission. Generating map tiles over time from remote sensing images is relatively simple and can be performed quickly without vector data. However, this approach used to be challenging or even impossible. Inspired by image-to-image translation (img2img) techniques based on generative adversarial networks (GANs), we proposed a semisupervised generation of styled map tiles based on the GANs (SMAPGAN) model to generate styled map tiles directly from remote sensing images. In this model, we designed a semisupervised learning strategy to pretrain SMAPGAN on rich unpaired samples and fine-tune it on limited paired samples in reality. We also designed the image gradient L1 loss and the image gradient structure loss to generate a styled map tile with global topological relationships and detailed edge curves for objects, which are important in cartography. Moreover, we proposed the edge structural similarity index (ESSI) as a metric to evaluate the quality of the topological consistency between the generated map tiles and ground truth. The experimental results show that SMAPGAN outperforms state-of-the-art (SOTA) works according to the mean squared error, the structural similarity index, and the ESSI. Also, SMAPGAN gained higher approval than SOTA in a human perceptual test on the visual realism of cartography. Our work shows that SMAPGAN is a new tool with excellent potential for producing styled map tiles. Our implementation of SMAPGAN is available at https://github.com/imcsq/SMAPGAN.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics

What problem does this paper attempt to address?

The paper primarily addresses the issue of directly generating stylized map tiles from remote sensing images and attempts to improve the quality of the generated maps, specifically including the following aspects:

1. **Solving the Update Problem**: Traditional online map services render map tiles based on vector data, which is time-consuming to update. The proposed method can directly generate stylized map tiles from remote sensing images, thereby simplifying this process.

2. **Improving Generation Quality**: Previous works have issues with topological errors and blurred details when generating map tiles. This paper improves these issues by introducing Generative Adversarial Networks (GANs) technology and specific loss functions.

3. **Semi-Supervised Learning Strategy**: Due to the lack of paired samples of remote sensing images and corresponding map tiles, this paper designs a semi-supervised learning strategy that can train the model on limited paired data and a large amount of unpaired data, improving the model's generalization ability.

4. **Innovative Evaluation Metrics**: To better evaluate the quality of the generated map tiles, the paper proposes the Edge Structure Similarity Index (ESSI), a full-reference image quality metric used to measure the topological consistency between the generated map tiles and real maps.

In summary, this paper aims to address the problem of efficiently and high-quality generating stylized map tiles from remote sensing images. By proposing a new method called SMAPGAN, it not only improves the generation speed but also significantly enhances the quality of the generated maps.