Abstract:Online maps play an essential role in modern life. The convenience of acquiring remote sensing images provides reliable geographic information sources for the compilation of online maps. Some existing works have used the idea of domain mapping to translate remote sensing images into maps directly, which is of great prospect for application. However, many of the current remote sensing image-to-map translation (RSMT) works are performed in an unsupervised manner, which would lead to problems such as distortion and local detail inaccuracy. Although the fully supervised method is effective, it requires plenty of paired as well as matched data for training. Paired remote sensing images and maps with consistent spatial locations can be easily accessed through online map services, whereas many pairs of samples in which some geographic element information is not accurately and completely matched. Supervised learning-based translation models are often confused by these unmatched data. Accurate and complete matched data have to be selected deliberately by humans, and the manual selection process is time-consuming and laborious, which brings new challenges. Therefore, we propose a novel RSMT model named Semi-MapGen based on semisupervised generative adversarial networks (GANs), which requires only a small set of accurate and complete matched data and plenty of unpaired data. In this model, we apply a knowledge extension-based learning strategy that can improve the accuracy of translated maps. In addition, we design the expansion loss and channelwise loss to learn the information from massive unpaired data in an unsupervised manner. Qualitative and quantitative experiment results on three datasets demonstrate that the proposed model outperforms state-of-the-art semisupervised and supervised methods.

Weakly Supervised Concept Map Generation through Task-Guided Graph Translation

Query-focused Multi-document Summarization: Combining a Novel Topic Model with Graph-based Semi-supervised Learning

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

CycleGT: Unsupervised Graph-to-Text and Text-to-Graph Generation via Cycle Training

Unsupervised Graph-Text Mutual Conversion with a Unified Pretrained Language Model

Deep Graph Translation

Research on a New Automatic Generation Algorithm of Concept Map Based on Text Clustering and Association Rules Mining

Research on a new automatic generation algorithm of concept map based on text analysis and association rules mining

Learning to Generate CGs from Domain Specific Sentences

Metaphor Generation with Conceptual Mappings

CMMQC: Cascaded Multi-Model Quality Control for Unsupervised Data-to-Text Generation

Scaling Concept With Text-Guided Diffusion Models

Generating Semantic Concept Map for MOOCs.

INFINITY: A Simple Yet Effective Unsupervised Framework for Graph-Text Mutual Conversion

MapGen-GAN: A Fast Translator for Remote Sensing Image to Map Via Unsupervised Adversarial Learning

Guiding Topic Flows in the Generative Chatbot by Enhancing the ConceptNet with the Conversation Corpora

Semi-MapGen: Translation of Remote Sensing Image Into Map via Semisupervised Adversarial Learning

Unsupervised Task Graph Generation from Instructional Video Transcripts

Group Diffusion Transformers are Unsupervised Multitask Learners

Towards Fine-Grained Concept Generation.

Generalized Graph Embedding Models