Abstract:Deep learning models in the Earth Observation domain heavily rely on the availability of large-scale accurately labeled satellite imagery. However, obtaining and labeling satellite imagery is a resource-intensive endeavor. While generative models offer a promising solution to address data scarcity, their potential remains underexplored. Recently, Denoising Diffusion Probabilistic Models (DDPMs) have demonstrated significant promise in synthesizing realistic images from semantic layouts. In this paper, a conditional DDPM model capable of taking a semantic map and generating high-quality, diverse, and correspondingly accurate satellite images is implemented. Additionally, a comprehensive illustration of the optimization dynamics is provided. The proposed methodology integrates cutting-edge techniques such as variance learning, classifier-free guidance, and improved noise scheduling. The denoising network architecture is further complemented by the incorporation of adaptive normalization and self-attention mechanisms, enhancing the model's capabilities. The effectiveness of our proposed model is validated using a meticulously labeled dataset introduced within the context of this study. Validation encompasses both algorithmic methods such as Frechet Inception Distance (FID) and Intersection over Union (IoU), as well as a human opinion study. Our findings indicate that the generated samples exhibit minimal deviation from real ones, opening doors for practical applications such as data augmentation. We look forward to further explorations of DDPMs in a wider variety of settings and data modalities. An open-source reference implementation of the algorithm and a link to the benchmarked dataset are provided at <a class="link-external link-https" href="https://github.com/obaghirli/syn10-diffusion" rel="external noopener nofollow">this https URL</a>.

Diff-DEM: A Diffusion Probabilistic Approach to Digital Elevation Model Void Filling

Generative DEM Void Filling With Terrain Feature-Guided Transfer Learning Assisted by Remote Sensing Images

Voids Filling of DEM with Multiattention Generative Adversarial Network Model

Efficient Terrain Stochastic Differential Efficient Terrain Stochastic Differential Equations for Multipurpose Digital Elevation Model Restoration

InSAR Digital Elevation Model Void-Filling Method Based on Incorporating Elevation Outlier Detection

SatDM: Synthesizing Realistic Satellite Image with Semantic Layout Conditioning using Diffusion Models

MapGen-Diff: An End-to-End Remote Sensing Image to Map Generator via Denoising Diffusion Bridge Model

RoofDiffusion: Constructing Roofs from Severely Corrupted Point Data via Diffusion

Conditional Denoising Diffusion Probabilistic Model for Seismic Diffraction Separation and Imaging

Adaptive Semantic-Enhanced Denoising Diffusion Probabilistic Model for Remote Sensing Image Super-Resolution

UDPM: Upsampling Diffusion Probabilistic Models

EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Models

DiffusionEMIS: Diffusion Model for 3-D Electromagnetic Inverse Scattering

DDP: Diffusion Model for Dense Visual Prediction

RSHazeDiff: A Unified Fourier-aware Diffusion Model for Remote Sensing Image Dehazing

Fast LiDAR Upsampling using Conditional Diffusion Models

Learning to Discretize Denoising Diffusion ODEs

EDiffSR: An Efficient Diffusion Probabilistic Model for Remote Sensing Image Super-Resolution

PolyDiffuse: Polygonal Shape Reconstruction via Guided Set Diffusion Models

DiffMap: Enhancing Map Segmentation with Map Prior Using Diffusion Model

gDDIM: Generalized denoising diffusion implicit models