Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectives

Yidan Liu,Jun Yue,Shaobo Xia,Pedram Ghamisi,Weiying Xie,Leyuan Fang
DOI: https://doi.org/10.1109/tgrs.2024.3464685
IF: 8.2
2024-10-08
IEEE Transactions on Geoscience and Remote Sensing
Abstract:As a newly emerging advance in deep generative models, diffusion models have achieved state-of-the-art results in many fields, including computer vision, natural language processing, and molecule design. The remote sensing (RS) community has also noticed the powerful ability of diffusion models and quickly applied them to a variety of tasks for image processing. Given the rapid increase in research on diffusion models in the field of RS, it is necessary to conduct a comprehensive review of existing diffusion model-based RS papers, to help researchers recognize the potential of diffusion models and provide some directions for further exploration. Specifically, this article first introduces the theoretical background of diffusion models, and then systematically reviews the applications of diffusion models in RS, including image generation, enhancement, and interpretation. Finally, the limitations of existing RS diffusion models and worthy research directions for further exploration are discussed and summarized.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
What problem does this paper attempt to address?