A review of remote sensing image segmentation by deep learning methods

Jiangyun Li,Yuanxiu Cai,Qing Li,Mingyin Kou,Tianxiang Zhang
DOI: https://doi.org/10.1080/17538947.2024.2328827
IF: 4.606
2024-03-20
International Journal of Digital Earth
Abstract:Remote sensing (RS) images enable high-resolution information collection from complex ground objects and are increasingly utilized in the earth observation research. Recently, RS technologies are continuously enhanced by various characterized platforms and sensors. Simultaneously, artificial intelligence vision algorithms are also developing vigorously and playing a significant role in RS image analysis. In particular, aiming to divide images into different ground elements with specific semantic labels, RS image segmentation could realize the visual acquisition and interpretation. As one of the pioneering methods with the advantages of deep feature extraction ability, deep learning (DL) algorithms have been exploited and proved to be highly beneficial for precise segmentation in recent years. In this paper, a comprehensive review is performed on remote sensing survey systems and various kinds of specially designed deep learning architectures. Meanwhile, DL-based segmentation methods applied on four domains are also illustrated, including geography, precision agriculture, hydrology, and environmental protection issues. In the end, the existing challenges and promising research directions in RS image segmentation are discussed. It is envisioned that this review is able to provide a comprehensive and technical reference, deployment and successful exploitation of DL empowered RS image segmentation approaches.
geography, physical,remote sensing
What problem does this paper attempt to address?
This paper primarily addresses the following issues: ### Research Background and Objectives - **Problem Definition**: With the advancement of remote sensing technology and the development of artificial intelligence visual algorithms, how to efficiently and accurately segment remote sensing images using deep learning methods to achieve high-resolution information collection and analysis of complex ground objects. - **Specific Objectives**: - Conduct a comprehensive review of existing remote sensing image segmentation systems and introduce deep learning architectures specifically designed for handling such tasks. - Showcase application cases of segmentation methods based on deep learning in fields such as geography, precision agriculture, hydrology, and environmental protection. - Discuss current challenges and future research directions, providing comprehensive technical references and support for the field of remote sensing image segmentation. ### Key Contributions - **Comprehensive Evaluation**: Covers 160 deep learning algorithms and related methods, providing a comprehensive review of deep learning methods for image segmentation in the field of remote sensing. - **Application Scenario Classification**: Provides detailed introductions to the applications of remote sensing image segmentation methods in four fields: geological applications, precision agriculture, hydrological applications, and environmental protection. - **New Technology Outlook**: Introduces some novel deep learning strategies that may be applied to future remote sensing image analysis. ### Characteristics and Challenges of Remote Sensing Images - **Data Characteristics**: Remote sensing images usually contain multispectral or hyperspectral information and have rich details, which distinguish them from natural images. - **Data Acquisition Cost**: The preprocessing and annotation of remote sensing images require professional knowledge, resulting in relatively few large-scale labeled datasets available. - **Technical Challenges**: Include the computational burden brought by high resolution, effective fusion of multimodal data, and accurate segmentation in complex scenes. Through this review article, the authors aim to provide a comprehensive guide for researchers in the field of remote sensing image segmentation, helping them understand the latest technologies and methods, and pointing out directions for future exploration.