Abstract:Segmentation of Agricultural Remote Sensing Images (ARSIs) stands as a pivotal component within the intelligent development path of agricultural information technology. Similarly, quick and effective delineation of urban green spaces (UGSs) in high-resolution images is also increasingly needed as input in various urban simulation models. Numerous segmentation algorithms exist for ARSIs and UGSs; however, a model with exceptional generalization capabilities and accuracy remains elusive. Notably, the newly released Segment Anything Model (SAM) by META AI is gaining significant recognition in various domains for segmenting conventional images, yielding commendable results. Nevertheless, SAM's application in ARSI and UGS segmentation has been relatively limited. ARSIs and UGSs exhibit distinct image characteristics, such as prominent boundaries, larger frame sizes, and extensive data types and volumes. Presently, there is a dearth of research on how SAM can effectively handle various ARSI and UGS image types and deliver superior segmentation outcomes. Thus, as a novel attempt in this paper, we aim to evaluate SAM's compatibility with a wide array of ARSI and UGS image types. The data acquisition platform comprises both aerial and spaceborne sensors, and the study sites encompass most regions of the United States, with images of varying resolutions and frame sizes. It is noteworthy that the segmentation effect of SAM is significantly influenced by the content of the image, as well as the stability and accuracy across images of different resolutions and sizes. However, in general, our findings indicate that resolution has a minimal impact on the effectiveness of conditional SAM-based segmentation, maintaining an overall segmentation accuracy above 90%. In contrast, the unsupervised segmentation approach, SAM, exhibits performance issues, with around 55% of images (3 m and coarser resolutions) experiencing lower accuracy on low-resolution images. Whereas frame size exerts a more substantial influence, as the image size increases, the accuracy of unsupervised segmentation methods decreases extremely fast, and conditional segmentation methods also show some degree of degradation. Additionally, SAM's segmentation efficacy diminishes considerably in the case of images featuring unclear edges and minimal color distinctions. Consequently, we propose enhancing SAM's capabilities by augmenting the training dataset and fine-tuning hyperparameters to align with the demands of ARSI and UGS image segmentation. Leveraging the multispectral nature and extensive data volumes of remote sensing images, the secondary development of SAM can harness its formidable segmentation potential to elevate the overall standard of ARSI and UGS image segmentation.

Accurate, automatic zero-shot wetland mapping from high resolution remote sensing imagery by prompting large foundation model (Segment Anything Model-SAM)

MW‐SAM:Mangrove wetland remote sensing image segmentation network based on segment anything model

The Segment Anything Model (SAM) for Remote Sensing Applications: From Zero to One Shot

Remote Sensing Image Segmentation of Wetlands in Macau Based on Machine Learning

PointSAM: Pointly-Supervised Segment Anything Model for Remote Sensing Images

Evaluating the Efficacy of Segment Anything Model for Delineating Agriculture and Urban Green Spaces in Multiresolution Aerial and Spaceborne Remote Sensing Images

MapSAM: Adapting Segment Anything Model for Automated Feature Detection in Historical Maps

Automated Subpixel Surface Water Mapping From Heterogeneous Urban Environments Using Landsat 8 Oli Imagery

An Applicable and Automatic Method for Earth Surface Water Mapping Based on Multispectral Images

SAModified: A Foundation Model-Based Zero-Shot Approach for Refining Noisy Land-Use Land-Cover Maps

High-Resolution Fine-Grained Wetland Mapping Based on Class-Balanced Deep Semantic Segmentation Networks

Enhancing Crop Mapping through Automated Sample Generation Based on Segment Anything Model with Medium-Resolution Satellite Imagery

Segment Anything Model Combined with Multi-Scale Segmentation for Extracting Complex Cultivated Land Parcels in High-Resolution Remote Sensing Images

Zero-Shot Refinement of Buildings' Segmentation Models using SAM

RSAM-Seg: A SAM-based Approach with Prior Knowledge Integration for Remote Sensing Image Semantic Segmentation

Toward Transferable Water Level Trend Monitoring Using River Cameras: Integrating Domain-Specific Models and Segment Anything Model (SAM) for Water Segmentation

RSPS-SAM: A Remote Sensing Image Panoptic Segmentation Method Based on SAM

SAM-RSIS: Progressively Adapting SAM With Box Prompting to Remote Sensing Image Instance Segmentation

MeSAM: Multiscale Enhanced Segment Anything Model for Optical Remote Sensing Images

Can SAM recognize crops? Quantifying the zero-shot performance of a semantic segmentation foundation model on generating crop-type maps using satellite imagery for precision agriculture

SAM-Assisted Remote Sensing Imagery Semantic Segmentation With Object and Boundary Constraints