Abstract:Segmentation of Agricultural Remote Sensing Images (ARSIs) stands as a pivotal component within the intelligent development path of agricultural information technology. Similarly, quick and effective delineation of urban green spaces (UGSs) in high-resolution images is also increasingly needed as input in various urban simulation models. Numerous segmentation algorithms exist for ARSIs and UGSs; however, a model with exceptional generalization capabilities and accuracy remains elusive. Notably, the newly released Segment Anything Model (SAM) by META AI is gaining significant recognition in various domains for segmenting conventional images, yielding commendable results. Nevertheless, SAM's application in ARSI and UGS segmentation has been relatively limited. ARSIs and UGSs exhibit distinct image characteristics, such as prominent boundaries, larger frame sizes, and extensive data types and volumes. Presently, there is a dearth of research on how SAM can effectively handle various ARSI and UGS image types and deliver superior segmentation outcomes. Thus, as a novel attempt in this paper, we aim to evaluate SAM's compatibility with a wide array of ARSI and UGS image types. The data acquisition platform comprises both aerial and spaceborne sensors, and the study sites encompass most regions of the United States, with images of varying resolutions and frame sizes. It is noteworthy that the segmentation effect of SAM is significantly influenced by the content of the image, as well as the stability and accuracy across images of different resolutions and sizes. However, in general, our findings indicate that resolution has a minimal impact on the effectiveness of conditional SAM-based segmentation, maintaining an overall segmentation accuracy above 90%. In contrast, the unsupervised segmentation approach, SAM, exhibits performance issues, with around 55% of images (3 m and coarser resolutions) experiencing lower accuracy on low-resolution images. Whereas frame size exerts a more substantial influence, as the image size increases, the accuracy of unsupervised segmentation methods decreases extremely fast, and conditional segmentation methods also show some degree of degradation. Additionally, SAM's segmentation efficacy diminishes considerably in the case of images featuring unclear edges and minimal color distinctions. Consequently, we propose enhancing SAM's capabilities by augmenting the training dataset and fine-tuning hyperparameters to align with the demands of ARSI and UGS image segmentation. Leveraging the multispectral nature and extensive data volumes of remote sensing images, the secondary development of SAM can harness its formidable segmentation potential to elevate the overall standard of ARSI and UGS image segmentation.

Accuracy Evaluation of Segmentation for High Resolution Imagery and 3D Laser Point Cloud Data

Accuracy Evaluating Method for Object-Based Segmentation of High Resolution Remote Sensing Image

Toward Evaluating Multiscale Segmentations of High Spatial Resolution Remote Sensing Images

Segmentation of LiDAR Point Clouds Based on Similarity Measures in Multi-Dimensional Euclidean Space

GEOMETRIC ATTRIBUTE ANALYSIS AND SEGMENTATION OF POINT CLOUD

Segmentation Quality Evaluation Using Region-Based Precision and Recall Measures for Remote Sensing Images

Objective Performance Evaluation of Video Segmentation Algorithms with Ground-Truth

Review of 3D Point Cloud Data Segmentation Methods

A Fast and Effective Method for Unsupervised Segmentation Evaluation of Remote Sensing Images

Semantic Segmentation of Terrestrial Laser Scanning Point Clouds Using Locally Enhanced Image-Based Geometric Representations

Quality assessment of building roof segmentation from Airborne LIDAR data

Accuracy Assessment Measures for Object-Based Image Segmentation Goodness

Rethinking Design and Evaluation of 3D Point Cloud Segmentation Models

Integrating segmentation and classification accuracy for accuracy assessment in object-based image analysis

Segmentation Approach for Terrestrial Point Clouds Based on the Integration of Graph Theory and Region Growing

A Multilevel Hierarchical Image Segmentation Method for Urban Impervious Surface Mapping Using Very High Resolution Imagery

Deep-Learning-Based Point Cloud Semantic Segmentation: A Survey

A High Resolution Image Segmentation Method by Combined Structural and Spectral Characteristics

Evaluating the Efficacy of Segment Anything Model for Delineating Agriculture and Urban Green Spaces in Multiresolution Aerial and Spaceborne Remote Sensing Images

An Innovative Approach of Evaluating the Accuracy of Point Cloud Generated by Photogrammetry-Based 3D Reconstruction

Evaluation of Global-Scale and Local-Scale Optimized Segmentation Algorithms in GEOBIA With SAM on Land Use and Land Cover