Abstract:Image segmentation aims to partition an image according to the objects in the scene and is a fundamental step in analysing very high spatial-resolution (VHR) remote sensing imagery. Current methods struggle to effectively consider land objects with diverse shapes and sizes. Additionally, the determination of segmentation scale parameters frequently adheres to a static and empirical doctrine, posing limitations on the segmentation of large-scale remote sensing images and yielding algorithms with limited interpretability. To address the above challenges, we propose a deep-learning-based region merging method dubbed DeepMerge to handle the segmentation of complete objects in large VHR images by integrating deep learning and region adjacency graph (RAG). This is the first method to use deep learning to learn the similarity and merge similar adjacent super-pixels in RAG. We propose a modified binary tree sampling method to generate shift-scale data, serving as inputs for transformer-based deep learning networks, a shift-scale attention with 3-Dimension relative position embedding to learn features across scales, and an embedding to fuse learned features with hand-crafted features. DeepMerge can achieve high segmentation accuracy in a supervised manner from large-scale remotely sensed images and provides an interpretable optimal scale parameter, which is validated using a remote sensing image of 0.55 m resolution covering an area of 5,660 km^2. The experimental results show that DeepMerge achieves the highest F value (0.9550) and the lowest total error TE (0.0895), correctly segmenting objects of different sizes and outperforming all competing segmentation methods.

Extract and Merge: Superpixel Segmentation with Regional Attributes

High Quality Superpixel Generation Through Regional Decomposition

Superpixel Segmentation Based on Square-Wise Asymmetric Partition and Structural Approximation.

Adaptive Superpixel Segmentation Aggregating Local Contour and Texture Features

Automatic Image Segmentation by Dynamic Region Merging

A Super-pixel Based Method for Instance Segmentation Post-processing

Superpixel Segmentation Based on Delaunay Triangulation

Object Segmentation by Saliency-Seeded and Spatial-Weighted Region Merging

DeepMerge: Deep-Learning-Based Region-Merging for Image Segmentation

Interactive Image Segmentation Based on Hierarchical Superpixels Initialization and Region Merging

Objectness Supervised Merging Algorithm for Color Image Segmentation

The Image Segmentation Based on Optimized Spatial Feature of Superpixel

Adaptive strategy for superpixel-based region-growing image segmentation

Fast Pixel-Superpixel Region Merging for SAR Image Segmentation

Image Segmentation by Position-Edge-Aware Network

Adaptive and Fast Image Superpixel Segmentation Approach.

Interactiveimagesegmentationbymaximalsimilaritybasedregionmerging

From Pixels to Objects: A Hierarchical Approach for Part and Object Segmentation Using Local and Global Aggregation

Efficient Face Segmentation Based on Face Attention Model and Seeded Region Merging

Rethinking Superpixel Segmentation from Biologically Inspired Mechanisms

Semasuperpixel - A Multi-Channel Probability-Driven Superpixel Segmentation Method.