Abstract:Remote sensing techniques for shoreline extraction are crucial for monitoring changes in erosion rates, surface hydrology, and ecosystem structure. In recent years, Convolutional neural networks (CNNs) have developed as a cutting-edge deep learning technique that has been extensively used in shoreline extraction from remote sensing images, owing to their exceptional feature extraction capabilities. They are progressively replacing traditional methods in this field. However, most CNN models only focus on the features in local receptive fields, and overlook the consideration of global contextual information, which will hamper the model's ability to perform a precise segmentation of boundaries and small objects, consequently leading to unsatisfactory segmentation results. To solve this problem, we propose a parallel semantic segmentation network (TCU-Net) combining CNN and Transformer, to extract shorelines from multispectral remote sensing images, and improve the extraction accuracy. Firstly, TCU-Net imports the Pyramid Vision Transformer V2 (PVT V2) network and ResNet, which serve as backbones for the Transformer branch and CNN branch, respectively, forming a parallel dual-encoder structure for the extraction of both global and local features. Furthermore, a feature interaction module is designed to achieve information exchange, and complementary advantages of features, between the two branches. Secondly, for the decoder part, we propose a cross-scale multi-source feature fusion module to replace the original UNet decoder block, to aggregate multi-scale semantic features more effectively. In addition, a sea-land segmentation dataset covering the Yellow Sea region (GF Dataset) is constructed through the processing of three scenes from Gaofen-6 remote sensing images. We perform a comprehensive experiment with the GF dataset to compare the proposed method with mainstream semantic segmentation models, and the results demonstrate that TCU-Net outperforms the competing models in all three evaluation indices: the PA (pixel accuracy), F1-score, and MIoU (mean intersection over union), while requiring significantly fewer parameters and computational resources compared to other models. These results indicate that the TCU-Net model proposed in this article can extract the shoreline from remote sensing images more effectively, with a shorter time, and lower computational overhead.

Self-Attention Fully Convolutional DenseNets for Automatic Salt Segmentation

Salt3DNet: A Self-Supervised Learning Framework for 3D Salt Segmentation

Attention-Guided Network with Densely Connected Convolution for Skin Lesion Segmentation

Automatic salt deposits segmentation: A deep learning approach

PUB-SalNet: A Pre-Trained Unsupervised Self-Aware Backpropagation Network for Biomedical Salient Segmentation

Deep Learning-based Model for Automatic Salt Rock Segmentation

Semi-Supervised Segmentation of Salt Bodies in Seismic Images using an Ensemble of Convolutional Neural Networks

3D Graph-S<SUP>2</SUP>Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution

Automatic Seismic Salt Interpretation with Deep Convolutional Neural Networks

Deep‐salt: Complete three‐dimensional salt segmentation from inaccurate migrated subsurface offset gathers using deep learning

Salt Detection Using Segmentation of Seismic Image

Enhanced Seismic Data Segmentation Using an Assembled Scse-Res-unet Deep Neural Network

Unbalanced Class Learning Network With Scale-Adaptive Perception for Complicated Scene in Remote Sensing Images Segmentation

Hierarchical Self-Attention Embedded Neural Network With Dense Connection for Remote-Sensing Image Semantic Segmentation

TCUNet: A Lightweight Dual-Branch Parallel Network for Sea-Land Segmentation in Remote Sensing Images

Data Cleansing for Salt Dome Dataset with Noise Robust Network on Segmentation Task

MSGSE-Net: Multi-scale guided squeeze-and-excitation network for subcortical brain structure segmentation

Progressive Scene Segmentation Based on Self-Attention Mechanism.

Attention-Guided Multi-Scale Segmentation Neural Network For Interactive Extraction Of Region Objects From High-Resolution Satellite Imagery

Self-supervised Semantic Segmentation: Consistency over Transformation

Segmentation of Seabed Sediment Images Based on Convolutional Neural Network