Abstract:The production of highly accurate land cover maps is one of the primary challenges in remote sensing, which depends on the spatial resolution of the input images. Sometimes, high-resolution imagery is not available or is too expensive to cover large areas or to perform multitemporal analysis. In this context, we propose a multi-task network to take advantage of the freely available Sentinel-2 imagery to produce a super-resolution image, with a scaling factor of 5, and the corresponding high-resolution land cover map. Our proposal, named SEG-ESRGAN, consists of two branches: the super-resolution branch, that produces Sentinel-2 multispectral images at 2 m resolution, and an encoder–decoder architecture for the semantic segmentation branch, that generates the enhanced land cover map. From the super-resolution branch, several skip connections are retrieved and concatenated with features from the different stages of the encoder part of the segmentation branch, promoting the flow of meaningful information to boost the accuracy in the segmentation task. Our model is trained with a multi-loss approach using a novel dataset to train and test the super-resolution stage, which is developed from Sentinel-2 and WorldView-2 image pairs. In addition, we generated a dataset with ground-truth labels for the segmentation task. To assess the super-resolution improvement, the PSNR, SSIM, ERGAS, and SAM metrics were considered, while to measure the classification performance, we used the IoU, confusion matrix and the F1-score. Experimental results demonstrate that the SEG-ESRGAN model outperforms different full segmentation and dual network models (U-Net, DeepLabV3+, HRNet and Dual_DeepLab), allowing the generation of high-resolution land cover maps in challenging scenarios using Sentinel-2 10 m bands.

A Network for Merging SAR Image Sea-Land Segmentation and Coastline Detection Tasks

A novel sea-land segmentation network for enhanced coastline extraction using satellite remote sensing images

MAEE-Net: SAR Ship Target Detection Network Based on Multi-Input Attention and Edge Feature Enhancement

DAENet: Deformable Attention Edge Network for Automatic Coastline Extraction from Satellite Imagery

Multiscale Sea-Land Segmentation Networks for Weak Boundaries

Combining Segmentation Network and Nonsubsampled Contourlet Transform for Automatic Marine Raft Aquaculture Area Extraction from Sentinel-1 Images

SEFRNet: An SAR Ship Target Detection Network With Effective Feature Representation

Sea-land segmentation method based on an improved MA-Net for Gaofen-2 images

CSEF-Net: Cross-Scale SAR Ship Detection Network Based on Efficient Receptive Field and Enhanced Hierarchical Fusion

SEG-ESRGAN: A Multi-Task Network for Super-Resolution and Semantic Segmentation of Remote Sensing Images

L-ENet: An Ultralightweight SAR Image Detection Network

Efficient Multi-scale Network for Semantic Segmentation of fine-Resolution Remotely Sensed Images

SRMA: a dual-branch parallel multi-scale attention network for remote sensing images sea-land segmentation

A Mask Attention Interaction and Scale Enhancement Network for SAR Ship Instance Segmentation

MSAFNet: Multiscale Successive Attention Fusion Network for Water Body Extraction of Remote Sensing Images

Semantic-Guided Attention Refinement Network for Salient Object Detection in Optical Remote Sensing Images

Stepwise Attention-Guided Multiscale Fusion Network for Lightweight and High-Accurate SAR Ship Detection

Semantic Assistance in SAR Object Detection: A Mask-Guided Approach

Automatic Water Body Extraction from SAR Images Based on MADF-Net

SCAttNet: Semantic Segmentation Network with Spatial and Channel Attention Mechanism for High-Resolution Remote Sensing Images

A position-aware attention network with progressive detailing for land use semantic segmentation of Remote Sensing images