Abstract:Convolutional Neural Network (CNN) is widely used for semantic segmentation and land-use and land-cover (LULC) mapping of very high-resolution (VHR) remote sensing images. The convolution operation is a powerful method for VHR classification, but the loss of high-frequency detail information caused during its operation decreases the classification accuracy, particularly in the boundary. Thus, it is necessary to supply additional boundary information to the CNN for alleviating this situation. In the classification task (and in LULC mapping), providing more effective information generates a better classification result. Current methods regard the boundary of images as the same category object and process it uniformly, which loses a notable amount of useful information because of the different properties, such as ambiguity and transition, between remote sensing images and their boundaries. Thus, a semantic segmentation method with category boundary for LULC mapping is proposed in this paper. First, a multi-task CNN called the category boundary detection network (CBDN) is designed to extract the boundary information of different category objects. Second, this category boundary and VHR images are used for initial semantic segmentation. Finally, the category boundary and the initial semantic segmentation result (ISSR) are fused to obtain the final LULC map by a two-step strategy, including the explicit fusion and the boundary attention loss function. To verify whether category boundary improved the classification accuracy, a set of comparative experiments were conducted on the International Society for Photogrammetry and Remote Sensing (ISPRS) Vaihingen and Potsdam datasets. The method in this paper was compared with a semantic segmentation method with no boundary information and a semantic segmentation method with global boundary. The results showed that the proposed method in this paper achieved good performances in the Vaihingen (overall accuracy (OA) = 0.924, Kappa coefficient (K) = 0.898, mean F1 score (mF1) = 0.896 and mean Intersection over Union (mIoU) = 0.817) and Potsdam datasets (OA = 0.890, K = 0.857, mF1 = 0.923, and mIoU = 0.860) based on the eroded labels.

Aggregate boundary recognition of asphalt mixture CT images based on convolutional neural networks

Two-Stream Boundary-Aware Neural Network for Concrete Crack Segmentation and Quantification

Convolutional Neural Network for Asphalt Pavement Surface Texture Analysis

Improved Procedure for the 3D Reconstruction of Asphalt Concrete Mesostructures Considering the Similarity of Aggregate Phase Geometry between Adjacent CT Slices

Aggregate particle identification and gradation analysis method based on the deep learning network of Mask R-CNN

Aggregation segregation generative adversarial network (AG-GAN) facilitated multi-scale segregation detection in asphalt pavement paving stage

Robust Detection of Headland Boundary in Paddy Fields from Continuous RGB-D Images Using Hybrid Deep Neural Networks

Rapid extraction of pavement aggregate gradation based on point clouds using deep learning networks

Automatic Inspection and Evaluation System for Pavement Distress

A coarse aggregate particle size classification method by fusing 3D multi‐view and graph convolutional networks

Deep learning-based automated image segmentation for concrete petrographic analysis

Rapid pavement aggregate gradation estimation based on 3D data using a multi-feature fusion network

Stone Segmentation Based on Improved U-Net Network

A cross-channel multi-scale gated fusion network for recognizing construction and demolition waste from high-resolution remote sensing images

High-Accuracy Image Segmentation Based on Hybrid Attention Mechanism for Sandstone Analysis

Innovative method for pavement multiple damages segmentation and measurement by the Road-Seg-CapsNet of feature fusion

Concrete forensic analysis using deep learning-based coarse aggregate segmentation

DCTNET: HYBRID NETWORK MODEL FUSING WITH MULTISCALE DEFORMABLE CNN AND TRANSFORMER STRUCTURE FOR ROAD EXTRACTION FROM GAOFEN SATELLITE REMOTE SENSING IMAGE

Toward enhancing concrete crack segmentation accuracy under complex scenarios: a novel modified U-Net network

A semantic segmentation method with category boundary for Land Use and Land Cover (LULC) mapping of Very-High Resolution (VHR) remote sensing image

Asphalt Pavement Crack Detection Based on Convolutional Neural Network and Infrared Thermography