Abstract:Efficient road and building footprint extraction from satellite images are predominant in many remote sensing applications. However, precise segmentation map extraction is quite challenging due to the diverse building structures camouflaged by trees, similar spectral responses between the roads and buildings, and occlusions by heterogeneous traffic over the roads. Existing convolutional neural network (CNN)-based methods focus on either enriched spatial semantics learning for the building extraction or the fine-grained road topology extraction. The profound semantic information loss due to the traditional pooling mechanisms in CNN generates fragmented and disconnected road maps and poorly segmented boundaries for the densely spaced small buildings in complex surroundings. In this paper, we propose a novel attention-aware segmentation framework, Multi-Scale Supervised Dilated Multiple-Path Attention Network (MSSDMPA-Net), equipped with two new modules Dynamic Attention Map Guided Index Pooling (DAMIP) and Dynamic Attention Map Guided Spatial and Channel Attention (DAMSCA) to precisely extract the building footprints and road maps from remotely sensed images. DAMIP mines the salient features by employing a novel index pooling mechanism to retain important geometric information. On the other hand, DAMSCA simultaneously extracts the multi-scale spatial and spectral features. Besides, using dilated convolution and multi-scale deep supervision in optimizing MSSDMPA-Net helps achieve stellar performance. Experimental results over the seven benchmark building and road extraction datasets namely, Porto, Shanghai, Massachusetts Road, Massachusetts Building, Synthinel-1, WHU Satellite I and WHU aerial Imagery dataset, ensures MSSDMPA-Net as the state-of-the-art (SOTA) method for building and road extraction as our method beats the next best alternatives by 5.94%, 2.55%, 3.97%, 11.64%, 6.86%, 6.92%, 2.57% IOU and 3.98%, 1.90%, 2.43%, 7.17%, 3.98%, 4.99%, 1.37% F1 score, respectively, over the mentioned datasets. The code has been released in: https://github.com/shirshabose/MSSDMPA-Net.

Automated Road-Marking Segmentation via a Multiscale Attention-Based Dilated Convolutional Neural Network Using the Road Marking Dataset

Road Traffic Sign Detection Method Based on RTS R-CNN Instance Segmentation Network

Block Multi-Dimensional Attention for Road Segmentation in Remote Sensing Imagery

DPSDA-Net: Dual-Path Convolutional Neural Network with Strip Dilated Attention Module for Road Extraction from High-Resolution Remote Sensing Images

ME-Seg&DLS-Net: A Dataset and a Network for Autonomous Driving Based on Multi-Element Semantic Segmentation of Pavement

A Lightweight High-Resolution RS Image Road Extraction Method Combining Multi-Scale and Attention Mechanism

A Method Based on Multi-Scale Consistency Regularization and Color-Spatial Constraints for Road Segmentation with Noisy Labels

Road Extraction by Multi-scale Deformable Transformer from Remote Sensing Images

Interactive Attention Learning on Detection of Lane and Lane Marking on the Road by Monocular Camera Image

M-SKSNet: Multi-Scale Spatial Kernel Selection for Image Segmentation of Damaged Road Markings

MRENet: Simultaneous Extraction of Road Surface and Road Centerline in Complex Urban Scenes from Very High-Resolution Images

Automated pavement crack detection based on multiscale fully convolutional network

MDMASNet: A dual-task interactive semi-supervised remote sensing image segmentation method

Multiscale Global Attention Network With Edge Perceptron for Automatic Road Extraction From Remote Sensing Imagery

Multiscale probability map guided index pooling with attention-based learning for road and building segmentation

Aerial LaneNet: Lane Marking Semantic Segmentation in Aerial Imagery using Wavelet-Enhanced Cost-sensitive Symmetric Fully Convolutional Neural Networks

Intelligent pixel-level pavement marking detection using 2D laser pavement images

DMA-Net: DeepLab With Multi-Scale Attention for Pavement Crack Segmentation

Multi-class Road Defect Detection and Segmentation using Spatial and Channel-wise Attention for Autonomous Road Repairing

A Novel Multi-Scale Feature Enhancement U-Shaped Network for Pixel-Level Road Crack Segmentation

Dense Multiscale Feature Learning Transformer Embedding Cross-Shaped Attention for Road Damage Detection