Abstract:High spatial resolution (HSR) remote sensing (RS) images inevitably pose the challenge of multiscale transformation, as small objects, such as cars and helicopters (HCs), may occupy only a few pixel points. This incurs a significant hurdle for global context modeling, particularly in backbone networks with large downsampling coefficients. Simple summation or concatenation techniques, such as skip connections, fail to address semantic gaps and even impose negative impacts on multiscale feature fusion. Meanwhile, due to the complexity of foreground objects, the boundary details of HSR RS images are easy to lose in sampling operations. To overcome these challenges, we propose a multiscale channelwise cross attention network (MCCANet) assisted by boundary supervision (BS). Technically, MCCA captures the channel attention (CA) with various scales, which allows dynamic and adaptive feature fusion in a contextual scale-aware manner and focuses on both large and small objects distributed throughout the inputs. Besides, a channel and context strainer (CCS) module is proposed and embedded in MCCA, filtering channels and contexts for the mitigation of intraclass differences. In addition, we apply a BS module to recover boundary contour, avoiding the blurring effect during the construction of contextual information. The refined boundary allows for the effective recognition of surrounding pixels, ensuring a better segmentation performance. Extensive experiments on the instance segmentation in aerial images dataset (iSAID), International Society for Photogrammetry and Remote Sensing (ISPRS) Potsdam, and land-cover domain adaptive (LoveDA) datasets demonstrate that our proposed MCCANet achieves a good balance of high accuracy and efficiency. Code will be available at: https://github.com/ZhengJianwei2/MCCANet.

Panoramic image semantic segmentation using channel attention-based HarDNet and distorted boundary learning

Omnisupervised Omnidirectional Semantic Segmentation

Can We PASS Beyond the Field of View? Panoramic Annular Semantic Segmentation for Real-World Surrounding Perception

A New Deep Distortion Convolutional Neural Network for Semantic Segmentation of Panoramic Images

AinnoSeg: Panoramic Segmentation with High Perfomance

Is Context-Aware CNN Ready for the Surroundings? Panoramic Semantic Segmentation in the Wild

The Application of Panoramic Segmentation Network to Medical Image Segmentation

E2LNet: An Efficient and Effective Lightweight Network for Panoramic Depth Estimation

Accurate Semantic Segmentation in Remote Sensing Image.

DEANet: Dual Encoder with Attention Network for Semantic Segmentation of Remote Sensing Imagery

Panoramic Panoptic Segmentation: Insights Into Surrounding Parsing for Mobile Agents via Unsupervised Contrastive Learning

Aerial Image Semantic Segmentation Using Spatial and Channel Attention

Look at the Neighbor: Distortion-aware Unsupervised Domain Adaptation for Panoramic Semantic Segmentation

Panoramic Panoptic Segmentation: Towards Complete Surrounding Understanding via Unsupervised Contrastive Learning

Real-time Panoptic Segmentation with Relationship Between Adjacent Pixels and Boundary Prediction

Laformer: Vision Transformer for Panoramic Image Semantic Segmentation

Semantic Segmentation Algorithm of Remote Sensing Images Based on Improved Panoptic

Panoramic Image Depth Estimation Based on Deformable Convolution and Attention Mechanism

Semantic Segmentation of Panoramic Images Using a Synthetic Dataset

Capturing Omni-Range Context for Omnidirectional Segmentation

Remote Sensing Semantic Segmentation via Boundary Supervision-Aided Multiscale Channelwise Cross Attention Network