Abstract:Clouds lead to missing or distorted land-related information in impacted areas in optical remote sensing images. Cloud masking, which labels cloud-contaminated pixels, forms the basis for subsequent image utilization, such as excluding the distorted pixel or filling in the missing area. However, due to the diverse spectral, textural, and shape characteristics of different clouds and complicated combinations with the underlying land surfaces, cloud masking has become a challenge in remote sensing image processing. In recent years, the Mask region-based convolutional neural network (R-CNN) method, which performs instance segmentation from a complex background and generates a pixelwise mask for the object of interest, has been used widely in object segmentation tasks. When the Mask R-CNN method is used for cloud masking, the mask result has certain problems, such as failing to extract uncommon clouds and outputting inaccurate mask boundaries for large clouds. To address these problems, we introduce two strategies, group training and boundary optimization, to improve the Mask R-CNN. For group training, samples are divided into several groups. The samples in the first group are used for the initial training, and the samples in the next group are used for evaluation. Only samples with missing or falsely detected clouds are used for tuning the classifier; then, these processes are repeated until all groups have been used or the detection precision becomes stable. For boundary optimization, a block-by-block mask strategy is adopted to guarantee that clouds with diverse sizes have similar performances. Finally, two open data sets and one data set labelled by ourselves are selected to test the proposed method, and the results demonstrate that our method can produce cloud masks for different cloud types and diverse underlying land surfaces and can achieve high accuracies, thereby providing an effective alternative for cloud masking. Compared with the original Mask R-CNN method, our method improves the average recall, average precision, and intersection over union by 5.88%, 2.4%, and 0.071 in pixel level, respectively, demonstrating the effectiveness of our improvement.

A remote sensing image target recognition method based on improved Mask-RCNN model

Remote sensing image segmentation based on improved Mask-RCNN

Improved Mask R-CNN for Aircraft Detection in Remote Sensing Images

Remote Sensing Image Target Detection Method Based on Refined Feature Extraction

Research on efficient detection network method for remote sensing images based on self attention mechanism

Remote Sensing Object Detection in Disturbed Environment Based on Improved RTMDet Network

Object detection of face mask recognition based on improved faster rcnn

Object Detection and Instance Segmentation in Remote Sensing Imagery Based on Precise Mask R-CNN

An improved mask-RCNN algorithm for UAV TIR video stream target detection

Improved mask R-CNN-based cloud masking method for remote sensing images

Unmanned aerial vehicle reconnaissance image recognition based on convolutional neural network

A Multi-Scale Target Detection Method Using an Improved Faster Region Convolutional Neural Network Based on Enhanced Backbone and Optimized Mechanisms

An Efficient Target Detection and Recognition Method in Aerial Remote-sensing Images Based on Multiangle Regions-of-Interest

Research on Target Recognition Technology of Satellite Remote Sensing Image Based on Neural Network

High-Resolution Remote Sensing Image Information Extraction and Target Recognition Based on Multiple Information Fusion

Object detection of aerial image using mask-region convolutional neural network (mask R-CNN)

Research on Unmanned Infrared Night Vision System Based on Improved Faster R-CNN Target Detection Algorithm

Techniques for the Automatic Detection and Hiding of Sensitive Targets in Emergency Mapping Based on Remote Sensing Data

A Crop Image Segmentation and Extraction Algorithm Based on Mask RCNN

Improved remote sensing image target detection based on YOLOv7