Abstract:Clouds lead to missing or distorted land-related information in impacted areas in optical remote sensing images. Cloud masking, which labels cloud-contaminated pixels, forms the basis for subsequent image utilization, such as excluding the distorted pixel or filling in the missing area. However, due to the diverse spectral, textural, and shape characteristics of different clouds and complicated combinations with the underlying land surfaces, cloud masking has become a challenge in remote sensing image processing. In recent years, the Mask region-based convolutional neural network (R-CNN) method, which performs instance segmentation from a complex background and generates a pixelwise mask for the object of interest, has been used widely in object segmentation tasks. When the Mask R-CNN method is used for cloud masking, the mask result has certain problems, such as failing to extract uncommon clouds and outputting inaccurate mask boundaries for large clouds. To address these problems, we introduce two strategies, group training and boundary optimization, to improve the Mask R-CNN. For group training, samples are divided into several groups. The samples in the first group are used for the initial training, and the samples in the next group are used for evaluation. Only samples with missing or falsely detected clouds are used for tuning the classifier; then, these processes are repeated until all groups have been used or the detection precision becomes stable. For boundary optimization, a block-by-block mask strategy is adopted to guarantee that clouds with diverse sizes have similar performances. Finally, two open data sets and one data set labelled by ourselves are selected to test the proposed method, and the results demonstrate that our method can produce cloud masks for different cloud types and diverse underlying land surfaces and can achieve high accuracies, thereby providing an effective alternative for cloud masking. Compared with the original Mask R-CNN method, our method improves the average recall, average precision, and intersection over union by 5.88%, 2.4%, and 0.071 in pixel level, respectively, demonstrating the effectiveness of our improvement.

Research on Fuzzy Image Instance Segmentation Based on Improved Mask R-CNN

A Simultaneous Object Detection and Component Segmentation Approach Based on Mask R-CNN

Remote sensing image segmentation based on improved Mask-RCNN

Matting Enhanced Mask R-CNN

Improving Semantic Image Segmentation with a Probabilistic Superpixel-Based Dense Conditional Random Field.

Mask R-Cnn With Feature Pyramid Attention For Instance Segmentation

Improved mask R-CNN-based cloud masking method for remote sensing images

A Mask R-Cnn Model With Improved Region Proposal Network For Medical Ultrasound Image

Mask-R-FCN: A Deep Fusion Network for Semantic Segmentation.

Fully Convolutional Networks for Automatically Generating Image Masks to Train Mask R-CNN

Improvement of Road Instance Segmentation Algorithm Based on the Modified Mask R-CNN

SimpleMask: parameter link and efficient instance segmentation

MaskPlus: Improving Mask Generation for Instance Segmentation

Image Semantic Segmentation Use Multiple-Threshold Probabilistic R-CNN with Feature Fusion

RefineMask: Towards High-Quality Instance Segmentation with Fine-Grained Features

Fine Segmentation on Faces With Masks Based on a Multistep Iterative Segmentation Algorithm

Boundary-preserving Mask R-CNN

An Improved Mask R-CNN Example Segmentation Algorithm Based on RGB-D

Object Detection and Instance Segmentation in Remote Sensing Imagery Based on Precise Mask R-CNN

Skin Lesion Segmentation Based on Mask R-CNN