Abstract:The identification of wear rubber balls in the rubber ball cleaning system in heat exchange equipment directly affects the descaling efficiency. For the problem that the rubber ball image contains impurities and bubbles and the segmentation is low in real time, a multi-scale feature fusion real-time instance segmentation model based on the attention mechanism is proposed for the object segmentation of the rubber ball images. First, we introduce the Pyramid Vision Transformer instead of the convolution module in the backbone network and use the spatial-reduction attention layer of the transformer to improve the feature extraction ability across scales and spatial reduction to reduce computational cost; Second, we improve the feature fusion module to fuse image features across scales, combined with an attention mechanism to enhance the output feature representation; Third, the prediction head separates the mask branches separately. Combined with dynamic convolution, it improves the accuracy of the mask coefficients and increases the number of upsampling layers. It also connects the penultimate layer with the second layer feature map to achieve detection of smaller images with larger feature maps to improve the accuracy. Through the validation of the produced rubber ball dataset, the Dice score, Jaccard coefficient, and mAP of the actual segmented region of this network with the rubber ball dataset are improved by 4.5%, 4.7%, and 7.73%, respectively, and our model achieves 33.6 fps segmentation speed and 79.3% segmentation accuracy. Meanwhile, the average precision of Box and Mask can also meet the requirements under different IOU thresholds. We compared the DeepMask, Mask R-CNN, BlendMask, SOLOv1 and SOLOv2 instance segmentation networks with this model in terms of training accuracy and segmentation speed and obtained good results. The proposed modules can work together to better handle object details and achieve better segmentation performance.

Semi-Symmetrical, Fully Convolutional Masked Autoencoder for TBM Muck Image Segmentation

Multi Mask Learning of Stone Segmentation for Auto-Monitoring System in TBM Construction

Tissue-Contrastive Semi-Masked Autoencoders for Segmentation Pretraining on Chest CT

Masked Image Modeling Boosting Semi-Supervised Semantic Segmentation

Masked Topology Convolutional Network for Classification and Segmentation of Remote Sensing Images

HMT-UNet: A hybird Mamba-Transformer Vision UNet for Medical Image Segmentation

Masked Feature Modeling for Generative Self-Supervised Representation Learning of High-Resolution Remote Sensing Images

Multi-Scale Masked 3-D U-Net For Brain Tumor Segmentation

Advancing Volumetric Medical Image Segmentation via Global-Local Masked Autoencoder

HybridMIM: A Hybrid Masked Image Modeling Framework for 3D Medical Image Segmentation

CD-MAE: Contrastive Dual-Masked Autoencoder Pre-Training Model for PCB CT Image Element Segmentation

Multi-Granularity Denoising and Bidirectional Alignment for Weakly Supervised Semantic Segmentation

Learning with Unmasked Tokens Drives Stronger Vision Learners

GMIM: Self-supervised pre-training for 3D medical image segmentation with adaptive and hierarchical masked image modeling

Enhancing Semi-Supervised Medical Image Segmentation with Bidirectional Copy-Paste and Masked Image Reconstruction

Learning Content-enhanced Mask Transformer for Domain Generalized Urban-Scene Segmentation

A Multiscale Instance Segmentation Method Based on Cleaning Rubber Ball Images

Efficient Masked Autoencoders with Self-Consistency

Tube Masking-Based MAE Pre-Training for Three-Dimensional Lumbar Vertebrae Segmentation

L-MAE: Masked Autoencoders are Semantic Segmentation Datasets Augmenter

Feature-enhanced Adversarial Semi-supervised Semantic Segmentation Network for Pulmonary Embolism Annotation