Abstract:Aiming at the problem of insignificant target morphological features, inaccurate detection and unclear boundary of small-target regions, and multitarget boundary overlap in multitarget complex image segmentation, combining the image segmentation mechanism of generative adversarial network with the feature enhancement method of nonlocal attention, a generative adversarial network fused with attention mechanism (AM-GAN) is proposed. The generative network in the model is composed of residual network and nonlocal attention module, which use the feature extraction and multiscale fusion mechanism of residual network, as well as feature enhancement and global information fusion ability of nonlocal spatial-channel dual attention to enhance the target features in the detection area and improve the continuity and clarity of the segmentation boundary. The adversarial network is composed of fully convolutional networks, which penalizes the loss of information in small-target regions by judging the authenticity of prediction and label segmentation and improves the detection ability of the generative adversarial model for small targets and the accuracy of multitarget segmentation. AM-GAN can use the GAN’s inherent mechanism that reconstruct and repair high-resolution image, as well as the ability of nonlocal attention global receptive field to strengthen detail features, automatically learn to focus on target structures of different shapes and sizes, highlight salient features useful for specific tasks, reduce the loss of image detail features, improve the accuracy of small-target detection, and optimize the segmentation boundary of multitargets. Taking medical MRI abdominal image segmentation as a verification experiment, multitargets such as liver, left/right kidney, and spleen are selected for segmentation and abnormal tissue detection. In the case of small and unbalanced sample datasets, the class pixels’ accuracy reaches 87.37%, the intersection over union is 92.42%, and the average Dice coefficient is 93%. Compared with other methods in the experiment, the segmentation precision and accuracy are greatly improved. It shows that the proposed method has good applicability for solving typical multitarget image segmentation problems such as small-target feature detection, boundary overlap, and offset deformation.

A froth image segmentation method via generative adversarial networks with multi-scale self-attention mechanism

Optimizing flotation froth image segmentation via parallel branch network and hybrid loss supervision

Generative Adversarial Network Based Cerebrovascular Segmentation for Time-of-flight Magnetic Resonance Angiography Image

Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation

SBSNet: selective branch segmentation network of coal flotation froth images

Online Monitoring of Flotation Froth Bubble-Size Distributions via Multiscale Deblurring and Multistage Jumping Feature-Fused Full Convolutional Networks

BubGAN: Bubble generative adversarial networks for synthesizing realistic bubbly flow images

AF-SEG: an Annotation-Free Approach for Image Segmentation by Self-Supervision and Generative Adversarial Network.

Generative Adversarial Semi-Supervised Network for Medical Image Segmentation

MFFNet: Multi-modal Feature Fusion Network for Instance Segmentation of Froth Flotation Images

Bubble Image Segmentation Based on a Novel Watershed Algorithm With an Optimized Mark and Edge Constraint

Artificial neural network (ANN) modelling to estimate bubble size from macroscopic image and object features

A Generative Adversarial Network Fused with Dual-Attention Mechanism and Its Application in Multitarget Image Fine Segmentation

Medical image segmentation with generative adversarial semi-supervised network

FNeXter: A Multi-Scale Feature Fusion Network Based on ConvNeXt and Transformer for Retinal OCT Fluid Segmentation

SegAN: Adversarial Network with Multi-scale $L_1$ Loss for Medical Image Segmentation

S Seg: A Three-Stage Unsupervised Foreground and Background Segmentation Network

Semantic Segmentation by Improved Generative Adversarial Networks

Multi-Source Fusion Image Semantic Segmentation Model of Generative Adversarial Networks Based on FCN

A Refined Equilibrium Generative Adversarial Network for Retinal Vessel Segmentation

Skin Lesion Segmentation through Generative Adversarial Networks with Global and Local Semantic Feature Awareness