Abstract:Aiming at the problem of insignificant target morphological features, inaccurate detection and unclear boundary of small-target regions, and multitarget boundary overlap in multitarget complex image segmentation, combining the image segmentation mechanism of generative adversarial network with the feature enhancement method of nonlocal attention, a generative adversarial network fused with attention mechanism (AM-GAN) is proposed. The generative network in the model is composed of residual network and nonlocal attention module, which use the feature extraction and multiscale fusion mechanism of residual network, as well as feature enhancement and global information fusion ability of nonlocal spatial-channel dual attention to enhance the target features in the detection area and improve the continuity and clarity of the segmentation boundary. The adversarial network is composed of fully convolutional networks, which penalizes the loss of information in small-target regions by judging the authenticity of prediction and label segmentation and improves the detection ability of the generative adversarial model for small targets and the accuracy of multitarget segmentation. AM-GAN can use the GAN’s inherent mechanism that reconstruct and repair high-resolution image, as well as the ability of nonlocal attention global receptive field to strengthen detail features, automatically learn to focus on target structures of different shapes and sizes, highlight salient features useful for specific tasks, reduce the loss of image detail features, improve the accuracy of small-target detection, and optimize the segmentation boundary of multitargets. Taking medical MRI abdominal image segmentation as a verification experiment, multitargets such as liver, left/right kidney, and spleen are selected for segmentation and abnormal tissue detection. In the case of small and unbalanced sample datasets, the class pixels’ accuracy reaches 87.37%, the intersection over union is 92.42%, and the average Dice coefficient is 93%. Compared with other methods in the experiment, the segmentation precision and accuracy are greatly improved. It shows that the proposed method has good applicability for solving typical multitarget image segmentation problems such as small-target feature detection, boundary overlap, and offset deformation.

Melt pool segmentation for additive manufacturing: A generative adversarial network approach

Thermal Deformation Defect Prediction for Layered Printing Using Convolutional Generative Adversarial Network

Automated Segmentation and Analysis of Microscopy Images of Laser Powder Bed Fusion Melt Tracks

Synthetic-to-real Composite Semantic Segmentation in Additive Manufacturing

Thermal Field Prediction for Welding Paths in Multi-Layer Gas Metal Arc Welding-Based Additive Manufacturing: A Machine Learning Approach

A semantic segmentation algorithm for automated rapid melt pool identification from cross-sectional micrographs

AM-SegNet for additive manufacturing in situ X-ray image segmentation and feature quantification

A New GAN-Based Approach to Data Augmentation and Image Segmentation for Crack Detection in Thermal Imaging Tests

IRT-GAN: A GAN Framework for Automated Defect Segmentation in Composites Using Infrared Thermography

A Deep Learning Method for Material Performance Recognition in Laser Additive Manufacturing

Diffusion generative model-based learning for smart layer-wise monitoring of additive manufacturing

IRT-GAN: A Generative Adversarial Network with a Multi-Headed Fusion Strategy for Automated Defect Detection in Composites Using Infrared Thermography

Image segmentation of exfoliated two-dimensional materials by generative adversarial network-based data augmentation

A Generative Adversarial Network Fused with Dual-Attention Mechanism and Its Application in Multitarget Image Fine Segmentation

FEGAN: A Feature-Oriented Enhanced GAN for Enhancing Thermal Image Super-Resolution

A Hybrid Deep Generative Network for Pore Morphology Prediction in Metal Additive Manufacturing

Exploring efficient and effective generative adversarial network for thermal infrared image colorization

TIG Stainless Steel Molten Pool Contour Detection and Weld Width Prediction Based on Res-Seg

Anomaly Detection in Additive Manufacturing Processes using Supervised Classification with Imbalanced Sensor Data based on Generative Adversarial Network

In-situ capture of melt pool signature in selective laser melting using U-Net-based convolutional neural network

Automated Segmentation of Large Image Datasets using Artificial Intelligence for Microstructure Characterisation, Damage Analysis and High-Throughput Modelling Input