Grain and Grain Boundary Segmentation using Machine Learning with Real and Generated Datasets

Peter Warren,Nandhini Raju,Abhilash Prasad,Shajahan Hossain,Ramesh Subramanian,Jayanta Kapat,Navin Manjooran,Ranajay Ghosh

2023-07-12

Abstract:We report significantly improved accuracy of grain boundary segmentation using Convolutional Neural Networks (CNN) trained on a combination of real and generated data. Manual segmentation is accurate but time-consuming, and existing computational methods are faster but often inaccurate. To combat this dilemma, machine learning models can be used to achieve the accuracy of manual segmentation and have the efficiency of a computational method. An extensive dataset of from 316L stainless steel samples is additively manufactured, prepared, polished, etched, and then microstructure grain images were systematically collected. Grain segmentation via existing computational methods and manual (by-hand) were conducted, to create "real" training data. A Voronoi tessellation pattern combined with random synthetic noise and simulated defects, is developed to create a novel artificial grain image fabrication method. This provided training data supplementation for data-intensive machine learning methods. The accuracy of the grain measurements from microstructure images segmented via computational methods and machine learning methods proposed in this work are calculated and compared to provide much benchmarks in grain segmentation. Over 400 images of the microstructure of stainless steel samples were manually segmented for machine learning training applications. This data and the artificial data is available on Kaggle.

Materials Science,Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the accuracy of grain and grain - boundary segmentation in materials science, especially in the microstructure analysis of metallic materials. Traditional methods, such as manual segmentation, are accurate but time - consuming, while existing computational methods are fast but often inaccurate. To overcome the limitations of these methods, the paper proposes a new method, that is, using convolutional neural networks (CNN) combined with real data and generated data for training to achieve high - precision grain and grain - boundary segmentation. Specifically, the main contributions of the paper include: 1. **Dataset construction**: A large number of microstructure images of 316L stainless - steel samples were collected through experiments and manually segmented as "real" training data. 2. **Artificial data generation**: A new method based on Voronoi tessellations and randomly synthesized noise was developed to generate artificial grain images to supplement the real data and improve the training effect of the machine - learning model. 3. **Model training and evaluation**: The CNN model was trained using the generated data and the real data, and the segmentation accuracy of the model was evaluated by multiple metrics (such as Dice score and intersection - over - union IoU). Through these methods, the paper aims to provide an efficient and accurate grain and grain - boundary segmentation scheme, thereby promoting the research progress in the field of materials science.

Grain and Grain Boundary Segmentation using Machine Learning with Real and Generated Datasets

Automated Grain Boundary (GB) Segmentation and Microstructural Analysis in 347H Stainless Steel Using Deep Learning and Multimodal Microscopy

Spatiotemporal Evolution of Grain Microstructure: A CNN Perspective

Automatic Detection of Grains in Partially Recrystallized Microstructures Using Deep Learning

Human Perception-Inspired Grain Segmentation Refinement Using Conditional Random Fields

Optimized and autonomous machine learning framework for characterizing pores, particles, grains and grain boundaries in microstructural images

Automated Grain Boundary Detection for Bright-Field Transmission Electron Microscopy Images via U-Net

GrainGNN: A dynamic graph neural network for predicting 3D grain microstructure

Generative adversarial networks assisted machine learning based automated quantification of grain size from scanning electron microscope back scatter images

Many-Scale Investigations of the Deformation Behavior of Polycrystalline Composites: I-Machine Learning Applied for Image Segmentation

Revealing in-plane grain boundary composition features through machine learning from atom probe tomography data

Predicting grain boundary damage by machine learning

Deep-Learning-Based Automatic Mineral Grain Segmentation and Recognition

High throughput quantitative metallography for complex microstructures using deep learning: A case study in ultrahigh carbon steel

Machine-Learning Informed Representations for Grain Boundary Structures

Deep Neural Networks for Automatic Grain-matrix Segmentation in Plane and Cross-polarized Sandstone Photomicrographs

3D Grain Shape Generation in Polycrystals Using Generative Adversarial Networks

An automatic segmentation and quantification method for austenite and ferrite phases in duplex stainless steel based on deep learning

A Machine Learning Framework for the Prediction of Grain Boundary Segregation in Chemically Complex Environments

Automated Copper Alloy Grain Size Evaluation Using a Deep-learning CNN

Automated Segmentation of Large Image Datasets using Artificial Intelligence for Microstructure Characterisation, Damage Analysis and High-Throughput Modelling Input