Abstract:The microstructure is a critical factor governing the functionality of ceramic materials. Meanwhile, microstructural analysis of electron microscopy images of polycrystalline ceramics, which are geometrically complex and composed of countless crystal grains with porosity and secondary phases, has generally been performed manually by human experts. Objective pixel-based analysis (semantic segmentation) with high accuracy is a simple but critical step for quantifying microstructures. In this study, we apply neural network-based semantic segmentation to secondary electron images of polycrystalline ceramics obtained by three-dimensional (3D) imaging. The deep-learning-based models (e.g., fully convolutional network and U-Net) by employing a dataset based on a 3D scanning electron microscopy with a focused ion beam is found to be able to recognize defect structures characteristic of polycrystalline materials in some cases due to artifacts in electron microscopy imaging. Owing to the training images with improved depth accuracy, the accuracy evaluation function, intersection over union (IoU) values, reaches 94.6% for U-Net. These IoU values are among the highest for complex ceramics, where the 3D spatial distribution of phases is difficult to locate from a 2D image. Moreover, we employ the learned model to successfully reconstruct a 3D microstructure consisting of giga-scale voxel data in a few minutes. The resolution of a single voxel is 20 nm, which is higher than that obtained using a typical X-ray computed tomography. These results suggest that deep learning with datasets that learn depth information is essential in 3D microstructural quantifying polycrystalline ceramic materials. Additionally, developing improved segmentation models and datasets will pave the way for data assimilation into operando analysis and numerical simulations of in situ microstructures obtained experimentally and for application to process informatics.

Rapid and Flexible Semantic Segmentation of Electron Microscopy Data Using Few-Shot Machine Learning

Uncertainty-aware particle segmentation for electron microscopy at varied length scales

Machine Learning-Enabled Image Classification for Automated Electron Microscopy

MatSAM: Efficient Extraction of Microstructures of Materials via Visual Large Model

Unsupervised Reward-Driven Image Segmentation in Automated Scanning Transmission Electron Microscopy Experiments

Efficient Phase Segmentation of Light-Optical Microscopy Images of Highly Complex Microstructures Using a Correlative Approach in Combination with Deep Learning Techniques

Machine Learning Pipeline for Segmentation and Defect Identification from High Resolution Transmission Electron Microscopy Data

SAM-I-Am: Semantic Boosting for Zero-shot Atomic-Scale Electron Micrograph Segmentation

Machine Learning-Based Multidomain Processing for Texture-Based Image Segmentation and Analysis

Understanding important features of deep learning models for segmentation of high-resolution transmission electron microscopy images

Robust Detection, Segmentation, and Metrology of High Bandwidth Memory 3D Scans Using an Improved Semi-Supervised Deep Learning Approach

Deep Learning for Automated Experimentation in Scanning Transmission Electron Microscopy

Deep learning for three-dimensional segmentation of electron microscopy images of complex ceramic materials

Rapid detection of rare events from in situ X-ray diffraction data using machine learning

Deep Learning of Atomically Resolved Scanning Transmission Electron Microscopy Images: Chemical Identification and Tracking Local Transformations

Preliminary Investigations of a Multi-Faceted Robust and Synergistic Approach in Semiconductor Electron Micrograph Analysis: Integrating Vision Transformers with Large Language and Multimodal Models

Exploring electron-beam induced modifications of materials with machine-learning assisted high temporal resolution electron microscopy

ParticleSeg3D: A Scalable Out-of-the-Box Deep Learning Segmentation Solution for Individual Particle Characterization from Micro CT Images in Mineral Processing and Recycling

Unsupervised segmentation of irradiation$\unicode{x2010}$induced order$\unicode{x2010}$disorder phase transitions in electron microscopy

Machine Learning for Microscopy Data Analysis: Toward Real-time Optical and Electrical Characterization of Sub-micron Materials

Performance, Successes and Limitations of Deep Learning Semantic Segmentation of Multiple Defects in Transmission Electron Micrographs