Abstract:Microstructure is key to controlling and understanding the properties of materials, but traditional approaches to describing microstructure capture only a small number of features. We require more complete descriptors of microstructure to enable data-centric approaches to materials discovery, to allow efficient storage of microstructural data and to assist in quality control in metals processing. The concept of microstructural fingerprinting , using machine learning (ML) to develop quantitative, low-dimensional descriptors of microstructures, has recently attracted significant attention. However, it is difficult to interpret conclusions drawn by ML algorithms, which are often referred to as "black boxes". For example, convolutional neural networks (CNNs) can be trained to make predictions about a material from a set of microstructural image data, but the feature space that is learned is often used uncritically and adopted without any validation. Here we explore the use of variational autoencoders (VAEs), comprising a pair of CNNs, which can be trained to produce microstructural fingerprints in a continuous latent space. The VAE architecture also permits the reconstruction of images from fingerprints, allowing us to explore how key features of microstructure are encoded in the latent space of fingerprints. We develop a VAE architecture based on ResNet18 and train it on two classes of Ti-6Al-4V optical micrographs (bimodal and lamellar) as an example of an industrially important alloy where microstructural control is critical to performance. The latent/feature space of fingerprints learned by the VAE is explored in several ways, including by supplying interpolated and randomly perturbed fingerprints to the trained decoder and via dimensionality reduction to explore the distribution and correlation of microstructural features within the latent space of fingerprints. We demonstrate that the fingerprints generated via the trained VAE exhibit smooth, interpolable behaviour with stability to local perturbations, supporting their suitability as general purpose descriptors for microstructure. The analysis of computational results uncover that key properties of the microstructures (volume fraction and grain size) are strongly correlated with position in the encoded feature space, supporting the use of VAE fingerprints for quantitative exploration of process–structure–property relationships.

Exploring descriptors for titanium microstructure via digital fingerprints from variational autoencoders

Exploring descriptors for titanium microstructure via digital fingerprints from variational autoencoders

Digital Fingerprinting of Microstructures

A Novel PCA-based Microstructure Descriptor for Heterogeneous Material Design

A New Method for Classifying and Segmenting Material Microstructure Based on Machine Learning

Image-driven discriminative and generative machine learning algorithms for establishing microstructure-processing relationships

Overview: Computer Vision and Machine Learning for Microstructural Characterization and Analysis

Exploring the microstructure manifold: Image texture representations applied to ultrahigh carbon steel microstructures

Machine learning enabled autonomous microstructural characterization in 3D samples

Overview: Machine Learning for Segmentation and Classification of Complex Steel Microstructures

High throughput quantitative metallography for complex microstructures using deep learning: A case study in ultrahigh carbon steel

Microstructure quality control of steels using deep learning

Enhancing machine learning classification of microstructures: A workflow study on joining image data and metadata in CNN

Unsupervised machine learning and cepstral analysis with 4D-STEM for characterizing complex microstructures of metallic alloys

Computer Vision Methods for the Microstructural Analysis of Materials: The State-of-the-art and Future Perspectives

Three dimensional modeling of complex heterogeneous materials via statistical microstructural descriptors

A Structural Equation Modeling Based Approach for Identifying Key Descriptors in Microstructural Materials Design

Advanced Steel Microstructural Classification by Deep Learning Methods

A Machine Learning Approach for Segmentation and Characterization of Microtextured Regions in a Near-α Titanium Alloy

Integration of Artificial Intelligence into Metallography: Area-wide Analysis of Microstructural Components of a Jominy Sample

Deep learning enhanced Watershed for microstructural analysis using a boundary class semantic segmentation