Generating 3D images of material microstructures from a single 2D image: a denoising diffusion approach

Johan Phan,Muhammad Sarmad,Leonardo Ruspini,Gabriel Kiss,Frank Lindseth

DOI: https://doi.org/10.1038/s41598-024-56910-9

IF: 4.6

2024-03-19

Scientific Reports

Abstract:Three-dimensional (3D) images provide a comprehensive view of material microstructures, enabling numerical simulations unachievable with two-dimensional (2D) imaging alone. However, obtaining these 3D images can be costly and constrained by resolution limitations. We introduce a novel method capable of generating large-scale 3D images of material microstructures, such as metal or rock, from a single 2D image. Our approach circumvents the need for 3D image data while offering a cost-effective, high-resolution alternative to existing imaging techniques. Our method combines a denoising diffusion probabilistic model with a generative adversarial network framework. To compensate for the lack of 3D training data, we implement chain sampling, a technique that utilizes the 3D intermediate outputs obtained by reversing the diffusion process. During the training phase, these intermediate outputs are guided by a 2D discriminator. This technique facilitates our method's ability to gradually generate 3D images that accurately capture the geometric properties and statistical characteristics of the original 2D input. This study features a comparative analysis of the 3D images generated by our method, SliceGAN (the current state-of-the-art method), and actual 3D micro-CT images, spanning a diverse set of rock and metal types. The results shown an improvement of up to three times in the Frechet inception distance score, a typical metric for evaluating the performance of image generative models, and enhanced accuracy in derived properties compared to SliceGAN . The potential of our method to produce high-resolution and statistically representative 3D images paves the way for new applications in material characterization and analysis domains.

multidisciplinary sciences

What problem does this paper attempt to address?

The paper aims to address the problem of generating 3D material microstructure images from a single 2D image. Specifically, the study proposes a novel method that can generate large-scale, high-resolution 3D images from a single 2D image without 3D training data. This method combines the Denoising Diffusion Probabilistic Model (DDPM) and the Generative Adversarial Network (GAN) framework, and compensates for the lack of 3D training data through chain sampling techniques. Experimental results show that compared to existing methods, this approach significantly improves the visual quality and statistical properties of the generated images, especially demonstrating greater robustness in handling complex images with high heterogeneity.

In short, the goal of this paper is to provide a new 3D image generation method for the field of material characterization and analysis, aiming to reduce costs and improve efficiency while overcoming the limitations of traditional imaging techniques.