Deep Learning based Optical Image Super-Resolution via Generative Diffusion Models for Layerwise in-situ LPBF Monitoring

Francis Ogoke,Sumesh Kalambettu Suresh,Jesse Adamczyk,Dan Bolintineanu,Anthony Garland,Michael Heiden,Amir Barati Farimani

2024-09-20

Abstract:The stochastic formation of defects during Laser Powder Bed Fusion (L-PBF) negatively impacts its adoption for high-precision use cases. Optical monitoring techniques can be used to identify defects based on layer-wise imaging, but these methods are difficult to scale to high resolutions due to cost and memory constraints. Therefore, we implement generative deep learning models to link low-cost, low-resolution images of the build plate to detailed high-resolution optical images of the build plate, enabling cost-efficient process monitoring. To do so, a conditional latent probabilistic diffusion model is trained to produce realistic high-resolution images of the build plate from low-resolution webcam images, recovering the distribution of small-scale features and surface roughness. We first evaluate the performance of the model by analyzing the reconstruction quality of the generated images using peak-signal-to-noise-ratio (PSNR), structural similarity index measure (SSIM) and wavelet covariance metrics that describe the preservation of high-frequency information. Additionally, we design a framework based upon the Segment Anything foundation model to recreate the 3D morphology of the printed part and analyze the surface roughness of the reconstructed samples. Finally, we explore the zero-shot generalization capabilities of the implemented framework to other part geometries by creating synthetic low-resolution data.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning

What problem does this paper attempt to address?

This paper attempts to address the issue of defect formation during the Laser Powder Bed Fusion (L-PBF) process. Although L-PBF technology can create parts with fine internal features, defects during the manufacturing process affect its widespread adoption in high-precision applications. These defects may arise from variations in processing parameters, leading to a decline in part quality. Optical monitoring techniques can identify defects through layer-by-layer imaging, but these methods are challenging to scale to high resolution due to cost and memory constraints. To this end, the authors propose a deep learning approach based on a generative diffusion model that links low-cost, low-resolution images with detailed high-resolution optical images, achieving cost-effective process monitoring. Specifically, they trained a conditional latent probability diffusion model to generate realistic high-resolution images from low-resolution webcam images, recovering the distribution of small-scale features and surface roughness. By evaluating the reconstruction quality of the generated images and designing a framework to reconstruct the 3D morphology of printed parts and analyze surface roughness, the authors demonstrated the effectiveness of this method. Additionally, they explored the zero-shot generalization capability of this framework on other part geometries.

Deep Learning based Optical Image Super-Resolution via Generative Diffusion Models for Layerwise in-situ LPBF Monitoring

Thermal Deformation Defect Prediction for Layered Printing Using Convolutional Generative Adversarial Network

Improving Build Quality in Laser Powder Bed Fusion Using High Dynamic Range Imaging and Model-Based Reinforcement Learning

Layer-wise multi-defect detection for laser powder bed fusion using deep learning algorithm with visual explanation

Diffusion generative model-based learning for smart layer-wise monitoring of additive manufacturing

A Layer-Wise Surface Deformation Defect Detection by Convolutional Neural Networks in Laser Powder-Bed Fusion Images

Enhanced detection of surface deformations in LPBF using deep convolutional neural networks and transfer learning from a porosity model

Inexpensive High Fidelity Melt Pool Models in Additive Manufacturing Using Generative Deep Diffusion

In-situ visual monitoring for multi-scale defects detection in laser powder bed fusion

Machine‐Learning‐Based Monitoring of Laser Powder Bed Fusion

A lightweight high-resolution algorithm based on deep learning for layer-wise defect detection in laser powder bed fusion

Traditional machine learning and deep learning for predicting melt-pool cross-sectional morphology of laser powder bed fusion additive manufacturing with thermographic monitoring

A deep learning-based model for defect detection in laser-powder bed fusion using in-situ thermographic monitoring

Deep Learning-Based Monitoring of Laser Powder Bed Fusion Process on Variable Time-Scales Using Heterogeneous Sensing and Operando X-Ray Radiography Guidance

Predicting Laser Powder Bed Fusion Defects Through In-Process Monitoring Data and Machine Learning

A hybrid deep learning model of process-build interactions in additive manufacturing

A Novel Approach of Online Monitoring for Laser Powder Bed Fusion Defects: Air-borne Acoustic Emission and Deep Transfer Learning

Research on an Online Monitoring Device for the Powder Laying Process of Laser Powder Bed Fusion

A physics-guided deep generative model for predicting melt pool behavior in laser powder bed fusion additive manufacturing

In-situ Monitoring in Laser Powder Bed Fusion Based on Acoustic Signal Time-Frequency Synchrosqueezing Transform and Multi-Scale Spatially Interactive Fusion Convolutional Neural Network