Abstract:Early detection of defects, such as keyhole pores and cracks is crucial in laser-directed energy deposition (L-DED) additive manufacturing (AM) to prevent build failures. However, the complex melt pool behaviour cannot be adequately captured by conventional single-modal process monitoring approaches. This study introduces a multisensor fusion-based digital twin (MFDT) for localized quality prediction in the robotic L-DED process. The data used in multisensor fusion includes features extracted from a coaxial melt pool vision camera, a microphone, and an off-axis short wavelength infrared thermal camera. The key novelty of this work is a spatiotemporal data fusion method that synchronizes multisensor features with the real-time robot motion data to achieve localized quality prediction. Optical microscope (OM) images of the printed part are used to locate defect-free and defective regions (i.e., cracks and keyhole pores), which serve as ground truth labels for training supervised machine learning (ML) models for quality prediction. The trained ML model is then used to generate a virtual quality map that registers quality prediction outcomes within the 3D volume of the printed part, thus eliminating the need of physical inspections by destructive methods. Experiments show that the virtual quality map closely matches the actual quality observed by OM. Compared to traditional single-sensor-based quality prediction, the MFDT has achieved a significantly higher quality prediction accuracy (96%), a higher ROC-AUC score (99%), and a lower false alarm rate (4.4%). As a result, the MFDT is a more reliable method for defect prediction. The proposed MFDT also lays the groundwork for our future development of a self-adaptive hybrid processing strategy that combines machining with AM for defect removal and quality improvement.

Deep Learning-Based Super Resolution Applied to Finite Element Analysis of Fused Deposition Modeling 3D Printing

Monitoring the Extrusion State of Fused Filament Fabrication Using Fine-Grain Recognition Method

A CNN-Based Adaptive Surface Monitoring System for Fused Deposition Modeling

A Deep Learning Method for Material Performance Recognition in Laser Additive Manufacturing

Numerical Simulation and Printability Analysis of Fused Deposition Modeling with Dual-Temperature Control

Qualify assessment for extrusion-based additive manufacturing with 3D scan and machine learning

Super-resolving material microstructure image via deep learning for microstructure characterization and mechanical behavior analysis

Deep Learning for Super-Resolution in a Field Emission Scanning Electron Microscope

SuperMeshing: A New Deep Learning Architecture for Increasing the Mesh Density of Physical Fields in Metal Forming Numerical Simulation

Fast and accurate prediction of temperature evolutions in additive manufacturing process using deep learning

Automated Real‐Time Detection and Prediction of Interlayer Imperfections in Additive Manufacturing Processes Using Artificial Intelligence

Monitoring of fused filament fabrication (FFF): An infrared imaging and machine learning approach

Research on Optimization of 3D Printing Model Based on Deep Learning

Validation of a Finite Element Model for Fused Filament Fabrication Additive Manufacturing

Application of Numerical Modeling and Finite Element Analysis in Fused Filament Fabrication: A Review

SuperMeshing: A New Deep Learning Architecture for Increasing the Mesh Density of Metal Forming Stress Field with Attention Mechanism and Perceptual Features

Multisensor fusion-based digital twin for localized quality prediction in robotic laser-directed energy deposition

Deep learning-based super-resolution images for synchronous measurement of temperature and deformation at elevated temperature

Detection of Material Extrusion In-Process Failures via Deep Learning

Interpretable machine learning for predicting the strength of 3D printed fiber-reinforced concrete (3DP-FRC)

Multi-scale modeling and simulation of additive manufacturing based on fused deposition technique