Demonstrating the Suitability of Neuromorphic, Event-Based, Dynamic Vision Sensors for In Process Monitoring of Metallic Additive Manufacturing and Welding

David Mascareñas,Andre Green,Ashlee Liao,Michael Torrez,Alessandro Cattaneo,Amber Black,John Bernardin,Garrett Kenyon
DOI: https://doi.org/10.1007/978-3-031-68192-9_7
2024-11-20
Abstract:We demonstrate the suitability of high dynamic range, high-speed, neuromorphic event-based, dynamic vision sensors for metallic additive manufacturing and welding for in-process monitoring applications. In-process monitoring to enable quality control of mission critical components produced using metallic additive manufacturing is of high interest. However, the extreme light environment and high speed dynamics of metallic melt pools have made this a difficult environment in which to make measurements. Event-based sensing is an alternative measurement paradigm where data is only transmitted/recorded when a measured quantity exceeds a threshold resolution. The result is that event-based sensors consume less power and less memory/bandwidth, and they operate across a wide range of timescales and dynamic ranges. Event-driven driven imagers stand out from conventional imager technology in that they have a very high dynamic range of approximately 120 dB. Conventional 8 bit imagers only have a dynamic range of about 48 dB. This high dynamic range makes them a good candidate for monitoring manufacturing processes that feature high intensity light sources/generation such as metallic additive manufacturing and welding. In addition event based imagers are able to capture data at timescales on the order of 100 {\mu}s, which makes them attractive to capturing fast dynamics in a metallic melt pool. In this work we demonstrate that event-driven imagers have been shown to be able to observe tungsten inert gas (TIG) and laser welding melt pools. The results of this effort suggest that with additional engineering effort, neuromorphic event imagers should be capable of 3D geometry measurements of the melt pool, and anomaly detection/classification/prediction.
Image and Video Processing,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
This paper aims to explore the applicability of high - dynamic - range, high - speed neuromorphic event - driven dynamic vision sensors in metal additive manufacturing and welding processes, especially in process monitoring applications. Specifically, the paper focuses on how to use these sensors to overcome the difficulties of traditional imaging techniques in making measurements under extreme light environments and rapid dynamic conditions (such as the high - temperature and strong - light environment of the metal molten pool). By introducing event - driven sensing technology, the paper shows that this technology can operate across a wide range of time scales and dynamic ranges while reducing power consumption, memory/bandwidth consumption, and is particularly suitable for monitoring manufacturing processes with high - intensity light sources, such as metal additive manufacturing and welding. In addition, the paper also discusses the advantages of event - driven imagers in capturing the rapid dynamics of the metal molten pool and proposes possible future application directions, including 3D geometric measurement, anomaly detection/classification/prediction, etc.