Monocular 3D Reconstruction of Blast Furnace Burden Surface Based on Cross-Domain Generative Self-Supervised Network

Zhipeng Chen,Xinyi Wang,Ling Shen,Jinshi Liu,Jianjun He,Jilin Zhu,Weihua Gui
DOI: https://doi.org/10.1109/tai.2024.3511515
2024-01-01
IEEE Transactions on Artificial Intelligence
Abstract:Accurate acquisition of the three-dimensional (3D) topography of the blast furnace (BF) burden surface is crucial for optimizing the ironmaking process. However, traditional methods struggle in the high-temperature, high-pressure, and dusty environment of the BF top, and even advanced industrial endoscopes only capture monocular images, limiting multi-view stereoscopic reconstruction. To address these challenges, we propose a novel 3D reconstruction framework featuring a virtual-real multi-view endoscope array for capturing multi-view images and a cross-domain point cloud generation self-supervised network (XGSN). The XGSN leverages a progressive multi-modal self-attention mechanism and ray-tracing projection to compensate for the lack of 3D labels, producing a high-fidelity 3D point cloud. Experimental results show that the proposed method achieves a significant improvement in burden surface reconstruction accuracy, delivering high-quality 3D mapping with enhanced real-time processing capabilities, demonstrating its potential for challenging industrial environments.
What problem does this paper attempt to address?