3D reconstruction method of welding area by fusion of coding raster and semantic segmentation network
Limei Song,Baolin Xu,Yangang Yang,Jiaxing Yuan,Chenchao Ye
DOI: https://doi.org/10.1007/s11554-024-01555-0
IF: 2.293
2024-10-01
Journal of Real-Time Image Processing
Abstract:Due to its rapid projection and capture of fringe patterns, coded structured light measurement technology is widely utilised for acquiring three-dimensional information in welding areas. To achieve real-time segmentation of the welding area for T-joint butt welding workpieces with various noise interference, this paper has developed a lightweight dual-resolution semantic segmentation network (LDRNet). This paper designed a lightweight feature extraction module that provides efficient feature representations for the network using fewer parameters and computational costs. To enhance the network's robustness to complex environmental noise, this paper introduced a multi-scale adaptive feature extraction module that can capture information at different scales of the environment. To further improve segmentation accuracy, this paper reconstructed the traditional pyramid pooling module and combined it with the CBAM attention mechanism to enhance the focus on important features. This paper proposes a local feature constraint method to improve the phase matching accuracy. Experimental results show that this paper algorithm significantly reduces Params and FLOPs by 62.02% and 65.78%, respectively, compared to the original network DDRNet-23-Slim. Moreover, it leads to an improvement in the IOU of the welding area from 74.55% to 77.43%. Additionally, this paper's proposed algorithm effectively reduces the generation of noise points through phase matching by approximately 93.88%. Consequently, this algorithm satisfactorily meets the requirements of practical production processes.
computer science, artificial intelligence,engineering, electrical & electronic,imaging science & photographic technology