Abstract:To promote development of sensing technology applied in the welding process and improvement of production automation in the welding manufacturing industry, an innovative multi-functional monocular visual sensor based on combined laser structured lights (single-line & cross-lines) is proposed and devised. It can realize the detection of cross-sectional size parameters of welding groove, space position and posture of welding torch relative to the weldment or welding groove by using monocular vision. Its calibration makes full use of the intrinsic parameters, such as its internal structure parameters and the focal length of industrial CCD camera. Therefore, it is unnecessary to re-calibrate when the position and posture of welding torch have some variations during the welding process or the visual sensor reassembles with the welding torch, which availably improves the adaptability of this sensor in engineering application, so that it can apply to the welding process with complex space welding trajectory. Furthermore, with the use of combined laser structured lights, it effectively eliminates the problem of information loss in depth commonly existing in usual monocular visual sensor. Meanwhile, all the detection functions of this sensor are derived from the processing results of a single image captured by industrial CCD camera, which avoids the problems of time-consuming and large amount of calculation resulting from multi-images processing (multi-vision method or multi-angle time-sharing imaging in monocular vision), and thus significantly improves its real-time performance in engineering application. Its functional detection algorithms for the cross-sectional size parameters of welding groove and the height of welding torch derived from the principle of optical triangulation are given. After establishing a test platform, we carried out a series of detecting experiments for different types or sizes of V-type butt groove. By image processing, recognition and extraction of the feature points, the cross-sectional size parameters of welding groove and the height of welding torch calculate out through the derived detection algorithms. The acquired detection results have enough accuracy and their maximum relative errors are not exceeding 3.9%, which demonstrate the rationality of the physical design for the proposed visual sensor and the validity of the derived detection algorithms.

A 3D reconstruction method based on grid laser and gray scale photo for visual inspection of welds

3D Reconstruction of High Reflective Welding Surface Based on Binocular Structured Light Stereo Vision

Three-dimensional reconstruction filtering algorithm based on single ray picture of pipe welds

3D reconstruction of complex spatial weld seam for autonomous welding by laser structured light scanning

Research on slope algorithm based laser welding guidance technology for 3D vision inspection of thin-walled parts

A 3D Vision-Based Weld Seam Extraction Method for Arbitrarily Placed Spatial Planar Weldments

A Laser-Based Vision System for Weld Quality Inspection

A novel method for dense point cloud reconstruction and weld seam detection for tubesheet welding robot

3D vision-based weld seam extraction method

An automatic measurement method for hull weld seam dimensions based on 3D laser scanning

Visual inspection of weld surface quality

Intelligent Grinding System for Medium/Thick Plate Welding Seams in Construction Machinery Using 3D Laser Measurement and Deep Learning

Defect detection method for high-resolution weld based on wandering Gaussian and multi-feature enhancement fusion

Weld quality measurement of T-joints based on three-dimensional scanner

Principle of an Innovative Visual Sensor Based on Combined Laser Structured Lights and Its Experimental Verification

Point Cloud 3D Weldment Reconstruction and Welding Feature Extraction for Robotic Multi-bead Arc Weld Cladding Path Plaanning

A Novel 3D Seam Extraction Method Based on Multi-Functional Sensor for V-Type Weld Seam

Real-time detection and localization method for weld seam of narrow butt joint based on semantic segmentation

Laser-vision-based quality inspection system for small-bead laser welding

A Novel 3-D Path Extraction Method for Arc Welding Robot Based on Stereo Structured Light Sensor

Machine Learning and 3D Reconstruction of Materials Surface for Nondestructive Inspection