Abstract:Point cloud is widely available in the manufacturing system with the continuous development of 3-D sensors. Accurate point cloud segmentation can automatically identify different components during the manufacturing process, which is essential to the quality assurance of the final product. However, the existing methods for point cloud segmentation fail to accurately identify the boundary of each region, which decays the quality of many manufacturing operations (i.e., welding). In this article, a point cloud segmentation model, Attention Recurrent PointNet (AR-PointNet), is proposed to improve the segmentation accuracy, especially on the regions’ boundaries. More specifically, the PointNet is used as the backbone, and the novel channel and spatial statistical feature (SSF) attention modules are proposed and combined to enhance the features along the regions’ edges. In addition, context features among different regions in the point cloud are further extracted to consider the interactions among components. The experiments are conducted on the ShapeNet dataset and the real-scanned dataset of manufactured products, respectively. The results demonstrated that: 1) on the ShapeNet dataset, the proposed method outperforms the state-of-the-art segmentation models. The mean intersection-over-union (mIoU) is selected as the evaluation metric to indicate the segmentation accuracy. The proposed method improves mIoU by 2.3% compared with its backbone (PointNet) and 2) on the simulated and real-scanned sheet metal part, it successfully recognizes the boundaries of components in the sheet metal part and significantly improves the recognition accuracy. Boundary mean accuracy (BMA) is defined as the evaluation metric to indicate the boundary recognition accuracy. Results of the simulated data and the real-scanned data show that the proposed method improves the BMA by 4.4% and 3.6%, respectively, compared with its backbone (PointNet).

3D M-Net: Object-Specific 3D Segmentation Network Based on a Single Projection

3-D Inspection Method for Industrial Product Assembly Based on Single X-Ray Projections

Interactive Defect Segmentation in X-Ray Images Based on Deep Learning

A novel segmentation algorithm for complex 3D mesh model in computer vision.

Online Global Non-rigid Registration for 3D Object Reconstruction Using Consumer-level Depth Cameras

Sewer defect instance segmentation, localization, and 3D reconstruction for sewer floating capsule robots

Three-Dimensional Point Cloud Segmentation Based on Context Feature for Sheet Metal Part Boundary Recognition

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Uni-3DAD: GAN-Inversion Aided Universal 3D Anomaly Detection on Model-free Products

MPDNet: A 3D Missing Part Detection Network Based on Point Cloud Segmentation

AnomalySeg: Deep Learning-Based Fast Anomaly Segmentation Approach for Surface Defect Detection

An Efficient End-to-End Multitask Network Architecture for Defect Inspection

EasyNet: An Easy Network for 3D Industrial Anomaly Detection

Assembly Integrity Detection Based on 3D CAD Model

Robust Detection, Segmentation, and Metrology of High Bandwidth Memory 3D Scans Using an Improved Semi-Supervised Deep Learning Approach

Mask-Point: Automatic 3D Surface Defects Detection Network for Fiber-Reinforced Resin Matrix Composites

3D Pose Recognition of Small Special-Shaped Sheet Metal with Multi-Objective Overlapping

Single system for online monitoring and inspection of automated fiber placement with object segmentation by artificial neural networks

High-performance deep learning segmentation for non-destructive testing of X-ray tomography

A Pixel-Level Segmentation Convolutional Neural Network Based on Global and Local Feature Fusion for Surface Defect Detection

MINet: Multi-scale Interactive Network for Real-time Salient Object Detection of Strip Steel Surface Defects