CAM/CAD Point Cloud Part Segmentation via Few-Shot Learning

Jiahui Wang,Haiyue Zhu,Haoren Guo,Abdullah Al Mamun,Vadakkepat Prahlad,Tong Heng Lee
DOI: https://doi.org/10.48550/arXiv.2207.01218
2022-07-16
Abstract:3D part segmentation is an essential step in advanced CAM/CAD workflow. Precise 3D segmentation contributes to lower defective rate of work-pieces produced by the manufacturing equipment (such as computer controlled CNCs), thereby improving work efficiency and attaining the attendant economic benefits. A large class of existing works on 3D model segmentation are mostly based on fully-supervised learning, which trains the AI models with large, annotated datasets. However, the disadvantage is that the resulting models from the fully-supervised learning methodology are highly reliant on the completeness of the available dataset, and its generalization ability is relatively poor to new unknown segmentation types (i.e. further additional novel classes). In this work, we propose and develop a noteworthy few-shot learning-based approach for effective part segmentation in CAM/CAD; and this is designed to significantly enhance its generalization ability and flexibly adapt to new segmentation tasks by using only relatively rather few samples. As a result, it not only reduces the requirements for the usually unattainable and exhaustive completeness of supervision datasets, but also improves the flexibility for real-world applications. As further improvement and innovation, we additionally adopt the transform net and the center loss block in the network. These characteristics serve to improve the comprehension for 3D features of the various possible instances of the whole work-piece and ensure the close distribution of the same class in feature space.
Image and Video Processing,Artificial Intelligence,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the challenges faced by 3D part segmentation in computer - aided manufacturing (CAM) and computer - aided design (CAD). Specifically, most of the existing 3D model segmentation methods are based on fully - supervised learning, which requires a large amount of labeled data to train AI models. However, this method that depends on large - scale labeled data sets has two main problems: 1. **Completeness of the data set**: The fully - supervised learning method is highly dependent on the completeness of the available data set, which is very difficult to achieve in practical applications, especially for newly emerging or unseen segmentation types (the so - called new categories), and its generalization ability is relatively weak. 2. **Lack of flexibility**: Due to the high dependence on the completeness of the data set, these models are difficult to flexibly adapt to new segmentation tasks, especially when the amount of data is limited. To overcome these problems, this paper proposes a 3D part segmentation method based on few - shot learning. This method aims to significantly improve the generalization ability of the model and can flexibly adapt to new segmentation tasks by using only a small number of samples. Specifically, the main contributions of the paper include: - **Multi - Prototype Network**: A multi - prototype network with a self - attention mechanism is introduced to improve the model's ability to understand the 3D features of different instances and ensure that the features of the same category are more closely distributed in the feature space. - **Transform Net**: A transform net is adopted to improve the geometric invariance of feature extraction, so as to better understand the geometric features of 3D workpieces. - **Center Loss**: By introducing center loss, the intra - class distance is reduced, the probability of misclassification is decreased, and the performance of the model is further improved. Through these innovations, the method proposed in this paper not only reduces the need for large - scale labeled data sets but also improves the flexibility and accuracy in practical applications.