P2CADNet: An End-to-End Reconstruction Network for Parametric 3D CAD Model from Point Clouds

Zhihao Zong,Fazhi He,Rubin Fan,Yuxin Liu

2023-10-04

Abstract:Computer Aided Design (CAD), especially the feature-based parametric CAD, plays an important role in modern industry and society. However, the reconstruction of featured CAD model is more challenging than the reconstruction of other CAD models. To this end, this paper proposes an end-to-end network to reconstruct featured CAD model from point cloud (P2CADNet). Initially, the proposed P2CADNet architecture combines a point cloud feature extractor, a CAD sequence reconstructor and a parameter optimizer. Subsequently, in order to reconstruct the featured CAD model in an autoregressive way, the CAD sequence reconstructor applies two transformer decoders, one with target mask and the other without mask. Finally, for predicting parameters more precisely, we design a parameter optimizer with cross-attention mechanism to further refine the CAD feature parameters. We evaluate P2CADNet on the public dataset, and the experimental results show that P2CADNet has excellent reconstruction quality and accuracy. To our best knowledge, P2CADNet is the first end-to-end network to reconstruct featured CAD model from point cloud, and can be regarded as baseline for future works. Therefore, we open the source code at <a class="link-external link-https" href="https://github.com/Blice0415/P2CADNet" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The paper attempts to address the problem of directly reconstructing feature-based Computer-Aided Design (CAD) models from point cloud data. Specifically, existing CAD model reconstruction methods typically focus on the reconstruction of resultant models (such as meshes, B-reps, etc.) and pay less attention to feature-based CAD models. Feature-based CAD models contain high-level information such as design semantics and design intent, which are crucial for subsequent design modifications and optimizations. However, directly reconstructing such advanced CAD models from point cloud data is an open and challenging problem.

The paper proposes an end-to-end network called P2CADNet, which aims to directly generate a sequence of feature-based CAD models from point cloud data and further optimize parameter predictions to achieve high-quality CAD model reconstruction. The main contributions of P2CADNet include:

1. **First Proposal**: This is the first end-to-end network to directly reconstruct feature-based CAD models from point cloud data.
2. **Autoregressive Decoder**: Combines a transformer decoder and a masked decoder to generate CAD model sequences in an autoregressive manner.
3. **Cross-Attention Mechanism**: Introduces a cross-attention mechanism in the parameter optimization module to improve the accuracy of parameter predictions.
4. **Outstanding Performance**: Experimental results show that P2CADNet performs excellently on multiple metrics and can serve as a benchmark for future research.

Through these innovations, P2CADNet not only improves reconstruction quality but also simplifies the reconstruction process, reducing the need for intermediate data and preprocessing.