Abstract:Computer-aided design (CAD) tools are utilized in the manufacturing industry for modeling everything from cups to spacecraft. These programs are complex to use and typically require years of training and experience to master. Structured and well-constrained 2D sketches and 3D constructions are crucial components of CAD modeling. A well-executed CAD model can be seamlessly integrated into the manufacturing process, thereby enhancing production efficiency. Deep generative models of 3D shapes and 3D object reconstruction models have garnered significant research interest. However, most of these models produce discrete forms of 3D objects that are not editable. Moreover, the few models based on CAD operations often have substantial input restrictions. In this work, we fine-tuned pre-trained models to create OpenECAD models (0.55B, 0.89B, 2.4B and 3.1B), leveraging the visual, logical, coding, and general capabilities of visual language models. OpenECAD models can process images of 3D designs as input and generate highly structured 2D sketches and 3D construction commands, ensuring that the designs are editable. These outputs can be directly used with existing CAD tools' APIs to generate project files. To train our network, we created a series of OpenECAD datasets. These datasets are derived from existing public CAD datasets, adjusted and augmented to meet the specific requirements of vision language model (VLM) training. Additionally, we have introduced an approach that utilizes dependency relationships to define and generate sketches, further enriching the content and functionality of the datasets.

View2CAD: Parsing Multi-view into CAD Command Sequences

Training Automatic View Planner for Cardiac MR Imaging via Self-supervision by Spatial Relationship Between Views

Automatic Reverse Engineering: Creating computer-aided design (CAD) models from multi-view images

Automatic Generation of Canonical Views for CAD Models

P2CADNet: An End-to-End Reconstruction Network for Parametric 3D CAD Model from Point Clouds

Point2CAD: Reverse Engineering CAD Models from 3D Point Clouds

Embedding Visual Cognition in 3D Reconstruction from Multi-View Engineering Drawings

Img2CAD: Conditioned 3D CAD Model Generation from Single Image with Structured Visual Geometry

SECAD-Net: Self-Supervised CAD Reconstruction by Learning Sketch-Extrude Operations

Self-supervised Graph Neural Network for Mechanical CAD Retrieval

CAD-NeRF: Learning NeRFs from Uncalibrated Few-view Images by CAD Model Retrieval

Img2CAD: Reverse Engineering 3D CAD Models from Images through VLM-Assisted Conditional Factorization

DiffCAD: Weakly-Supervised Probabilistic CAD Model Retrieval and Alignment from an RGB Image

OpenECAD: An Efficient Visual Language Model for Editable 3D-CAD Design

3D CAD Model Retrieval Based on Sketch and Unsupervised Variational Autoencoder

CAD Translator: an Effective Drive for Text to 3D Parametric Computer-Aided Design Generative Modeling

Converting sectional views to three orthographic views to reconstruct 3D models

MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Seconds

Multi-View Stereo Representation Revist: Region-Aware MVSNet

Sketch2CAD: Sequential CAD Modeling by Sketching in Context