Abstract:When it comes to the optimization of CAD models in the automation domain, neural networks currently play only a minor role. Optimizing abstract features such as automation capability is challenging, since they can be very difficult to simulate, are too complex for rule-based systems, and also have little to no data available for machine-learning methods. On the other hand, image manipulation methods that can manipulate abstract features in images such as StyleCLIP have seen much success. They rely on the latent space of pretrained generative adversarial networks, and could therefore also make use of the vast amount of unlabeled CAD data. In this paper, we show that such an approach is also suitable for optimizing abstract automation-related features of CAD parts. We achieved this by extending StyleCLIP to work with CAD models in the form of voxel models, which includes using a 3D StyleGAN and a custom classifier. Finally, we demonstrate the ability of our system for the optimiziation of automation-related features by optimizing the grabability of various CAD models. This is an open access article under the CC BY-NC-ND license (<a class="link-external link-http" href="http://creativecommons.org/licenses/by-nc-nd/4.0/" rel="external noopener nofollow">this http URL</a>) Peer review under the responsibility of the scientific committee of the 33rd CIRP Design Conference.

What problem does this paper attempt to address?

### Problems Addressed by the Paper In the field of automation, the ability to optimize CAD (Computer-Aided Design) models is an important research direction. However, the application of neural networks in this area is still limited. Particularly for some abstract features (such as automation capabilities), these features are difficult to evaluate through simulation, too complex to handle with rule-based systems, and lack sufficient data for machine learning methods. This paper aims to optimize the abstract features of CAD models by drawing on the successful experiences in the field of image processing, especially by utilizing the latent space of Generative Adversarial Networks (GAN). Specifically, the authors extend the StyleCLIP method to handle CAD models to optimize abstract features related to automation. For example, they demonstrate how to improve the automation assembly capability by optimizing the graspability of screws and bolts. ### Main Contributions 1. **Extending StyleCLIP**: The authors extend the StyleCLIP method from the field of image processing to the optimization of CAD models by using 3D StyleGAN and custom classifiers. 2. **Optimizing Abstract Features**: By manipulating the latent space, the authors successfully optimized the graspability of CAD models, an abstract feature closely related to automated assembly. 3. **Experimental Validation**: The authors conducted experiments using a small-scale dataset, demonstrating the potential and limitations of their method in practical applications. ### Key Technologies - **3D StyleGAN**: Used for generating and encoding CAD models. - **Custom Classifier**: Used to evaluate optimization targets. - **Latent Space Manipulation**: Includes latent optimization and latent mapper methods. ### Conclusion Although many optimization results have high perceptual quality and rationality, there are still some unrealistic or distorted optimization results. This indicates that the current method still faces challenges in handling CAD models, especially in maintaining the authenticity and functionality of the models. Future work can explore the use of generative models with natural language representations to better handle complex CAD datasets and preserve specific functional structures.

Optimizing CAD Models with Latent Space Manipulation

Feature visualization within an automated design assessment leveraging explainable artificial intelligence methods

GenCAD: Image-Conditioned Computer-Aided Design Generation with Transformer-Based Contrastive Representation and Diffusion Priors

Hierarchical Neural Coding for Controllable CAD Model Generation

Towards automated Capability Assessment leveraging Deep Learning

Extending Point-Based Deep Learning Approaches for Better Semantic Segmentation in CAD

Self-supervised Graph Neural Network for Mechanical CAD Retrieval

Point2CAD: Reverse Engineering CAD Models from 3D Point Clouds

Enhancing 3D-CNN-based Geometric Feature Recognition for Adaptive Additive Manufacturing: A SDF Data Approach

OpenECAD: An Efficient Visual Language Model for Editable 3D-CAD Design

DeepMorpher: deep learning-based design space dimensionality reduction for shape optimisation

Automatic Reverse Engineering: Creating computer-aided design (CAD) models from multi-view images

Computer-Aided Design as Language

Topologically robust CAD model generation for structural optimisation

Text2CAD: Generating Sequential CAD Models from Beginner-to-Expert Level Text Prompts

Large Language and Text-to-3D Models for Engineering Design Optimization

CAD 3D Model classification by Graph Neural Networks: A new approach based on STEP format

CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimization

Interactive design space exploration and optimization for CAD models

A Generative Neural Network Approach for 3D Multi-Criteria Design Generation and Optimization of an Engine Mount for an Unmanned Air Vehicle

Towards AI Drawing Agents