Manipulating Vehicle 3D Shapes through Latent Space Editing

JiangDong Miao,Tatsuya Ikeda,Bisser Raytchev,Ryota Mizoguchi,Takenori Hiraoka,Takuji Nakashima,Keigo Shimizu,Toru Higaki,Kazufumi Kaneda

2024-10-31

Abstract:Although 3D object editing has the potential to significantly influence various industries, recent research in 3D generation and editing has primarily focused on converting text and images into 3D models, often overlooking the need for fine-grained control over the editing of existing 3D objects. This paper introduces a framework that employs a pre-trained regressor, enabling continuous, precise, attribute-specific modifications to both the stylistic and geometric attributes of vehicle 3D models. Our method not only preserves the inherent identity of vehicle 3D objects, but also supports multi-attribute editing, allowing for extensive customization without compromising the model's structural integrity. Experimental results demonstrate the efficacy of our approach in achieving detailed edits on various vehicle 3D models.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: in the field of 3D model editing, existing methods mainly focus on fusing text or image information into 3D models, while ignoring the need for fine - grained control of existing 3D objects. Specifically, current 3D editing methods usually lack the ability to make detailed modifications based on existing models, especially in adjusting the geometric and stylistic properties of vehicle 3D models.

To solve this problem, the author proposes a new framework to achieve continuous, precise, and specific - attribute modifications in the latent space with the help of a pre - trained regressor. This framework can not only maintain the inherent identity of vehicle 3D objects but also support multi - attribute editing, allowing for extensive customization without compromising the structural integrity of the model.

### Core Objectives of the Paper:
1. **Achieve Fine - Grained Editing**: Enable users to make continuous and precise modifications to the geometric properties (such as roof height, hood length, etc.) and stylistic properties (such as changing the appearance from "powerful" to "delicate") of 3D vehicle models.
2. **Maintain Model Integrity**: Ensure that the basic structure and overall design of the vehicle are not changed during the editing process.
3. **Support Multi - Attribute Editing**: Allow multiple attributes to be edited simultaneously, thereby fulfilling more complex customization requirements.

### Key Technologies of the Solution:
- **DeepSDF Model**: Used to generate and reconstruct 3D vehicle models and provide a latent representation suitable for continuous editing.
- **Latent Space Editing**: Train a regressor to determine specific directions in the latent space to achieve modifications of different attributes.
- **MLP and KAN Editors**: Design two editors based on the Multilayer Perceptron (MLP) and Kolmogorov - Arnold Network (KAN) respectively, which are used to output the edited latent code according to the original latent code and the attribute editing intensity.

### Experimental Results:
The experimental results show that this method can achieve detailed editing on a variety of vehicle 3D models, verifying its effectiveness and precision in geometric and stylistic property editing. In addition, this method can also maintain the identity characteristics of vehicle models and support the simultaneous editing of multiple attributes, demonstrating its potential in practical applications.

Through these improvements, this research provides a more powerful tool for 3D vehicle design, which helps designers quickly preview and evaluate different design options and also supports early aerodynamic research.