Abstract:In automotive digital development, engineers utilize multiple virtual prototyping tools to design and assess the performance of 3D shapes. However, accurate performance simulations are computationally expensive and time-consuming, which may be prohibitive for design optimization tasks. To address this challenge, we envision a 3D design assistance system for design exploration with performance assessment in the automotive domain. Recent advances in deep learning methods for learning geometric data are a promising step towards realizing such systems. Deep learning-based (variational) autoencoder models have been used for learning and compressing 3D data allowing engineers to generate low-dimensional representations of 3D designs. Finding representations in a data-driven fashion results in representations that are agnostic to downstream tasks performed on these representations and are believed to capture relevant design features. In this paper, we evaluate whether such data-driven representations contain relevant information about the input data and whether representations are meaningful in performance prediction tasks for the input data. We use machine learning-based surrogate models to predict the performances of car shapes based on the low-dimensional representation learned by 3D point cloud (variational) autoencoders. Furthermore, we exploit the stochastic nature of the representation learned by variational autoencoders to augment the training data for our surrogate models, since the limited amount of data is usually a challenge for surrogate modeling in engineering. We demonstrate that augmenting training with generated shapes improves prediction accuracy. In sum, we find that geometric deep learning approaches offer powerful tools to support the engineering design process.

Imagine That! Leveraging Emergent Affordances for 3D Tool Synthesis

3D-Aware Image Synthesis Via Learning Structural and Textural Representations

Learning Object Affordance with Contact and Grasp Generation

Learning Generalizable Tool-use Skills through Trajectory Generation

ProtoDreamer: A Mixed-prototype Tool Combining Physical Model and Generative AI to Support Conceptual Design

Transfer of Tool Affordance and Manipulation Cues with 3D Vision Data

Learning at the Ends: From Hand to Tool Affordances in Humanoid Robots

Emergence of Hidden Capabilities: Exploring Learning Dynamics in Concept Space

What Can I Do Here? Learning New Skills by Imagining Visual Affordances

Learning Precise Affordances from Egocentric Videos for Robotic Manipulation

Learning Environment-Aware Affordance for 3D Articulated Object Manipulation under Occlusions

Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations

Efficient and Scalable Estimation of Tool Representations in Vector Space

FAME: 3D Shape Generation via Functionality-Aware Model Evolution

3D Semantic Subspace Traverser: Empowering 3D Generative Model with Shape Editing Capability

Systematically Exploring the Landscape of Grasp Affordances via Behavioral Manifolds

Shaping Realities: Enhancing 3D Generative AI with Fabrication Constraints

PartAfford: Part-level Affordance Discovery from 3D Objects

Visual Affordance Prediction for Guiding Robot Exploration

Exploiting Generative Models for Performance Predictions of 3D Car Designs

L3GO: Language Agents with Chain-of-3D-Thoughts for Generating Unconventional Objects