Digital Modeling for Everyone: Exploring How Novices Approach Voice-Based 3D Modeling

Giuseppe Desolda,Andrea Esposito,Florian Müller,Sebastian Feger

DOI: https://doi.org/10.1007/978-3-031-42293-5_11

2023-08-30

Abstract:Manufacturing tools like 3D printers have become accessible to the wider society, making the promise of digital fabrication for everyone seemingly reachable. While the actual manufacturing process is largely automated today, users still require knowledge of complex design applications to produce ready-designed objects and adapt them to their needs or design new objects from scratch. To lower the barrier to the design and customization of personalized 3D models, we explored novice mental models in voice-based 3D modeling by conducting a high-fidelity Wizard of Oz study with 22 participants. We performed a thematic analysis of the collected data to understand how the mental model of novices translates into voice-based 3D modeling. We conclude with design implications for voice assistants. For example, they have to: deal with vague, incomplete and wrong commands; provide a set of straightforward commands to shape simple and composite objects; and offer different strategies to select 3D objects.

Human-Computer Interaction,Artificial Intelligence

What problem does this paper attempt to address?

The problem this paper attempts to address is: how to lower the threshold for novices to engage in personalized 3D modeling design and customization through voice interaction.

Specifically, the authors point out that although manufacturing technologies such as 3D printing have become widespread, users still need to have knowledge of complex 3D modeling software to design or adjust models. To simplify this process, researchers have explored natural interaction technologies (such as gestures, eye-tracking, brain-computer interfaces, etc.) to simplify 3D modeling tools, but these technologies are often limited by hardware costs and usage complexity, mainly suitable for technical users. Voice interaction, as an intuitive and simple technology, is considered a promising method to democratize 3D modeling.

However, existing voice interaction solutions have three main issues:
1. Users are often ignored during the design phase or only considered during the testing phase.
2. Novices have never been regarded as target users.
3. Voice interaction is usually built on top of existing complex CAD systems rather than designing the entire system from scratch.

Therefore, this study aims to reduce the barriers for novices to enter the digital manufacturing field by exploring their mental models in voice 3D modeling. The specific research question is: how can novices' mental models be translated into voice 3D modeling?