Abstract:In the development of a new product, the design team must describe the expected effects of the final products to potential users and stakeholders. However, existing prototyping tools can only present a product imperfectly, due to limitations at different levels. Specifically, the physical product model, which may be the product of 3D printing, could lack a visual interface; the presentation of the product through modeling software such as Rhinoceros 3D does not provide good realistic tactile perception; or the interface platforms, such as Axure RP, used to display the interactive effects differ from those to be used in the actual operation. Thus, we present the VPModel, a high-fidelity prototyping tool, able to integrate multiple prototyping methods simultaneously. It combines a touchable 3D-printed product model (3DPM) and a corresponding visualized virtual model, and the interactive interfaces are rendered synchronously in a mixed-reality device. Through the tangible, visual, and interactive demonstration, designers and normal users can each obtain a similar experience to the experience of the finished product. Furthermore, the VPModel also enhances design practices by enabling comparisons between modular models. However, the implementation of this system is a challenging task, which subsumes several fundamental problems as sub-tasks: object detection, real-time matching, hand-gesture detection and action recognition. To achieve the expected goals of the VPModel, this system uses physical hardware (a Microsoft MR HoloLens headset, a Leap Motion Controller, and a 3D printer) and existing machine learning algorithms. To evaluate our VPModel, we report the user experience of 16 participants, evaluated using a closed-ended questionnaire survey, a quantitative analysis of task performance, and a qualitative analysis of open-ended interviews. The results show a significant improvement in realism and enjoyment using the VPModel over the two traditional camera prototype approaches. In summary, the VPModel can be used to support design strategy and to convey design concepts fully and efficiently, which indicates a potential use for the VPModel in shortening product development cycles and reducing communication costs.

Mixed reality prototyping for usability evaluation in product design: a case study of a handheld printer

Determining Fidelity of Mixed Prototypes: Effect of Media and Physical Interaction.

Prototyping to elicit user requirements for product development: Using head-mounted augmented reality when designing interactive devices

VPModel: High-Fidelity Product Simulation in a Virtual-Physical Environment

ProtoDreamer: A Mixed-prototype Tool Combining Physical Model and Generative AI to Support Conceptual Design

A Hybrid Prototype Method Combining Physical Models and Generative Artificial Intelligence to Support Creativity in Conceptual Design

Context-Based Interface Prototyping: Understanding the Effect of Prototype Representation on User Feedback

MIXED REALITY PROTOTYPING: SYNCHRONICITY AND ITS IMPACT ON A DESIGN WORKFLOW

Usability Evaluation of Augmented Reality: A Neuro-Information-Systems Study.

On Design Concept Validation Through Prototyping: Challenges And Opportunities

Using Mixed Reality for Iterative Sketching and Prototyping in Product Design

A modular visuo-haptic mixed reality (VHMR) aided prototype technique for in-vehicle human-machine interaction (HMI) evaluations

Elicitation and Evaluation of Hand-based Interaction Language for 3D Conceptual Design in Mixed Reality

Towards Mixed Reality as the Everyday Computing Paradigm: Challenges & Design Recommendations

Comparing Low and High-Fidelity Prototypes in Mobile Phone Evaluation

Methodology for Evaluating Product Design at the Early Stage of Life Cycle

Combining Virtual Reality (Vr) Technology With Physical Models - A New Way For Human-Vehicle Interaction Simulation And Usability Evaluation

Developing A Toolkit For Prototyping Machine Learning-Empowered Products: The Design And Evaluation Of Ml-Rapid

CoAug-MR: An MR-based Interactive Office Workstation Design System via Augmented Multi-Person Collaboration

An integrated prototyping tool to enhance interdisciplinary communication in smart product design

Multimodal Coexistence Environment Design to Assist User Testing and Iterative Design of HiGame Emotional Interaction Design for Elderly