BrickPal: Augmented Reality-based Assembly Instructions for Brick Models

Yao Shi,Xiaofeng Zhang,Ran zhang,Zhou Yang,Xiao Tang,Hongni Ye,Yi Wu
2023-07-07
Abstract:The assembly instruction is a mandatory component of Lego-like brick sets.The conventional production of assembly instructions requires a considerable amount of manual fine-tuning, which is intractable for casual users and customized brick sets.Moreover, the traditional paper-based instructions lack expressiveness and <a class="link-external link-http" href="http://interactivity.To" rel="external noopener nofollow">this http URL</a> tackle the two problems above, we present BrickPal, an augmented reality-based system, which visualizes assembly instructions in an augmented reality head-mounted display. It utilizes Natural Language Processing (NLP) techniques to generate plausible assembly sequences, and provide real-time guidance in the AR headset.Our user study demonstrates BrickPal's effectiveness at assisting users in brick assembly compared to traditional assembly methods. Additionally, the NLP algorithm-generated assembly sequences achieve the same usability with manually adapted sequences.
Human-Computer Interaction,Artificial Intelligence
What problem does this paper attempt to address?