ASAP: animation system for agent-based presentations
Minsoo Choi,Christos Mousas,Nicoletta Adamo,Sanjeevani Patankar,Klay Hauser,Fangzheng Zhao,Richard E. Mayer
DOI: https://doi.org/10.1007/s00371-024-03622-w
IF: 2.835
2024-10-05
The Visual Computer
Abstract:We introduce an animation system that transforms instructional videos into 3D animations with pedagogical agents, supplemented by animation editing tools to foster expressive, agent-based presentations, thereby enhancing educational benefits. Our system extracts the lecturer's motion from the imported instructional video. Once the data extraction is complete, the system retargets this motion to the virtual agent and integrates it into a virtual classroom environment. Subsequently, it provides a GUI-based animation editing tool, offering a range of resources, such as motion assets (e.g., upper body gestures, facial expressions), which enable users to layer them on top of the extracted motion to make the pedagogical agent's motions more engaging. To evaluate our system, we conducted a user study encompassing non-expert and expert groups, employing a mixed-method approach by collecting both quantitative and qualitative data. The results demonstrated our system's educational value, functionality, and usability. Furthermore, the comparative analysis between the non-expert (people with no animation experience) and expert (people with prior animation experience) user groups provided distinct perspectives on our system, reflecting differences in the user's animation experience and expertise. However, both groups reported similar usability and task load levels, indicating that non-experts can use our system efficiently to produce expressive agent-based presentations. We plan to release our system as an open source, cross-platform solution to help educators create engaging agent-based presentations.
computer science, software engineering