Innovative Digital Storytelling with AIGC: Exploration and Discussion of Recent Advances

Rongzhang Gu,Hui Li,Changyue Su,Wayne Wu
2023-09-28
Abstract:Digital storytelling, as an art form, has struggled with cost-quality balance. The emergence of AI-generated Content (AIGC) is considered as a potential solution for efficient digital storytelling production. However, the specific form, effects, and impacts of this fusion remain unclear, leaving the boundaries of AIGC combined with storytelling undefined. This work explores the current integration state of AIGC and digital storytelling, investigates the artistic value of their fusion in a sample project, and addresses common issues through interviews. Through our study, we conclude that AIGC, while proficient in image creation, voiceover production, and music composition, falls short of replacing humans due to the irreplaceable elements of human creativity and aesthetic sensibilities at present, especially in complex character animations, facial expressions, and sound effects. The research objective is to increase public awareness of the current state, limitations, and challenges arising from combining AIGC and digital storytelling.
Human-Computer Interaction,Artificial Intelligence,Computer Vision and Pattern Recognition,Graphics,Multimedia
What problem does this paper attempt to address?
The paper primarily explores the applications and challenges of Artificial Intelligence Generated Content (AIGC) in digital storytelling. Specifically, the researchers demonstrate how to use AIGC tools to generate various multimedia elements, including scripts, character appearances, scene images, animations, audio, and video, through an experimental project called "Naked Monkey’s Happy Discovery." Although AIGC performs excellently in image creation, voice-over production, and music arrangement, it currently cannot completely replace human creators, especially in complex character animations, facial expressions, and sound effect design. The core objective of the research is to enhance public awareness of the current state, limitations, and challenges of combining AIGC with digital storytelling. Additionally, the paper collects opinions from experts and artists within the creative industry through interviews regarding the application of AIGC in digital storytelling. The interviewees generally believe that AIGC helps improve artistic creation efficiency but cannot fully replace human artistic creativity at this stage. Therefore, AIGC should be used as an auxiliary tool rather than a substitute to enhance artists' creative thinking and the quality of their works. In summary, this paper aims to explore the potential of AIGC technology in digital storytelling creation and provide suggestions for its future development direction.