The Art of Storytelling: Multi-Agent Generative AI for Dynamic Multimodal Narratives

Samee Arif,Taimoor Arif,Muhammad Saad Haroon,Aamina Jamal Khan,Agha Ali Raza,Awais Athar

2024-09-19

Abstract:This paper introduces the concept of an education tool that utilizes Generative Artificial Intelligence (GenAI) to enhance storytelling for children. The system combines GenAI-driven narrative co-creation, text-to-speech conversion, and text-to-video generation to produce an engaging experience for learners. We describe the co-creation process, the adaptation of narratives into spoken words using text-to-speech models, and the transformation of these narratives into contextually relevant visuals through text-to-video technology. Our evaluation covers the linguistics of the generated stories, the text-to-speech conversion quality, and the accuracy of the generated visuals.

Computation and Language