Abstract:We present a method for producing documentary-style content using real-time scientific visualization. We produce molecumentaries, i.e., molecular documentaries featuring structural models from molecular biology. We employ scalable methods instead of the rigid traditional production pipeline. Our method is motivated by the rapid evolution of interactive scientific visualization, which shows great potential in science dissemination. Without some form of explanation or guidance, however, novices and lay-persons often find it difficult to gain insights from the visualization itself. We integrate such knowledge using the verbal channel and provide it along an engaging visual presentation. To realize the synthesis of a molecumentary, we provide technical solutions along two major production steps: 1) preparing a story structure and 2) turning the story into a concrete narrative. In the first step, information about the model from heterogeneous sources is compiled into a story graph. Local knowledge is combined with remote sources to complete the story graph and enrich the final result. In the second step, a narrative, i.e., story elements presented in sequence, is synthesized using the story graph. We present a method for traversing the story graph and generating a virtual tour, using automated camera and visualization transitions. Texts written by domain experts are turned into verbal representations using text-to-speech functionality and provided as a commentary. Using the described framework we synthesize automatic fly-throughs with descriptions that mimic a manually authored documentary. Furthermore, we demonstrate a second scenario: guiding the documentary narrative by a textual input.

Documentary narrative visualization: Features and modes of documentary film in narrative visualization

Cinematic Techniques in Narrative Visualization

Storytelling and Visualization: an Extended Survey.

Telling stories with data -- A systematic review

Decoupling narrative visualizations into components: Helping designers to tell data-driven stories

Narrative Transitions in Data Videos

Envisioning Narrative Intelligence: A Creative Visual Storytelling Anthology

Towards Narrative Medical Visualization

Animated narrative visualization for video clickstream data

Once Upon a Time in a Land Far Away: Guidelines for Spatio-Temporal Narrative Visualization

Sea of Genes: Combining Animation and Narrative Strategies to Visualize Metagenomic Data for Museums

Blurring the Lines: Feature News Videos and Documentaries in a New Digital Age

Leveraging Foundation Models for Crafting Narrative Visualization: A Survey

Narrative Player: Reviving Data Narratives with Visuals

Use of virtual reality and 360° video as narrative resources in the documentary genre: Towards a new immersive social documentary?

Telling Data Stories with the Hero's Journey: Design Guidance for Creating Data Videos

Coupling Story to Visualization: Using Textual Analysis as a Bridge Between Data and Interpretation

Research on Narrative Strategies and Innovations of Netflix Documentaries in the Grierson Model: Take Documentary City of Wonder as An Example

Narrative Strategies in Web Documentaries

Molecumentary: Scalable Narrated Documentaries Using Molecular Visualization

Documentary and Cognitive Theory: Narrative, Emotion and Memory