Abstract:Objective According to the characteristics of Fuzhou Shadow Play, digital reconstruction and innovative display are carried out through somatosensory interaction to enhance the audience's senses of participation and immersion, provide a new technical path for Intangible Cultural Heritage Inheritance and digital protection, and make the audience feel the charm of Chinese excellent traditional cultures. Methods On Microsoft Kinect 2.0 equipped with a CMOS depth sensor, depth data are acquired through the time-of-flight (TOF) ranging algorithm, which is based on the two-way ranging information technology of asynchronous transceivers. By collecting the depth image within the field-of-view of an infrared camera, the sensor uses a high-speed generated image stream with depth information to reproduce the scene in three dimensions. The optimized preprocessing shortens the evaluation of images with depth information, which is used to identify various parts of the human body. In the depth image, a specific mask area is created for each tracked viewer. Each pixel in the mask is transmitted to a machine learning system to identify various parts of the human body. Each recognized part is marked with the possibility of a specific pixel for the part, and a complete skeleton system is generated according to the coordinates of the 20 joint points tracked. Then the three-dimensional space data of the human body limbs are sent to the computer. Results Subsequent interactive reconstruction shows the human body movement and the joint point shadow puppet model movement match well, without model interspersion or bone damage. Conclusions The threedimensional digital preservation of shadow puppet entity realized by the construction of a joint point shadow puppet model eliminates time and space limitations against preservation of shadow puppet entity, highlights the immersion experience and reconstruction of drama time and space, creates a new interactive relationship of traditional drama performance, and changes the way of performing, viewing and creating Fuzhou shadow puppet art.

Reconstruction: A Motion Driven Interactive Artwork Inspired by Chinese Shadow Puppet

Integrating old chinese shadow play-piying into tangible interaction (abstract only).

Restoration of traditional Chinese shadow play-Piying art from tangible interaction

A Method of Shadow Puppet Figure Modeling and Animation

The Interactive Narration of Chinese Shadow Play

Real-time Digitised Shadow Play Performance Method Based on Multi-Point Interactive Controlling Method

Shadow toy: The children's toy-making system based on paintings

Reconstruction of somatosensory interaction in Fuzhou Shadow Play based on depth image recognition

Enhancing the Motivation of Young Learners in Intangible Cultural Heritage Education: A Creative Real-Time Finger Tracking System for Chinese Shadow Puppetry

The Application of Digital Interactive Technology in Shadow Play Art

ShadowPlayVR: Understanding Traditional Shadow Puppetry Performance Techniques Through Non-Intuitive Embodied Interactions.

ShadowMaker: Sketch-Based Creation Tool for Digital Shadow Puppetry

Puppetanimator: A Performative Interface for Experiencing Shadow Play

Exploitation of Multiplayer Interaction and Development of Virtual Puppetry Storytelling Using Gesture Control and Stereoscopic Devices.

Exploitation Of Novel Multiplayer Gesture-Based Interaction And Virtual Puppetry For Digital Storytelling To Develop Children'S Narrative Skills

THE SOCIAL INTERFACES DEVELOPMENT FOR CULTURAL CREATIVITY INDUSTRY: A USER-CENTRED DESIGN CASE STUDY ON CHINESE SHADOW PUPPETRY

Lumina: A Software Tool for Fostering Creativity in Designing Chinese Shadow Puppets

Ontology-Based Interactive Animation/Game Generation for Chinese Shadow Play Preservation

Inheritance and innovation of Chinese shadow puppetry art in digital media art teaching in colleges and universities

Promoting the Culture of Qinhuai River Lantern Shadow Puppetry with a Digital Archive and Immersive Experience

Contemporary Chinese Animation Design as a Reinterpretation of Traditional Cultural Connotations Based on Shadow Puppet Theater