Sounds of History: A Digital Twin Approach to Musical Heritage Preservation in Virtual Museums

Changman Zou,Sang-Yong Rhee,Lin He,Dayang Chen,Xiaofei Yang

DOI: https://doi.org/10.3390/electronics13122388

IF: 2.9

2024-06-19

Electronics

Abstract:Musical cultural heritage, as an important component of cultural heritage, possesses significant cultural value and inheritance significance. With the development of society and the passage of time, these precious traditional musical cultural heritages inevitably face the dilemma of gradual depletion or even disappearance. In the digital age, effectively protecting and inheriting these musical cultural heritages has become an urgent problem to be addressed. Therefore, this paper proposes an application method based on digital twin technology, exploring how to protect and inherit musical cultural heritages through digital twin technology. By leveraging digital twin technology, a virtual museum dedicated to showcasing the richness and historical connotations of music cultures is created, preserving and simulating the soundscapes of historical music eras. Through the integration of audio archives, 3D modeling, and interactive displays, users can immerse themselves in the experience of historical music in the digital space. This paper evaluates the feasibility and cultural preservation value of this digital music history museum through the creation of music digital twin technology instances and user survey feedback and discusses the prospects of digital twins in the field of musical cultural heritage.

engineering, electrical & electronic,computer science, information systems,physics, applied

What problem does this paper attempt to address?

The paper primarily explores how to use digital twin technology to protect and inherit musical cultural heritage and achieve this goal in virtual museums. Specifically, the paper attempts to address the following key issues:

1. **Challenges faced by musical cultural heritage**: With globalization and social changes, many traditional forms of music are at risk of disappearing. Additionally, the oral transmission method of traditional music makes it prone to being lost. While modern technology helps in recording music, it may not fully capture the emotional expression and other details of live performances.

2. **Limitations of existing protection methods**: Existing methods for protecting musical cultural heritage (such as manual recording, document collection, etc.) are often constrained by resources and technology, making it difficult to comprehensively and effectively protect these heritages.

3. **Application potential of digital twin technology**: As an emerging digital technology and exhibition concept, digital twin technology can create a virtual world as a new platform for cultural display, presenting musical cultural heritage to the public in a digital form. By constructing digital twins of musical cultural heritage, it is possible not only to more comprehensively record and preserve musical works, instruments, and playing methods but also to provide researchers and the public with an interactive immersive experience.

4. **Specific implementation plan**: The paper takes Chinese Kunqu Opera as an example, attempting to use digital twin technology and related metaverse technologies to establish a virtual museum and virtual music interaction platform. By integrating technologies such as Virtual Reality (VR), Augmented Reality (AR), blockchain, and Artificial Intelligence (AI), a virtual space named "Kunqu Metaverse" is constructed. Users can explore and participate in virtual creative activities guided by a virtual character named "Kunkun."

5. **Evaluation and outlook**: Through comprehensive analysis of user experience and dissemination effects, the paper not only verifies the effectiveness of this method in protecting musical cultural heritage but also provides valuable references for the construction of the metaverse in the field of intangible cultural heritage. This innovative approach opens up new perspectives for the inheritance and protection of musical cultural heritage, showcasing the outstanding achievements of advanced technology in the display and dissemination of cultural heritage.

In summary, the paper aims to explore the application possibilities of digital twin technology in the field of musical cultural heritage protection, particularly the practical application effects in virtual museum scenarios, as well as the specific challenges faced and solutions.