Multi-sensory Interactive Experience Design of Museum Musical Instrument Collections

Yanan Wu,Yiyuan Huang,Wenchen Guo,Xiao Li,Zhirui Chen,Zheyu Feng,Yubin Zhu,Guoyu Sun
DOI: https://doi.org/10.1007/978-3-031-48044-7_30
2023-01-01
Abstract:This paper explores museum musical instrument exhibits' current status and development trends. It highlights the importance of multi-sensory interaction for the museum experience, especially for musical instrument exhibits. Based on existing literatures and case studies, the strengths and weaknesses of current musical instrument exhibit interaction forms are analyzed, and the possibility of applying intelligent replicas to museum musical instrument interaction is proposed. This project produced an interactive prototype in which a physical model of chimes is embedded in a digital component that serves as an interface to control the delivery of virtual instrument sounds and animation effects on screen. The aim is to restore the functionality of the chimes as musical instruments by representing their visual, acoustic, and in some cases, tactile characteristics to visitors through physical interaction.
What problem does this paper attempt to address?