Wrist-Worn Sensor-Based Tangible Interface for Virtual Percussion Instruments.

Abassin Sourou Fangbemi,Yanxiang Zhang

DOI: https://doi.org/10.1007/978-3-319-95270-3_4

2018-01-01

Abstract:Virtual musical instruments (VMIs) are Augmented Reality (AR) or Virtual Reality (VR) based applications that focus on the interaction with real or virtual musical objects through AR or VR mediums. For such purpose, different interaction tools and techniques such as fiducial markers, RGB and depth cameras, VR and AR headsets are used. Though modern AR and VR devices provide better interaction interfaces, they are more expensive than traditional ones that are unfortunately not robust as the modern devices. To provide a robust and affordable AR and VR interaction interface for real-time applications, we investigate the use of affordable body-worn inertial measurement unit (IMU), a web camera, an RGB light as a simple, cheaper and reliable solution for the interaction with virtual percussion instruments. The performance of the proposed system was evaluated through a series of feedback from fifteen users. In general, the framework was considered as intuitive and tangible.<bold> </bold>