ViolinBot: A Framework for Imitation Learning of Violin Bowing Using Fuzzy Logic and PCA

Cong Jin,Xiaoyu Liu,YuFei Zhao,Yonggui Zhu,Jie Wang,Hesheng Wang

DOI: https://doi.org/10.1109/tfuzz.2024.3409146

IF: 12.253

2024-01-01

IEEE Transactions on Fuzzy Systems

Abstract:In this article, an imitation learning framework is innovatively developed for robot skills learning in violin bowing. The introduction of dynamic movement primitives (DMPs) to model motion addresses issues such as the uncertainty in changing string angles, which traditional methods like physical measurements are highly error-prone and nongeneralizable. Alternatively, conventional rule-based methods often fail to precisely mimic the complex playing techniques of humans, especially in terms of musicality and emotional expression. To address this, we propose a new model named fuzzy and PCA-dynamic movement primitive (FP-DMP), built upon Type-2 fuzzy models and principal component analysis (PCA). This model utilizes variables derived from PCA (bowing plane angles) as inputs for the membership function and employs fuzzy k-means clustering to identify the angle of the violin bowing plane, independent of physical measurements or positional information. In addition, we have developed a professional-level musical performance behavior database through a task-parameterized Gaussian mixture model (TP-GMM). Biomimetic experiments prove that our FP-DMP model can control robots for high-precision violin performances. The core technology, FP-DMP, combines Gaussian mixture models (GMM) and PCA for efficient trajectory clustering based on bowing angles, uses type-2 fuzzy K-means for nuanced differentiation of violin string trajectories, and innovatively adapts the force term in DMP to account for the nonlinear friction encountered in violin playing. This not only advances imitation learning in complex performance tasks for robots, but also opens new research avenues for imitation learning in other highly specialized and technically challenging fields.