MusicCollage: A Music Composition Tool for Children Based on Synesthesia and a Genetic Algorithm

Ge Yan,Cheng Yao,Chao Zhang,Jiadi Wang,Yuqi Hu,Fangtian Ying

DOI: https://doi.org/10.1007/978-3-031-05431-0_15

2022-01-01

Abstract:Creating music can be challenging for children aged 4-6. Making the creation procedure more interesting has been proved to stimulate and build children's interests in music. Based on the design concept of synesthesia from vision to hearing, we propose an application bywhich children aged 4-6 can create collages by matching different images of scenes and animals. The information contained in the created collages is then used as input parameters for generating music so as to create melodies corresponding to the collages. To evaluate our approach, we conducted a quantitative and qualitative user study with children (n = 6) by using our initial prototype. We concluded that the proposed application helps cultivate children's willingness to create melodies, and helps children better perceive and understand music by combining scenes and animal images in the collages.