This time with feeling: learning expressive musical performance

Sageev Oore,Ian Simon,Sander Dieleman,Douglas Eck,Karen Simonyan
DOI: https://doi.org/10.1007/s00521-018-3758-9
2018-11-14
Neural Computing and Applications
Abstract:AbstractMusic generation has generally been focused on either creating scores or interpreting them. We discuss differences between these two problems and propose that, in fact, it may be valuable to work in the space of direct performance generation: jointly predicting the notes and also their expressive timing and dynamics. We consider the significance and qualities of the dataset needed for this. Having identified both a problem domain and characteristics of an appropriate dataset, we show an LSTM-based recurrent network model that subjectively performs quite well on this task. Critically, we provide generated examples. We also include feedback from professional composers and musicians about some of these examples.
computer science, artificial intelligence
What problem does this paper attempt to address?