Abstract:Initiating a quest to unravel the complexities of musical aesthetics through the lens of information dynamics, our study delves into the realm of musical sequence modeling, drawing a parallel between the sequential structured nature of music and natural language.
Despite the prevalence of neural network models in MIR, the modeling of symbolic music events as applied to music cognition and music neuroscience has largely relied on statistical models. In this "proof of concept" paper we posit the superiority of neural network models over statistical models for predicting musical events. Specifically, we compare LSTM, Transformer, and GPT models against a widely-used markov model to predict a chord event following a sequence of chords.
Utilizing chord sequences from the McGill Billboard dataset, we trained each model to predict the next chord from a given sequence of chords. We found that neural models significantly outperformed statistical ones in our study. Specifically, the LSTM with attention model led with an accuracy of 0.329, followed by Transformer models at 0.321, GPT at 0.301, and standard LSTM at 0.191. Variable Order Markov and Markov trailed behind with accuracies of 0.277 and 0.140, respectively. Encouraged by these results, we extended our investigation to multidimensional modeling, employing a many-to-one LSTM, LSTM with attention, Transformer, and GPT predictors. These models were trained on both chord and melody lines as two-dimensional data using the CoCoPops Billboard dataset, achieving an accuracy of 0.083, 0.312, 0.271, and 0.120, respectively, in predicting the next chord.
What problem does this paper attempt to address?
### What problems does this paper attempt to solve?
This paper aims to explore the application of neural network models in music information dynamics, especially to reveal the complexity of music aesthetics from the perspective of information dynamics. Specifically, the authors studied the problem of music sequence modeling and made an analogy between the sequential structure of music and natural language.
#### Main research questions:
1. **Improvement of music event prediction**:
- The paper attempts to prove that neural network models (such as LSTM, Transformer, and GPT) are superior to traditional statistical models (such as Markov models) in predicting music events. Specifically, they compared the performance of these models in predicting chord sequences.
2. **Multidimensional music modeling**:
- Besides single - dimensional chord prediction, the author also extended the research and attempted to use multiple models for multidimensional music modeling, including the joint prediction of chords and melody lines.
3. **Model interpretability**:
- In order to make these models more suitable for music cognition research, the authors explored how to interpret the behavior of these models, including feature attribution and sensitivity analysis, to understand the basis for the model to classify music events.
4. **Cross - domain application**:
- The research also aims to highlight the potential of deep - learning models in interdisciplinary research in the music field, especially in music cognition and neuroscience, and to explore the cognitive process of human music expectation and its relationship with emotion and aesthetics.
#### Research background:
- In the field of music perception and cognition, statistical models such as Markov models and Bayesian inference models have been traditionally relied on to predict music structures.
- With the development of deep learning, neural network models (such as RNN, LSTM, Transformer, etc.) have been gradually applied to music generation and prediction tasks, but their applications in music cognition and neuroscience are relatively few.
- This paper verifies the superiority of neural network models in music prediction through experiments and explores their potential applications in music cognition research.
#### Experimental design:
- Use the McGill Billboard dataset and the CoCoPops dataset for training and evaluation.
- Compare the performance of multiple models (Markov, Variable Order Markov, LSTM, LSTM with Attention, Transformer, GPT) in single - dimensional and multidimensional music prediction tasks.
- Adopt multiple evaluation metrics, including accuracy, perplexity, and Word2Vec similarity, to comprehensively evaluate model performance.
#### Results:
- Neural network models are significantly superior to statistical models in predicting chord events. In particular, the LSTM with Attention model performs excellently in single - dimensional prediction.
- In multidimensional prediction, the Multi - LSTM with Attention model performs best, showing its advantage in processing multi - feature music data.
- Through sensitivity analysis and feature attribution, the dependence of different models on different positions and features of music sequences is revealed.
In conclusion, by comparing the performance of different models in music prediction tasks, this paper shows the potential of neural network models in music cognition and neuroscience research and provides new directions for future research.