Exploring Brain Dynamics via EEG and Steady-State Activation Map Networks in Music Composition

Xiaohu Gu,Leqi Jiang,Hao Chen,Ming Li,Chang Liu
DOI: https://doi.org/10.3390/brainsci14030216
IF: 3.333
2024-02-28
Brain Sciences
Abstract:In recent years, the integration of brain–computer interface technology and neural networks in the field of music generation has garnered widespread attention. These studies aimed to extract individual-specific emotional and state information from electroencephalogram (EEG) signals to generate unique musical compositions. While existing research has focused primarily on brain regions associated with emotions, this study extends this research to brain regions related to musical composition. To this end, a novel neural network model incorporating attention mechanisms and steady-state activation mapping (SSAM) was proposed. In this model, the self-attention module enhances task-related information in the current state matrix, while the extended attention module captures the importance of state matrices over different time frames. Additionally, a convolutional neural network layer is used to capture spatial information. Finally, the ECA module integrates the frequency information learned by the model in each of the four frequency bands, mapping these by learning their complementary frequency information into the final attention representation. Evaluations conducted on a dataset specifically constructed for this study revealed that the model surpassed representative models in the emotion recognition field, with recognition rate improvements of 1.47% and 3.83% for two different music states. Analysis of the attention matrix indicates that the left frontal lobe and occipital lobe are the most critical brain regions in distinguishing between 'recall and creation' states, while FP1, FPZ, O1, OZ, and O2 are the electrodes most related to this state. In our study of the correlations and significances between these areas and other electrodes, we found that individuals with musical training exhibit more extensive functional connectivity across multiple brain regions. This discovery not only deepens our understanding of how musical training can enhance the brain's ability to work in coordination but also provides crucial guidance for the advancement of brain–computer music generation technologies, particularly in the selection of key brain areas and electrode configurations. We hope our research can guide the work of EEG-based music generation to create better and more personalized music.
neurosciences
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to explore the relationship between electroencephalogram (EEG) signals and the music creation process, especially to identify and analyze the dynamic changes of the brain in the states of music recall and creation through Steady - State Activation Map Networks (SSAM). Specifically, the research aims to: 1. **Compare the differences in brain region activation between passive music listening and active music recall and creation**: By designing specific experimental paradigms, record the EEG data of participants when receiving music melody stimulation and recalling and creating melodies, in order to distinguish different patterns of brain activity in these two states. 2. **Identify the brain regions and electrodes most closely related to music memory and creation states**: Use the proposed self - attention neural network model based on SSAM to accurately locate the brain regions and electrode positions that play a key role in the music creation process. 3. **Improve the accuracy of music creation state recognition**: By introducing a new neural network model, combining the self - attention mechanism and steady - state activation mapping, improve the recognition rate of music recall and creation states, especially showing significant performance improvement in subjects with different music backgrounds. 4. **Analyze the cooperation patterns of brain regions in the music creation process**: Thoroughly explore the activity changes of brain regions in different frequency bands and their manifestations in different subjects, reveal the collaborative working patterns among brain regions in the music creation process, thereby enriching the understanding of the neural mechanism of music creativity. In conclusion, through innovative methods and techniques, this paper not only deepens the understanding of brain activity patterns in the music creation process, but also provides important guidance and reference for future brain - computer interface music generation technologies.