Abstract:In recent years, the integration of brain–computer interface technology and neural networks in the field of music generation has garnered widespread attention. These studies aimed to extract individual-specific emotional and state information from electroencephalogram (EEG) signals to generate unique musical compositions. While existing research has focused primarily on brain regions associated with emotions, this study extends this research to brain regions related to musical composition. To this end, a novel neural network model incorporating attention mechanisms and steady-state activation mapping (SSAM) was proposed. In this model, the self-attention module enhances task-related information in the current state matrix, while the extended attention module captures the importance of state matrices over different time frames. Additionally, a convolutional neural network layer is used to capture spatial information. Finally, the ECA module integrates the frequency information learned by the model in each of the four frequency bands, mapping these by learning their complementary frequency information into the final attention representation. Evaluations conducted on a dataset specifically constructed for this study revealed that the model surpassed representative models in the emotion recognition field, with recognition rate improvements of 1.47% and 3.83% for two different music states. Analysis of the attention matrix indicates that the left frontal lobe and occipital lobe are the most critical brain regions in distinguishing between 'recall and creation' states, while FP1, FPZ, O1, OZ, and O2 are the electrodes most related to this state. In our study of the correlations and significances between these areas and other electrodes, we found that individuals with musical training exhibit more extensive functional connectivity across multiple brain regions. This discovery not only deepens our understanding of how musical training can enhance the brain's ability to work in coordination but also provides crucial guidance for the advancement of brain–computer music generation technologies, particularly in the selection of key brain areas and electrode configurations. We hope our research can guide the work of EEG-based music generation to create better and more personalized music.

Music-emotion EEG coupling effects based on representational similarity

Using Psychophysiologicalmeasures to Recognize Personalmusic Emotional Experience

Image–Music Synesthesia-Aware Learning Based on Emotional Similarity Recognition

An EEG-Based brain informatics application for enhancing music experience

Human-centric Music Medical Therapy Exploration System

Exploratory Cross-Frequency Coupling and Scaling Analysis of Neuronal Oscillations Stimulated by Emotional Images: an Evidence from EEG

Music-evoked emotion recognition based on cognitive principles inspired EEG temporal and spectral features

Music emotion recognition based on temporal convolutional attention network using EEG

Multi-Modal Integration of EEG-fNIRS for Characterization of Brain Activity Evoked by Preferred Music

EEG Processing in Emotion Recognition: Inspired from a Musical Staff.

Analysis and recognition of a novel experimental paradigm for musical emotion brain-computer interface

Fusion of electroencephalographic dynamics and musical contents for estimating emotional responses in music listening

EEG Connectivity during Active Emotional Musical Performance

Enhancing Emotion Recognition Using Region-Specific Electroencephalogram Data and Dynamic Functional Connectivity

Neural correlates of the popular music phenomenon: evidence from functional MRI and PET imaging

EEG Emotion Recognition Applied to the Effect Analysis of Music on Emotion Changes in Psychological Healthcare

Music-evoked Emotion Classification Using EEG Correlation-Based Information

Effective Network Analysis in Music Listening Based on Electroencephalogram

How Does Music Affect Your Brain? A Pilot Study on EEG and Music Features for Automatic Analysis

Exploring Brain Dynamics via EEG and Steady-State Activation Map Networks in Music Composition

Electrophysiological Representations of Multivariate Human Emotion Experience