Abstract:In recent years, the integration of brain–computer interface technology and neural networks in the field of music generation has garnered widespread attention. These studies aimed to extract individual-specific emotional and state information from electroencephalogram (EEG) signals to generate unique musical compositions. While existing research has focused primarily on brain regions associated with emotions, this study extends this research to brain regions related to musical composition. To this end, a novel neural network model incorporating attention mechanisms and steady-state activation mapping (SSAM) was proposed. In this model, the self-attention module enhances task-related information in the current state matrix, while the extended attention module captures the importance of state matrices over different time frames. Additionally, a convolutional neural network layer is used to capture spatial information. Finally, the ECA module integrates the frequency information learned by the model in each of the four frequency bands, mapping these by learning their complementary frequency information into the final attention representation. Evaluations conducted on a dataset specifically constructed for this study revealed that the model surpassed representative models in the emotion recognition field, with recognition rate improvements of 1.47% and 3.83% for two different music states. Analysis of the attention matrix indicates that the left frontal lobe and occipital lobe are the most critical brain regions in distinguishing between 'recall and creation' states, while FP1, FPZ, O1, OZ, and O2 are the electrodes most related to this state. In our study of the correlations and significances between these areas and other electrodes, we found that individuals with musical training exhibit more extensive functional connectivity across multiple brain regions. This discovery not only deepens our understanding of how musical training can enhance the brain's ability to work in coordination but also provides crucial guidance for the advancement of brain–computer music generation technologies, particularly in the selection of key brain areas and electrode configurations. We hope our research can guide the work of EEG-based music generation to create better and more personalized music.

Mind Band: A Crossmedia AI Music Composing Platform

Human-centric Music Medical Therapy Exploration System

SongDriver2: Real-time Emotion-based Music Arrangement with Soft Transition.

An EEG-Based brain informatics application for enhancing music experience

Real-Time Human-Music Emotional Interaction Based on Deep Learning and Multimodal Sentiment Analysis

MoMusic: A Motion-Driven Human-AI Collaborative Music Composition and Performing System

Exploring Real-Time Music-to-Image Systems for Creative Inspiration in Music Creation

Emotion Manipulation Through Music -- A Deep Learning Interactive Visual Approach

Real-time Human-Music Emotional Interaction Based on Multimodal Analysis

MemoMusic 4.0: Personalized Emotion Music Generation Conditioned by Valence and Arousal As Virtual Tokens

XiaoIce Band

EmotionBox: A music-element-driven emotional music generation system based on music psychology

ComposerX: Multi-Agent Symbolic Music Composition with LLMs

Bridging Paintings and Music -- Exploring Emotion based Music Generation through Paintings

Multi-Think Transformer for Enhancing Emotional Health

Exploring Brain Dynamics via EEG and Steady-State Activation Map Networks in Music Composition

ByteComposer: a Human-like Melody Composition Method based on Language Model Agent

An interactive music infilling interface for pop music composition

Mind-modulated Music in the Mind Attention Interface.

Amplifying the Music Listening Experience through Song Comments on Music Streaming Platforms

SoundScape: A Human-AI Co-Creation System Making Your Memories Heard