Abstract:The field of AI-assisted music creation has made significant strides, yet existing systems often struggle to meet the demands of iterative and nuanced music production. These challenges include providing sufficient control over the generated content and allowing for flexible, precise edits. This thesis tackles these issues by introducing a series of advancements that progressively build upon each other, enhancing the controllability and editability of text-to-music generation models. First, we introduce Loop Copilot, a system that tries to address the need for iterative refinement in music creation. Loop Copilot leverages a large language model (LLM) to coordinate multiple specialised AI models, enabling users to generate and refine music interactively through a conversational interface. Central to this system is the Global Attribute Table, which records and maintains key musical attributes throughout the iterative process, ensuring that modifications at any stage preserve the overall coherence of the music. While Loop Copilot excels in orchestrating the music creation process, it does not directly address the need for detailed edits to the generated content. To overcome this limitation, MusicMagus is presented as a further solution for editing AI-generated music. MusicMagus introduces a zero-shot text-to-music editing approach that allows for the modification of specific musical attributes, such as genre, mood, and instrumentation, without the need for retraining. By manipulating the latent space within pre-trained diffusion models, MusicMagus ensures that these edits are stylistically coherent and that non-targeted attributes remain unchanged. This system is particularly effective in maintaining the structural integrity of the music during edits, but it encounters challenges with more complex and real-world audio scenarios. ...

Play Me Something Icy: Practical Challenges, Explainability and the Semantic Gap in Generative AI Music

Explainability Paths for Sustained Artistic Practice with AI

Exploring Variational Auto-Encoder Architectures, Configurations, and Datasets for Generative Music Explainable AI

Improving Controllability and Editability for Pretrained Text-to-Music Generation Models

Novice-AI Music Co-Creation via AI-Steering Tools for Deep Generative Models

MusicJam: Visualizing Music Insights via Generated Narrative Illustrations

A Survey of Music Generation in the Context of Interaction

The creative performance of the AI agents ChatGPT and Google Magenta compared to human-based solutions in a standardized melody continuation task

An Autoethnographic Exploration of XAI in Algorithmic Composition

The Interpretation Gap in Text-to-Music Generation Models

Between the AI and Me: Analysing Listeners' Perspectives on AI- and Human-Composed Progressive Metal Music

Towards the Generation of Musical Explanations with GPT-3

Creative Text-to-Audio Generation via Synthesizer Programming

Artificial Intelligence and Musicking

A Study on Teaching Plans for Music Creation Applying Generative AI Based on ‘Text to Music’ to Group Investigation Model

Generating Mixcode Popular Songs with Artificial Intelligence: Concepts, Plans, and Speculations

A Review of Intelligent Music Generation Systems

Deep learning for music generation: challenges and directions

Generative Disco: Text-to-Video Generation for Music Visualization

A Comprehensive Survey for Evaluation Methodologies of AI-Generated Music

How Music AI Is Useful: Engagements with Composers, Performers and Audiences