Abstract:Sketch-based melody creation systems enable people to compose melodies by converting human-sketched melody contours into coherent melodies that fit the depicted contours. This remains one of the most intuitive approaches to interactive music creation. However, previous studies are still stagnating in limitations regarding usability and interpretability, which hinders effective interactions between people and AI. For one thing, these studies entail additional complex musical conditions as auxiliary inputs (e.g. chord progressions, contextual melodies, and predetermined rhythms), supporting only fixed-length and rule-based melody generation. This makes existing systems less usable, with generated melodies lacking diversity and coherence. Moreover, users without enough musical expertise might find it difficult to define appropriate inputs and to interpret the role of these inputs in guiding melody generation. To address these limitations, we present Drawlody, a novel sketch-based melody creation system with enhanced usability and interpretability. Specifically, Drawlody simplifies user input requirements by excluding all complex musical conditions, using only a simplified melody contour representation named Generalised Melody Contour (GMC) as input. This simplification clarifies the role of user controls, making the system more usable for people without musical training. To guide coherent melody generation from GMC, we propose FlexMIDI music representation, which simulates the tonal structure of melodies and faithfully explains how human-sketched contours guide melody generation. We employ a CNN-Transformer-based architecture as the foundation model to achieve arbitrary-length melody generation. Drawlody is evaluated by both objective and subjective music quality studies, as well as a usability and interpretability study. The results support its enhanced usability, interpretability, and high-quality melody generation capabilities. Video demos of the system are presented here.

MIDI-LAB, a Powerful Visual Basic Program for Creating MIDI Music

Mind Band: A Crossmedia AI Music Composing Platform

DrumGenius: bridging learning-gap with interactive musical instruments.

Teacher-Student Interactive Creation Strategies in Music Teaching Assisted by Computer Information Technology

JAMMIN-GPT: Text-based Improvisation using LLMs in Ableton Live

Design of Simulation Software for Experiments with Visual Basic

MIDI-Draw: Sketching to Control Melody Generation

The possibility of the application of modern vocal music technology in vocal music education / La potencial aplicación de las nuevas tecnologías de la música vocal en la enseñanza de la música vocal

The Intelligent Music Editor: Towards An Automated Platform For Music Analysis And Editing

Modern music production equipment and how it can be used in student teaching: overture and its impact on motivation and interest in electronic music creation

Composer's Assistant 2: Interactive Multi-Track MIDI Infilling with Fine-Grained User Control

AI TrackMate: Finally, Someone Who Will Give Your Music More Than Just "Sounds Great!"

Music Representing Corpus Virtual: An Open Sourced Library for Explorative Music Generation, Sound Design, and Instrument Creation with Artificial Intelligence and Machine Learning

Drawlody: Sketch-Based Melody Creation with Enhanced Usability and Interpretability

BandNet: A Neural Network-based, Multi-Instrument Beatles-Style MIDI Music Composition Machine

Smart Edition of MIDI Files

Local deployment of large-scale music AI models on commodity hardware

Discovering novel computer music techniques by exploring the space of short computer programs

LiveScaler: Live control of the harmony of an electronic music track

Seed-Music: A Unified Framework for High Quality and Controlled Music Generation

Interactive methods for improving musical literacy among students with preschool education Majors at Teacher Training Universities: The effectiveness of the Kodály method