Abstract:In recent years, artificial neural networks (ANNs) have become a universal tool for tackling real-world problems. ANNs have also shown great success in music-related tasks including music summarization and classification, similarity estimation, computer-aided or autonomous composition, and automatic music analysis. As structure is a fundamental characteristic of Western music, it plays a role in all these tasks. Some structural aspects are particularly challenging to learn with current ANN architectures. This is especially true for mid- and high-level self-similarity, tonal and rhythmic relationships. In this thesis, I explore the application of ANNs to different aspects of musical structure modeling, identify some challenges involved and propose strategies to address them. First, using probability estimations of a Restricted Boltzmann Machine (RBM), a probabilistic bottom-up approach to melody segmentation is studied. Then, a top-down method for imposing a high-level structural template in music generation is presented, which combines Gibbs sampling using a convolutional RBM with gradient-descent optimization on the intermediate solutions. Furthermore, I motivate the relevance of musical transformations in structure modeling and show how a connectionist model, the Gated Autoencoder (GAE), can be employed to learn transformations between musical fragments. For learning transformations in sequences, I propose a special predictive training of the GAE, which yields a representation of polyphonic music as a sequence of intervals. Furthermore, the applicability of these interval representations to a top-down discovery of repeated musical sections is shown. Finally, a recurrent variant of the GAE is proposed, and its efficacy in music prediction and modeling of low-level repetition structure is demonstrated.

PopMNet: Generating Structured Pop Music Melodies Using Neural Networks

A Hierarchical Recurrent Neural Network for Symbolic Melody Generation.

MidiNet: A Convolutional Generative Adversarial Network for Symbolic-domain Music Generation

Hierarchical Recurrent Neural Networks for Conditional Melody Generation with Long-term Structure

Generating Nontrivial Melodies for Music as a Service

Pop Music Generation

Hierarchical Symbolic Pop Music Generation with Graph Neural Networks

MeloTrans: A Text to Symbolic Music Generation Model Following Human Composition Habit

The Effect of Explicit Structure Encoding of Deep Neural Networks for Symbolic Music Generation

2019 Formatting Instructions for Authors Using LaTeX

Melody Structure Transfer Network: Generating Music with Separable Self-Attention

Structure-Enhanced Pop Music Generation via Harmony-Aware Learning

MeloForm: Generating Melody with Musical Form based on Expert Systems and Neural Networks

Song From PI: A Musically Plausible Network for Pop Music Generation

MELONS: generating melody with long-term structure using transformers and structure graph

Modeling Musical Structure with Artificial Neural Networks

Modeling the Rhythm from Lyrics for Melody Generation of Pop Song

A Framework for Automated Pop-song Melody Generation with Piano Accompaniment Arrangement

Impromptu Accompaniment of Pop Music Using Coupled Latent Variable Model with Binary Regularizer

Personalized Popular Music Generation Using Imitation and Structure

Generating Music with Structure Using Self-Similarity as Attention