Abstract:In recent years, artificial neural networks (ANNs) have become a universal tool for tackling real-world problems. ANNs have also shown great success in music-related tasks including music summarization and classification, similarity estimation, computer-aided or autonomous composition, and automatic music analysis. As structure is a fundamental characteristic of Western music, it plays a role in all these tasks. Some structural aspects are particularly challenging to learn with current ANN architectures. This is especially true for mid- and high-level self-similarity, tonal and rhythmic relationships. In this thesis, I explore the application of ANNs to different aspects of musical structure modeling, identify some challenges involved and propose strategies to address them. First, using probability estimations of a Restricted Boltzmann Machine (RBM), a probabilistic bottom-up approach to melody segmentation is studied. Then, a top-down method for imposing a high-level structural template in music generation is presented, which combines Gibbs sampling using a convolutional RBM with gradient-descent optimization on the intermediate solutions. Furthermore, I motivate the relevance of musical transformations in structure modeling and show how a connectionist model, the Gated Autoencoder (GAE), can be employed to learn transformations between musical fragments. For learning transformations in sequences, I propose a special predictive training of the GAE, which yields a representation of polyphonic music as a sequence of intervals. Furthermore, the applicability of these interval representations to a top-down discovery of repeated musical sections is shown. Finally, a recurrent variant of the GAE is proposed, and its efficacy in music prediction and modeling of low-level repetition structure is demonstrated.

Modelling High-Dimensional Sequences with LSTM-RTRBM: Application to Polyphonic Music Generation

Polyphonic Music Modelling with LSTM-RTRBM

LSTM Based Music Generation System

Music Generation Using Bidirectional Recurrent Network

Using a Bi-directional LSTM Model with Attention Mechanism trained on MIDI Data for Generating Unique Music

Multi-category MIDI music generation based on LSTM Generative adversarial network

Recurrent Neural Network Method for Automatic Generation of Music

Polyphonic Music Composition with LSTM Neural Networks and Reinforcement Learning

Hierarchical Recurrent Neural Networks for Conditional Melody Generation with Long-term Structure

A Hierarchical Recurrent Neural Network for Symbolic Melody Generation.

Modeling Musical Structure with Artificial Neural Networks

Melody generation using LSTM and BI-LSTM Network

A Novel Method of Music Generation Based on Three Different Recurrent Neural Networks

2019 Formatting Instructions for Authors Using LaTeX

Rethinking Recurrent Latent Variable Model for Music Composition

Novel LSTM-GAN Based Music Generation

Music Generation System for Adversarial Training Based on Deep Learning

Melody Generation using Deep Learning: Unleashing the Power of RNN and LSTM

Symphony Generation with Permutation Invariant Language Model

An Emotional Symbolic Music Generation System based on LSTM Networks

Modelling Symbolic Music: Beyond the Piano Roll