Abstract:In recent years, artificial neural networks (ANNs) have become a universal tool for tackling real-world problems. ANNs have also shown great success in music-related tasks including music summarization and classification, similarity estimation, computer-aided or autonomous composition, and automatic music analysis. As structure is a fundamental characteristic of Western music, it plays a role in all these tasks. Some structural aspects are particularly challenging to learn with current ANN architectures. This is especially true for mid- and high-level self-similarity, tonal and rhythmic relationships. In this thesis, I explore the application of ANNs to different aspects of musical structure modeling, identify some challenges involved and propose strategies to address them. First, using probability estimations of a Restricted Boltzmann Machine (RBM), a probabilistic bottom-up approach to melody segmentation is studied. Then, a top-down method for imposing a high-level structural template in music generation is presented, which combines Gibbs sampling using a convolutional RBM with gradient-descent optimization on the intermediate solutions. Furthermore, I motivate the relevance of musical transformations in structure modeling and show how a connectionist model, the Gated Autoencoder (GAE), can be employed to learn transformations between musical fragments. For learning transformations in sequences, I propose a special predictive training of the GAE, which yields a representation of polyphonic music as a sequence of intervals. Furthermore, the applicability of these interval representations to a top-down discovery of repeated musical sections is shown. Finally, a recurrent variant of the GAE is proposed, and its efficacy in music prediction and modeling of low-level repetition structure is demonstrated.

Bach in 2014: Music Composition with Recurrent Neural Network

Learning to Generate Music with BachProp

Polyphonic Music Composition with LSTM Neural Networks and Reinforcement Learning

BachProp: Learning to Compose Music in Multiple Styles

Automatic music composition algorithm based on recurrent neural network

Recurrent Neural Network Method for Automatic Generation of Music

Algorithmic Composition of Melodies with Deep Recurrent Neural Networks

Bach2Bach: Generating Music Using A Deep Reinforcement Learning Approach

Bach Style Music Authoring System based on Deep Learning

Polyphonic Music Modelling with LSTM-RTRBM

Modelling High-Dimensional Sequences with LSTM-RTRBM: Application to Polyphonic Music Generation

Rethinking Recurrent Latent Variable Model for Music Composition

BandNet: A Neural Network-based, Multi-Instrument Beatles-Style MIDI Music Composition Machine

Text-based LSTM networks for Automatic Music Composition

LSTM Based Music Generation System

Music Generation Using Bidirectional Recurrent Network

Rhythm, Chord and Melody Generation for Lead Sheets using Recurrent Neural Networks

Modeling Musical Structure with Artificial Neural Networks

Music Generation using Three-layered LSTM

Stylistic Composition of Melodies Based on a Brain-Inspired Spiking Neural Network

A Novel Method of Music Generation Based on Three Different Recurrent Neural Networks