Abstract:Music has always been the most powerful medium to express human emotion and feeling which sometimes mere words cannot express. As a result generating music using machine and deep learning approaches have been quite popular for some time now. It is a very challenging and interesting task to do as imitating human creativity is not easy. This paper attempted to perform effective melody generation using sequential deep learning models particularly LSTMs (Long short-term memory). In this context, note that the previous works exhibit two principal limitations. Firstly, a significant majority of the studies rely on RNN variants that cannot effectively remember long past sequences. Secondly, they often don't consider the varying temporal context lengths in melody generation during data modeling. In this work, experiments have been performed with different LSTM variants namely Vanilla LSTM, Multi-Layer LSTM, Bidirectional LSTM and different temporal context lengths for each of them to find out the optimal LSTM model and the optimal timestep for efficient melody generation. Moreover, ensembles of the best-performing techniques for each genre (e.g., classical, country, jazz, and pop) are implemented to see if we can generate even better melodies than the corresponding individual models. Finally, a qualitative evaluation is carried out for the generated melodies by conducting a survey that we circulated among fellow colleagues and within the ISMIR community and asked the participants to rate each audio on a scale of 1-5 which helped us in assessing the quality of our generated music samples. All the models have been validated on four datasets that we manually prepared based on their genres namely Classical, Jazz, Country and Pop.

Bach2Bach: Generating Music Using A Deep Reinforcement Learning Approach

Learning to Generate Music with BachProp

Polyphonic Music Composition with LSTM Neural Networks and Reinforcement Learning

Bach Style Music Authoring System based on Deep Learning

LSTM Based Music Generation System

BachProp: Learning to Compose Music in Multiple Styles

Modelling High-Dimensional Sequences with LSTM-RTRBM: Application to Polyphonic Music Generation

RL-Duet: Online Music Accompaniment Generation Using Deep Reinforcement Learning

Using a Bi-directional LSTM Model with Attention Mechanism trained on MIDI Data for Generating Unique Music

Bach in 2014: Music Composition with Recurrent Neural Network

Algorithmic Composition of Melodies with Deep Recurrent Neural Networks

Melody Generation using Deep Learning: Unleashing the Power of RNN and LSTM

Prediction of Music Generation on Time Series Using Bi-LSTM Model

Music Generation using Three-layered LSTM

Melody generation based on deep ensemble learning using varying temporal context length

Music Generation Using Bidirectional Recurrent Network

Rhythm, Chord and Melody Generation for Lead Sheets using Recurrent Neural Networks

Deep learning for music generation: challenges and directions

Fine-Tuning Music Generation with Reinforcement Learning Based on Transformer

DeepJ: Style-Specific Music Generation

JamBot: Music Theory Aware Chord Based Generation of Polyphonic Music with LSTMs