Abstract:Recently, significant developments have been made in Long Short-Term Memory (LSTM) networks within the realm of synthesis music. Notwithstanding these advancements, several challenges persist warranting further research. Primarily, there exists an absence of dedicated research on the application of LSTM networks for the synthesis of Original Sound Tracks (OST). Secondly, in general, people can only judge whether the synthesized music meets their expectations based on the model output. However, due to the time-consuming of training the model may need to try multiple times to obtain successful training results. Moreover, the subjective of music quality evaluation relying on human perception, not only the result of model training. To address these multifaceted challenges, this paper concentrates specifically on OST and proposes a framework termed the OST Synthesis Framework (OSTSF) utilizing LSTM. This framework accepts various OST types as input, processed through LSTM to yield innovative OST. Additionally, a novel preprocessing algorithm is proposed to screen input OST elements such as notes and chords, enabling control over music type and quality before the training phase. This algorithm serves to mitigate training uncertainties and reduce situations that require repeated training. Besides, a postprocessing approach, leveraging mathematical formulations facilitates the evaluation of synthesis OST also proposed. This approach aims to quantify subjective evaluations, providing a more intuitive representation through scoring metrics. Experiment results reveal that the OSTSF synthesized OST received favorable rate among a cohort of 100 surveyed respondents attaining 78.8%, demonstrating the efficacy of the proposed framework in the realm of music synthesis utilizing LSTM.

Sound Reproduction by Concatenative Synthesis for Japanese Traditional Music Box

Real-Time Music Synthesis by Patch-Based Method

Modeling of Rakugo Speech and Its Limitations: Toward Speech Synthesis That Entertains Audiences

How Similar or Different is Rakugo Speech Synthesizer to Professional Performers?

SyncViolinist: Music-Oriented Violin Motion Generation Based on Bowing and Fingering

DESIGN AND IMPLEMENTATION OF A 36-NOTE LOW-COST CUSTOMIZED DIGITAL MUSIC BOX

Real-Time Audio-to-Score Alignment of Music Performances Containing Errors and Arbitrary Repeats and Skips

Sound Field Reproduction With Weighted Mode Matching and Infinite-Dimensional Harmonic Analysis: An Experimental Evaluation

GANkyoku: a Generative Adversarial Network for Shakuhachi Music

Coupled simulation of vibration and sound field of Stradivari violin

Computer Simulation of Piano Tones and Design of Virtual Piano System

Rhythm Transcription of Polyphonic Piano Music Based on Merged-Output HMM for Multiple Voices

Note Value Recognition for Piano Transcription Using Markov Random Fields

An acoustical study of sound production in biphonic singing, Xöömij

A finite element model of the Japanese koto constructed from computed tomography scans

Overview of Tasks and Investigation of Subjective Evaluation Methods in Environmental Sound Synthesis and Conversion

Foley Sound Synthesis at the DCASE 2023 Challenge

Msanii: High Fidelity Music Synthesis on a Shoestring Budget

LSTM-Based Framework for the Synthesis of Original Soundtracks

PerformanceNet: Score-to-Audio Music Generation with Multi-Band Convolutional Residual Network

J-MAC: Japanese multi-speaker audiobook corpus for speech synthesis