Abstract:Monaural source separation (MSS) aims to extract and reconstruct different sources from a single-channel mixture, which could facilitate a variety of applications such as chord recognition, pitch estimation and automatic transcription. In this paper, we study the problem of separating vocals and instruments from monaural music mixture. Existing works for monaural source separation either utilize linear and shallow models (e.g., non-negative matrix factorization), or do not explicitly address the coupling and tangling of multiple sources in original input signals, hence they do not perform satisfactorily in real-world scenarios. To overcome the above limitations, we propose a novel end-to-end framework for monaural music mixture separation called Deep Representation-Decoupling Neural Networks (DRDNN). DRDNN takes advantages of both traditional signal processing methods and popular deep learning models. For each input of music mixture, DRDNN converts it to a two-dimensional time-frequency spectrogram using short-time Fourier transform (STFT), followed by stacked convolutional neural networks (CNN) layers and long-short term memory (LSTM) layers to extract more condensed features. Afterwards, DRDNN utilizes a decoupling component, which consists of a group of multi-layer perceptrons (MLP), to decouple the features further into different separated sources. The design of decoupling component in DRDNN produces purified single-source signals for subsequent full-size restoration, and can significantly improve the performance of final separation. Through extensive experiments on real-world dataset, we prove that DRDNN outperforms state-of-the-art baselines in the task of monaural music mixture separation and reconstruction.

Source Separation of Piano Concertos Using Hybrid LSTM-Transformer Model

Source Separation of Piano Concertos Using Musically Motivated Augmentation Techniques

A Unified Model for Zero-shot Music Source Separation, Transcription and Synthesis

Source Separation & Automatic Transcription for Music

Piano automatic transcription based on transformer

End-to-end Piano Performance-MIDI to Score Conversion with Transformers

A Parallel Fusion Approach to Piano Music Transcription Based on Convolutional Neural Network

A study of audio mixing methods for piano transcription in violin-piano ensembles

Deep Learning Based Source Separation Applied To Choir Ensembles

A Two-Stage Audio-Visual Fusion Piano Transcription Model Based on the Attention Mechanism

HPPNet: Modeling the Harmonic Structure and Pitch Invariance in Piano Transcription

Deep Representation-Decoupling Neural Networks for Monaural Music Mixture Separation

Reconstructing Human Expressiveness in Piano Performances with a Transformer Network

Music source separation conditioned on 3D point clouds

Harmonic Frequency-Separable Transformer for Instrument-Agnostic Music Transcription

Music Source Separation With Band-Split RNN

Music Source Separation in the Waveform Domain

Music Generation and Human Voice Conversion Based on LSTM

Class-conditional Embeddings for Music Source Separation

Jointist: Simultaneous Improvement of Multi-instrument Transcription and Music Source Separation via Joint Training

Scoring Time Intervals using Non-Hierarchical Transformer For Automatic Piano Transcription