Abstract:A major challenge for the identification of singers from monaural popular music recording is to remove or alleviate the influence of accompaniments. Our system is realized in two stages. In the first stage, we exploit computational auditory scene analysis (CASA) to segregate the singing voice units from a mixture signal. First, the pitch of singing voice is estimated to extract the pitch-based features of each unit in an acoustic vector. These features are then exploited to estimate the binary time-frequency (T-F) masks, where 1 indicates that the corresponding T-F unit is dominated by the singing voice, and 0 indicates otherwise. These regions dominated by the singing voice are considered reliable, and other units are unreliable or missing. Thus the acoustic vector is incomplete. In the second stage, two missing feature methods, the reconstruction of acoustic vector and the marginalization, are used to identify the singer by dealing with the incomplete acoustic vectors. For the reconstruction of acoustic vector, the complete acoustic vector is first reconstructed and then converted to obtain the Gammatone frequency cepstral coefficients (GFCCs), which are further used to identify the singer. For the marginalization, the probabilities that the voice belonging to a certain singer are computed on the basis of only the reliable components. We find that the reconstruction method outperforms the marginalization method, while both methods have significantly good performances, especially at signal-to-accompaniment ratios (SARs) of 0 dB and − 3 dB, in contrast to another system.

Soft constrained leading voice separation with music score guidance

Towards Solving The Bottleneck Of Pitch-Based Singing Voice Separation

Separation of Singing Voice Using Nonnegative Matrix Partial Co-Factorization for Singer Identification

Multi-Stage Non-Negative Matrix Factorization for Monaural Singing Voice Separation

NMF based speech and music separation in monaural speech recordings with sparseness and temporal continuity constraints

Cepstral Smoothing of Spectral Masks for Acoustic Vector-Sensor Based Convolutive Speech Separation

Latent time-frequency component analysis: A novel pitch-based approach for singing voice separation

Single-Channel Speech Separation Based on Long-Short Frame Associated Harmonic Model

Singing Voice Separation and Vocal F0 Estimation based on Mutual Combination of Robust Principal Component Analysis and Subharmonic Summation

Unsupervised Single-Channel Music Source Separation by Average Harmonic Structure Modeling

Singer identification based on computational auditory scene analysis and missing feature methods

Combining HMM-based melody extraction and NMF-based soft masking for separating voice and accompaniment from monaural audio

Investigation of Singing Voice Separation for Singing Voice Detection in Polyphonic Music

Unsupervised Single-Channel Singing Voice Separation with Weighted Robust Principal Component Analysis Based on Gammatone Auditory Filterbank and Vocal Activity Detection

A Local Discontinuity Based Approach for Monaural Singing Voice Separation from Accompanying Music with Multi-Stage Non-Negative Matrix Factorization

Localization Based Stereo Speech Source Separation Using Probabilistic Time-Frequency Masking and Deep Neural Networks

Singer separation for karaoke content generation

Voice and accompaniment separation in music using self-attention convolutional neural network

Improving Real-Time Music Accompaniment Separation with MMDenseNet

Audiovisual Singing Voice Separation

DJCM: A Deep Joint Cascade Model for Singing Voice Separation and Vocal Pitch Estimation