Abstract:A cochlear implant (CI) is a surgically implanted electronic device that partially restores hearing to people suffering from profound hearing loss. Although CI users, in general, obtain a very good reception of continuous speech in the absence of background noise, they face severe limitations in the context of music perception and appreciation. The main reasons for these limitations are related to channel interactions created by the broad spread of electrical fields in the cochlea and to the low number of electrodes that stimulate it. Moreover, CIs have severe limitations when it comes to transmitting the temporal fine structure of acoustic signals, and hence, these devices elicit poor pitch and timber perception. For these reasons, several signal processing algorithms have been proposed to make music more accessible for CI users, trying to reduce the complexity of music signals or remixing them to enhance certain components, such as the lead singing voice. In this work, a deep neural network that performs real-time audio source separation to remix music for CI users is presented. The implementation is based on multi-layer perception (MLP) and has been evaluated using objective instrumental measurements to ensure clean source estimation. Furthermore, experiments in 10 normal hearing (NH) and 13 CI users to investigate how the vocals to instruments ratio (VIR) set by the tested listeners were affected in realistic environments with and without visual information. The objective instrumental results fulfill the benchmark reported in previous studies by introducing distortions that are shown to not be perceived by CI users. Moreover, the implemented model was optimized to perform real-time source separation. The experimental results show that CI users prefer vocals 8 dB enhanced with the respect to the instruments independent of acoustic sound scenarios and visual information. In contrast, NH listeners did not prefer a VIR different than zero dB.

The 2010 Signal Separation Evaluation Campaign (SiSEC2010): Biomedical Source Separation

The 2010 Signal Separation Evaluation Campaign (SiSEC2010): Audio Source Separation

The Signal Separation Evaluation Campaign (2007-2010): Achievements and Remaining Challenges.

The 2018 Signal Separation Evaluation Campaign

Sinusoidal-assisted Synchrosqueezing Transform: Algorithms and Biomedical Applications

Survey On Feature Extraction And Applications Of Biosignals

Epileptic Signal Classification Based on Synthetic Minority Oversampling and Blending Algorithm.

Robust Second-Order Source Separation Identifies Experimental Responses in Biomedical Imaging.

Constrained Online Recursive Source Separation Framework for Real-time Electrophysiological Signal Processing

Removal of EEG noise and artifact using blind source separation

Improved Swarm Intelligent Blind Source Separation Based on Signal Cross-Correlation

EECoG-Comp: An Open Source Platform for Concurrent EEG/ECoG Comparisons-Applications to Connectivity Studies

Design and Evaluation of a Real-Time Audio Source Separation Algorithm to Remix Music for Cochlear Implant Users

Source Imaging Method based on Spatial Smoothing and Edge Sparsity (SISSES) and Its Application to OPM-MEG

A Particle Swarm Optimised Independence Estimator for Blind Source Separation of Neurophysiological Time Series

Joint Blind Source Separation for Neurophysiological Data Analysis: Multiset and Multimodal Methods

Biomedical Signals Reconstruction Under the Compressive Sensing Approach

Remove Diverse Artifacts Simultaneously From a Single-Channel EEG Based on SSA and ICA: A Semi-Simulated Study.

Multi-task cascaded assessment of signal quality for long-term single-lead ECG monitoring

Score-based Source Separation with Applications to Digital Communication Signals

Benchmarks and leaderboards for sound demixing tasks