Abstract:BACKGROUNDS:The heartbeat is fundamental cardiac activity which is straightforwardly detected with a variety of measurement techniques for analyzing physiological signals. Unfortunately, unexpected noise or contaminated signals can distort or cut out electrocardiogram (ECG) signals in practice, misleading the heartbeat detectors to report a false heart rate or suspend itself for a considerable length of time in the worst case. To deal with the problem of unreliable heartbeat detection, PhysioNet/CinC suggests a challenge in 2014 for developing robust heart beat detectors using multimodal signals.METHODS:This article proposes a multimodal data association method that supplements ECG as a primary input signal with blood pressure (BP) and electroencephalogram (EEG) as complementary input signals when input signals are unreliable. If the current signal quality index (SQI) qualifies ECG as a reliable input signal, our method applies QRS detection to ECG and reports heartbeats. Otherwise, the current SQI selects the best supplementary input signal between BP and EEG after evaluating the current SQI of BP. When BP is chosen as a supplementary input signal, our association model between ECG and BP enables us to compute their regular intervals, detect characteristics BP signals, and estimate the locations of the heartbeat. When both ECG and BP are not qualified, our fusion method resorts to the association model between ECG and EEG that allows us to apply an adaptive filter to ECG and EEG, extract the QRS candidates, and report heartbeats.RESULTS:The proposed method achieved an overall score of 86.26 % for the test data when the input signals are unreliable. Our method outperformed the traditional method, which achieved 79.28 % using QRS detector and BP detector from PhysioNet. Our multimodal signal processing method outperforms the conventional unimodal method of taking ECG signals alone for both training and test data sets.CONCLUSIONS:To detect the heartbeat robustly, we have proposed a novel multimodal data association method of supplementing ECG with a variety of physiological signals and accounting for the patient-specific lag between different pulsatile signals and ECG. Multimodal signal detectors and data-fusion approaches such as those proposed in this article can reduce false alarms and improve patient monitoring.

Heartbeat-related spectral perturbation of electroencephalogram reflects dynamic interoceptive attention states in the trial-by-trial classification analysis

Exploring Skin Potential Signals in Electrodermal Activity: Identifying Key Features for Attention State Differentiation

Predicting Attentional Focus: Heartbeat-Evoked Responses and Brain Dynamics During Interoceptive and Exteroceptive Information Processing

Effect of heartbeat perception on heartbeat evoked potential waves

Electrophysiological signature of interoceptive attention: a spectral and source localization analysis

Listen to Your Heart: Trade-Off between Cardiac Interoceptive Processing and Visual Exteroceptive Processing

Pattern classification of EEG signals reveals perceptual and attentional states

Physiologic Network-Based Brain-Heart Interaction Quantification During Visual Emotional Elicitation

Conscious processing of global and local auditory irregularities causes differentiated heartbeat-evoked responses

Validating genuine changes in Heartbeat Evoked Potentials using Pseudotrials and Surrogate Procedures

Modulation of Attention in Visual Stimulation Response

Estimation of Heart Rate Variability Changes During Different Visual Stimulations Using Non-invasive Continuous ECG Monitoring System

Interpatient Heartbeat Classification Using Modified Residual Attention Network with Two-Phase Training and Assistant Decision

Behavioral Oscillations In Attention: Rhythmic Alpha Pulses Mediated Through Theta Band

Robust Detection of Heartbeats Using Association Models from Blood Pressure and EEG Signals.

Empirical mode decomposition improves detection of SSVEP.

Investigation of Heartbeat Evoked Potential (HEP) Response During Different Stages of Sleep in Sleep Disorders

Spectral distribution dynamics across different attentional priority states

Attention Detection by Heartbeat and Respiratory Features from Radio-Frequency Sensor.

Multidimensional assessment of heartbeat-evoked responses in disorders of consciousness

Event-Related Brain Dynamics In Continuous Sustained-Attention Tasks