Motion Robust Imaging Ballistocardiography Through a Two-Step Canonical Correlation Analysis

Rencheng Song,Jiji Li,Juan Cheng,Chang Li,Yu Liu,Xun Chen
DOI: https://doi.org/10.1109/tim.2020.3034974
IF: 5.6
2021-01-01
IEEE Transactions on Instrumentation and Measurement
Abstract:Imaging ballistocardiography (iBCG) is a video-based noncontact technique to detect heart rate (HR) from weak mechanical head movements caused by heart beating. However, rigid motions caused by voluntary movements and nonrigid motion resulted from facial expressions can easily distort the iBCG measurements. In this article, we propose a novel method, called robust iBCG (RiBCG), to suppress motion artifacts in iBCG with a two-step canonical correlation analysis (CCA). First, feature points are determined and tracked within two regions of interest (ROIs) from the face, where the vertical traces are taken as raw iBCG signals. Next, the first CCA is taken to separately remove the shared rigid motion artifacts between the horizontal and vertical traces in each ROI, where the obtained rigid-motion-free iBCG signals are further compressed by principal component analysis (PCA). Then, CCA is applied again to two sets of principal components to suppress nonrigid motion artifacts with low spatial correlations. Finally, the target HR value is determined as the one with the highest peak of power spectrums among all canonical variates (CVs). Besides, an improved version of RiBCG, termed RiBCG-C, is also proposed to reduce the HR outliers considering the continuity of HR variations. The proposed methods, as well as several other typical video-based HR measurement methods, are evaluated on two public databases, UBFC-RPPG and COHFACE, where the proposed RiBCG-C method achieves overall the best performance. The study provides a promising scheme for RiBCG measurements under realistic application scenarios.
engineering, electrical & electronic,instruments & instrumentation
What problem does this paper attempt to address?
The paper primarily aims to address the issue of motion artifacts in video-based heart rate measurement technology, with a particular focus on the accuracy and stability of imaging ballistocardiography (iBCG) in the presence of voluntary head movements and non-rigid movements caused by facial expressions. The paper proposes a new method called Robust iBCG (RiBCG), which employs a two-step Canonical Correlation Analysis (CCA) to suppress motion artifacts in iBCG signals. Specifically, the method includes the following steps: 1. **Feature Point Determination and Tracking**: Two regions of interest (ROI) are selected in the facial area, namely the forehead and nose regions, and feature points within these areas are tracked. 2. **Rigid Motion Artifact Removal**: CCA is used to remove rigid motion artifacts caused by voluntary head movements. By leveraging the high correlation between vertical and horizontal trajectories, CCA variables related to rigid motion are identified and removed from the iBCG signal. 3. **Local Motion Artifact Removal**: The vertical trajectory, after removing rigid motion artifacts, is further processed using Principal Component Analysis (PCA) for dimensionality reduction, and CCA is applied again to remove non-rigid motion artifacts caused by facial expressions. 4. **Heart Rate Estimation**: Power Spectral Density (PSD) analysis is performed on all candidate CCA variables, and the variable with the highest power peak is selected as the target iBCG pulse signal, based on which the heart rate is estimated. Additionally, the paper proposes an improved version of the method—RiBCG-C, which aims to reduce the impact of heart rate outliers by considering the continuity of heart rate changes. The study was evaluated on two public databases, UBFC-RPPG and COHFACE, and the results show that the proposed RiBCG-C method exhibits the best performance in handling iBCG measurements in practical application scenarios. This work provides a promising solution for robust iBCG measurement in real-world environments.