Real-Time Chest Compression Depth Rate, Posture, and Person Detections Using Binocular Vision for CPR Training

Jun Zhang,Feiyang Qu,Jingyu Liu,Yecheng Liu,Rucui Xia,Aiguo Song

DOI: https://doi.org/10.1109/jsen.2024.3445932

IF: 4.3

2024-01-01

IEEE Sensors Journal

Abstract:High-quality chest compressions (CCs) are crucial for cardiopulmonary resuscitation. This paper presents a vision-based real-time CC detection system that can detect the CC depth (CCD), CC rate (CCR), CC posture (CCP), and CC person based on binocular vision and human key point detection techniques. We propose a method combining target detection and color region segmentation to extract matching points during CC action identification. This method can achieve effective target ranging by detecting the motion trajectory of a MARK worn on the rescuer’s wrist. In addition, we propose a method to compensate for the CCD detection error caused by the rescuer’s palm deformation and arm tilt. We conducted volunteer CC experiments to verify the feasibility and effectiveness of our methods. Results showed that the mean absolute error (MAE) of the maximum CCD decreased from 14.306 mm to -1.073 mm after error compensation, with an average variance of 3.596 mm 2 . The MAE of the CCR was 2.4959 times/min. The recognition rate of the four types of CCP was 92.32%. The CC person detection accuracy was 92.9%. Our CC assessment method provides a non-contact measurement solution without installing any tool between the rescuer’s hand and the patient’s chest, which is convenient and has high application value in medical human-computer interaction.