Light-Adaptive Human Body Key Point Detection Algorithm Based on Multi-Source Information Fusion
Zhigang Hu,Chengwu Zhang,Xinzheng Wang,Aoru Ge
DOI: https://doi.org/10.3390/s24103021
IF: 3.9
2024-05-11
Sensors
Abstract:The identification of key points in the human body is vital for sports rehabilitation, medical diagnosis, human–computer interaction, and related fields. Currently, depth cameras provide more precise depth information on these crucial points. However, human motion can lead to variations in the positions of these key points. While the Mediapipe algorithm demonstrates effective anti-shake capabilities for these points, its accuracy can be easily affected by changes in lighting conditions. To address these challenges, this study proposes an illumination-adaptive algorithm for detecting human key points through the fusion of multi-source information. By integrating key point data from the depth camera and Mediapipe, an illumination change model is established to simulate environmental lighting variations. Subsequently, the fitting function of the relationship between lighting conditions and adaptive weights is solved to achieve lighting adaptation for human key point detection. Experimental verification and similarity analysis with benchmark data yielded R2 results of 0.96 and 0.93, and cosine similarity results of 0.92 and 0.90. With a threshold range of 8, the joint accuracy rates for the two rehabilitation actions were found to be 89% and 88%. The experimental results demonstrate the stability of the proposed method in detecting key points in the human body under changing illumination conditions, its anti-shake ability for human movement, and its high detection accuracy. This method shows promise for applications in human–computer interaction, sports rehabilitation, and virtual reality.
engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation