Smart Pressure e-Mat for Human Sleeping Posture and Dynamic Activity Recognition

Liangqi Yuan,Yuan Wei,Jia Li

2023-05-19

Abstract:With the emphasis on healthcare, early childhood education, and fitness, non-invasive measurement and recognition methods have received more attention. Pressure sensing has been extensively studied due to its advantages of simple structure, easy access, visualization application, and harmlessness. This paper introduces a smart pressure e-mat (SPeM) system based on a piezoresistive material Velostat for human monitoring applications, including sleeping postures, sports, and yoga recognition. After a subsystem scans e-mat readings and processes the signal, it generates a pressure image stream. Deep neural networks (DNNs) are used to fit and train the pressure image stream and recognize the corresponding human behavior. Four sleeping postures and five dynamic activities inspired by Nintendo Switch Ring Fit Adventure (RFA) are used as a preliminary validation of the proposed SPeM system. The SPeM system achieves high accuracies on both applications, which demonstrates the high accuracy and generalization ability of the models. Compared with other pressure sensor-based systems, SPeM possesses more flexible applications and commercial application prospects, with reliable, robust, and repeatable properties.

Computer Vision and Pattern Recognition,Human-Computer Interaction,Machine Learning,Signal Processing

What problem does this paper attempt to address?

### What problem does this paper attempt to solve?

This paper aims to address the following key issues:

1. **Non-invasive human monitoring**: With the increasing focus on healthcare, early childhood education, and fitness, non-invasive measurement and identification methods have garnered more attention. Pressure sensing technology is widely studied due to its simple structure, accessibility, visual application, and harmlessness.

2. **Sleep posture and dynamic activity recognition**: The paper proposes a Smart Pressure Electronic Mat (SPeM) system based on piezoresistive material (Velostat) for monitoring human sleep postures and dynamic activities such as exercise and yoga. The system generates pressure image streams and utilizes deep neural networks (DNN) for recognition.

3. **High accuracy and generalization capability**: Preliminary validation shows that the SPeM system exhibits high accuracy and good generalization capability in recognizing sleep postures and dynamic activities. Compared to other pressure sensor-based systems, SPeM offers greater flexibility and commercial application prospects.

Specifically, the paper aims to design a flexible, non-invasive, portable, and low-cost pressure sensing system for applications in healthcare, sports, gaming, early childhood education, and entertainment. By collecting human pressure pattern data and training different DNN models, the system achieves high-precision human behavior recognition.