Abstract:Recently, pressure-sensing mats have been widely used to capture static and dynamic pressure over sleep for posture recognition. Both a full-size mat with a low-density sensing array for figuring out the structure of the whole body and a miniature scale mat with a high-density sensing array for identifying the local characteristics around the chest have been investigated. However, both of the mat systems may face the challenge in the trade-off between the computational complexity (involving the size, density, etc. of the mat) and the performance of sleep posture recognition, where high performance may requires overcomplex computation and result in time latency in real-time sleep posture monitoring. In this paper, a lightweight neural network named ConcatNet, is proposed to realize sleep postures (supine, left, right, and prone) recognition in real time while maintaining a favorable performance. In ConcatNet, the inception module is proposed to extract the image features under multiple receptive fields, while the multi-layer feature fusion module is utilized to fuse deep and shallow features to enhance the model performance. To further improve the efficiency of the model, the depthwise convolution is adopoted. ConcatNet models in 3 different scales (ConcatNet-S, ConcatNet-M, and ConcatNet-L) are built to explore the impact of the sensor density on sleep posture recognition performance. Experimental results exhibit that ConcatNet-M corresponding to medium sensor density (16×16) achieved the best comprehensive performance, with short-term data cross-validation accuracy at 95.56% and overnight data testing accuracy at 94.68%. The model size is 7.91KB, FLOPs is 56.47K, and the inference time is only 0.38ms, which shows an outstanding performance of real-time sleep posture recognition with minimum consumption, indicating the potential to be deployed in mobile devices.

MassNet: A Deep Learning Approach for Body Weight Extraction from A Single Pressure Image

BodyPressure -- Inferring Body Pose and Contact Pressure from a Depth Image

BodyPressure - Inferring Body Pose and Contact Pressure from a Depth Image

Bodies at Rest: 3D Human Pose and Shape Estimation from a Pressure Image using Synthetic Data

Body Weight Estimation Using Virtual Anthropometric Measurements from a Single Image

Deep Multitask Learning for Pervasive BMI Estimation and Identity Recognition in Smart Beds

BodyMAP -- Jointly Predicting Body Mesh and 3D Applied Pressure Map for People in Bed

Estimating Pose from Pressure Data for Smart Beds with Deep Image-based Pose Estimators

Lightweight Neural Network for Sleep Posture Classification Using Pressure Sensing Mat at Various Sensor Densities

A Method to Recognize Sleeping Position Using an CNN Model Based on Human Body Pressure Image

Estimating Human Weight from A Single Image

Pressure Eye: In-bed Contact Pressure Estimation via Contact-less Imaging

A Privacy-Preserving and Unobtrusive Sitting Posture Recognition System Via Pressure Array Sensor and Infrared Array Sensor for Office Workers

Smart Pressure e-Mat for Human Sleeping Posture and Dynamic Activity Recognition

The Development of an Attention Mechanism Enhanced Deep Learning Model and Its Application for Body Composition Assessment with L3 CT Images

3D Human Pose Estimation on a Configurable Bed from a Pressure Image

Attention Guided Deep Features for Accurate Body Mass Index Estimation

Single Image Based Infant Body Height and Weight Estimation.

Deep Residual Networks for Sleep Posture Recognition with Unobtrusive Miniature Scale Smart Mat System

Identity and Posture Recognition in Smart Beds with Deep Multitask Learning

Multimodal Data-Based Deep Learning Model for Sitting Posture Recognition Toward Office Workers’ Health Promotion