Abstract:Yoga has become an essential part of modern life, and hence, there has been a tremendous demand for self-training yoga platforms for trainer-less yoga practice. Robust and efficient recognition of yoga poses in video stream is the first requirement of such systems. However, the existing techniques for yoga pose recognition are compute-intensive and may fail in complex real-world conditions. These issues pose serious limitations on their practical applicability. To this end, this paper examines state-of-the-art deep learning techniques to implement a robust and compute-efficient system for yoga pose recognition in real-time on a resource-constrained embedded platform. The first technique uses a hybrid CNN & LSTM model, while the other three (3DCNN Model1, 3DCNN Model2, and 3DCNN Model3) employ the Sports1M pre-trained 3DCNN model named C3D. We assessed the performance of the designed architectures on a publicly available yoga pose database by applying four well-known metrics, namely recognition accuracy, precision, recall, and F1-score. On three database splits, the designed hybrid CNN & LSTM, 3DCNN Model1, 3DCNN Model2, and 3DCNN Model3 achieved mean recognition accuracy of 98.80%, 99.07% 98.19%, and 98.43%, respectively. Also, on one of the splits, the best-performing model achieved the highest recognition accuracy of 99.65% and, thus, surpassed the baseline accuracy of 99.38%. Also, the optimal model runs at a frame rate of 31 FPS on an Nvidia GPU-enabled desktop, much better than the previous best of 3 FPS. Finally, to evaluate the model's efficiency on embedded systems, we optimized it using TensorRT SDK and deployed it on an Nvidia Xavier embedded platform. The optimized model runs at 8 FPS on the resource-constrained embedded platform, demonstrating its suitability for real-world applications. A working demo of the developed system is available at https://youtu.be/at1GJ8Nxx38, and the source codes are available at https://github.com/sumeetssaurav/Yoga-Pose-Classification.

Yoga Pose Estimation Using YOLO Model

Deep Learning-Based Yoga Posture Recognition Using the Y_PN-MSSD Model for Yoga Practitioners

Real-time Recognition of Yoga Poses using computer Vision for Smart Health Care

An Efficient Deep Convolutional Neural Network Model For Yoga Pose Recognition Using Single Images

YAP_LSTM: yoga asana prediction using pose estimation and long short-term memory

A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy

Yoga Posture Recognition Through Computer Vision and Deep Learning

Exploration of deep learning architectures for real-time yoga pose recognition

Yoga Posture Detection and Correction System

Image-Based Fitness Yoga Pose Recognition: Using Ensemble Learning and Multi-head Attention

YoNet: A Neural Network for Yoga Pose Classification

A View Independent Classification Framework for Yoga Postures

A Survey on Yogic Posture Recognition

Aasna: Kinematic Yoga Posture Detection And Correction System Using CNN

Segmentation quality assessment network-based object detection and optimized CNN with transfer learning for yoga pose classification for health care

Yoga-82: A New Dataset for Fine-grained Classification of Human Poses

Research on Human Posture Estimation Algorithm Based on YOLO-Pose

Surya Namaskar: real-time advanced yoga pose recognition and correction for smart healthcare

MDA-YOLO Person: a 2D human pose estimation model based on YOLO detection framework

Deep Learning for Fitness

3DYoga90: A Hierarchical Video Dataset for Yoga Pose Understanding