Abstract:Automated human posture estimation (A-HPE) systems need delicate methods for detecting body parts and selecting cues based on marker-less sensors to effectively recognize complex activity motions. Recognition of human activities using vision sensors is a challenging issue due to variations in illumination conditions and complex movements during the monitoring of sports and fitness exercises. In this paper, we propose a novel A-HPE method that intelligently identifies human behaviours by utilizing saliency silhouette detection, robust body parts model and multidimensional cues from full-body silhouettes followed by an entropy Markov model. Initially, images are pre-processed and noise is removed to obtain a robust silhouette. Body parts models are then used to extract twelve key body parts. These key body parts are further optimized to assist the generation of multidimensional cues. These cues include energy, optical flow and distinctive values that are fed into quadratic discriminant analysis to discriminate cues which help in the recognition of actions. Finally, these optimized patterns are further processed by a maximum entropy Markov model as a recognizer engine based on transition and emission probability values for activity recognition. For evaluation, we used a leave-one-out cross validation scheme and the results outperformed existing well-known statistical state-of-the-art methods by achieving better body parts detection and higher recognition accuracy over four benchmark datasets. The proposed method will be useful for man-machine interactions such as 3D interactive games, virtual reality, service robots, e-health fitness, and security surveillance.

Human pose recognition using Kinect and rule-based system

The Design and Implementation of Natural Human-Robot Interaction System Based on Kinect Sensor

View independent human posture identification using Kinect

Human motion recognition using three-dimensional skeleton model based on RGBD vision system

Modelling Human Body Pose for Action Recognition Using Deep Neural Networks

Student Behavior Recognition System for the Classroom Environment Based on Skeleton Pose Estimation and Person Detection

Human Action Recognition with Contextual Constraints Using a RGB-D Sensor

Learning and Recognizing Human Action from Skeleton Movement with Deep Residual Neural Networks

A multimodal approach for human activity recognition based on skeleton and RGB data

Human Pose Detection for Robotic-Assisted and Rehabilitation Environments

Improved Key Poses Model for Skeleton-Based Action Recognition.

Indoor Human Action Recognition Based on Dual Kinect V2 and Improved Ensemble Learning Method

A Sitting Posture Surveillance System Based on Kinect

A Real-time Human Pose Estimation Approach for Optimal Sensor Placement in Sensor-based Human Activity Recognition

Human-robot cooperation using Kinect

Real-time human pose recognition in parts from single depth images

Recognition and Scoring Physical Exercises via Temporal and Relative Analysis of Skeleton Nodes Extracted from the Kinect Sensor

Tennis Posture Classification and Recognition Based on an Improved KNN

Automatic human posture estimation for sport activity recognition with robust body parts detection and entropy markov model

Tracking Human-like Natural Motion Using Deep Recurrent Neural Networks

An effective representation for action recognition with human skeleton joints