Abstract:Recent advances in 3D depth sensors have created many opportunities for security, surveillance, and entertainment. The 3D depth sensors provide more powerful monitoring systems for dangerous situations irrespective of lighting conditions in buildings or production facilities. To robustly recognize emergency actions or hazardous situations of workers at a production facility, we present human joint estimation and behavior recognition algorithms that solely use depth information in this paper. To estimate human joints on a low cost computing platform, we propose a human joint estimation algorithm that integrates a geodesic graph and a support vector machine (SVM). The human feature points are extracted within a range of geodesic distance from a geodesic graph. The geodesic graph is used for optimizing the estimation result. The SVM-based human joint estimator uses randomly selected human features to reduce computation. Body parts that typically involve many motions are then estimated by the geodesic distance value. The proposed algorithm can work for any human without calibration, and thus the system can be used with any subject immediately even with a low cost computing platform. In the case of the behavior recognition algorithm, the algorithm should have a simple behavior registration process, and it also should be robust to environmental changes. To meet these goals, we propose a template matching-based behavior recognition algorithm. Our method creates a behavior template set that consists of weighted human joint data with scale and rotation invariant properties. A single behavior template consists of the joint information that is estimated per frame. Additionally, we propose adaptive template rejection and a sliding window filter to prevent misrecognition between similar behaviors. The human joint estimation and behavior recognition algorithms are evaluated individually through several experiments and the performance is proven through a comparison with other algorithms. The experimental results show that our method performs well and is applicable in real environments.

A Projection-Based Human Motion Recognition Algorithm Based on Depth Sensors

RGB-D Camera based Human Limb Movement Recognition and Tracking in Supine Positions.

A motion recognition model for upper-limb rehabilitation exercises

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

Quantitative assessment of human motion for health and rehabilitation: A novel fuzzy comprehensive evaluation approach

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

3D Human Motion Analysis for Reconstruction and Recognition

Human Motion Posture Detection Algorithm Using Deep Reinforcement Learning

Human Motion Tracking Algorithm Based on Image Segmentation Algorithm and Kinect Depth Information

Analysis of Students' Sports Exercise Behavior and Health Education Strategy Using Visual Perception–Motion Recognition Algorithm

Research on motion recognition based on multi-dimensional sensing data and deep learning algorithms

PMotion: An advanced markerless pose estimation approach based on novel deep learning framework used to reveal neurobehavior

Human Motion Tracking Using 3D Image Features with a Long Short-Term Memory Mechanism Model—An Example of Forward Reaching

Motion Recognition Based on Deep Learning and Human Joint Points

Estimation for Human Motion Posture and Health Using Improved Deep Learning and Nano Biosensor

Weighted joint-based human behavior recognition algorithm using only depth information for low-cost intelligent video-surveillance system

Research on the Human Motion Recognition Method Based on Wearable

Gesture Tracking and Recognition Algorithm for Dynamic Human Motion Using Multimodal Deep Learning

Accurate realtime full-body motion capture using a single depth camera

Depth-aware pose estimation using deep learning for exoskeleton gait analysis

Human-Like Trajectory Planning Based on Postural Synergistic Kernelized Movement Primitives for Robot-Assisted Rehabilitation