Abstract:Real-time human activity recognition is essential for human-robot interactions for assisted healthy independent living. Most previous work in this area is performed on traditional two-dimensional (2D) videos and both global and local methods have been used. Since 2D videos are sensitive to changes of lighting condition, view angle, and scale, researchers begun to explore applications of 3D information in human activity understanding in recently years. Unfortunately, features that work well on 2D videos usually don't perform well on 3D videos and there is no consensus on what 3D features should be used. Here we propose a model of human activity recognition based on 3D movements of body joints. Our method has three steps, learning dictionaries of sparse codes of 3D movements of joints, sparse coding, and classification. In the first step, space-time volumes of 3D movements of body joints are obtained via dense sampling and independent component analysis is then performed to construct a dictionary of sparse codes for each activity. In the second step, the space-time volumes are projected to the dictionaries and a set of sparse histograms of the projection coefficients are constructed as feature representations of the activities. Finally, the sparse histograms are used as inputs to a support vector machine to recognize human activities. We tested this model on three databases of human activities and found that it outperforms the state-of-the-art algorithms. Thus, this model can be used for real-time human activity recognition in many applications.

Human 3D Motion Recognition Based on Spatial-Temporal Context of Joints

3d Human Action Recognition Based On The Spatial-Temporal Moving Skeleton Descriptor

Human motion segmentation using collaborative representations of 3D skeletal sequences.

Action Recognition Based on Global Optimal Similarity Measuring

Combining Adaptive Hierarchical Depth Motion Maps with Skeletal Joints for Human Action Recognition

Hybrid generative-discriminative recognition of human action in 3D joint space.

Full Body Tracking-Based Human Action Recognition

Action Recognition Based on Motion Representing and Reconstructed Phase Spaces Matching of 3D Joint Positions

An effective representation for action recognition with human skeleton joints

Human 3D Model-based 2D Action Recognition

Action Recognition Using Local Joints Structure and Histograms of 3D Joints

Action and Gait Recognition from Recovered 3-D Human Joints

Human Action Recognition Based on Kinematic Similarity in Real Time.

Long-Term Human Motion Prediction with Scene Context

Human Motion Recognition Based On Hidden Markov Models

Hidden Markov Model for Action Recognition Using Joint Angle Acceleration.

3d Body Joints-Based Human Action Recognition

Multimodal human action recognition based on spatio-temporal action representation recognition model

Real-time Human Action Recognition Using Individual Body Part Locations and Local Joints Structure.

Learning Dictionaries Of Sparse Codes Of 3d Movements Of Body Joints For Real-Time Human Activity Understanding

3D Skeletal Gesture Recognition Via Hidden States Exploration