Abstract:Nowadays, more and more activity recognition algorithms begin to improve recognition performance by combining the RGB and depth information. Although, the space-time volumes (STV) algorithm and the space-time local features algorithm can combine the RGB and depth information effectively, they also have their own defects. Such as they need expensive computational cost and they are not suitable for modeling nonperiodic activity. In this paper, we propose a novel algorithm for three dimensional human activity recognition that combines spatial-domain local texture features and spatio-temporal local texture features. On the one hand, in order to extract spatial local texture features, we mix the RGB and depth image sequence which have been applied with ViBe (Visual Background extractor) and binarization operator. Then we obtain the RGB-MOHBBI and depth-MOBHBI respectively and perform intersect operation on them. Afterwards, we extract LBP feature from the mixed MOHBBI to describe spatial domain feature. On the other hand, we follow the same background subtraction and binarization method to process the RGB and depth image sequences and get the spatial-temporal local texture features. And then, we project the three dimensional image volume on plane X-T and plane Y-T to get the spatio-temporal behavior volume change image to which we apply LBP operator to extract features that can represent human activity feature in spatio-temporal domain. At last, we combine the two local features that are extracted by LBP algorithm as one integrated feature of our model final output. Extensive experiments are conducted on the BUPT Arm Activity Dataset and the BUPT Arm And Finger Activity Dataset. The experimental results demonstrate the algorithm we proposed in this paper can make up for the deficiency of traditional activity recognition algorithms effectively and provide excellent experiment results on different databases of various complexities.

Discriminative Sparse Projections for Activity-Based Person Recognition

Activity-Based Person Identification Using Discriminative Sparse Projections And Orthogonal Ensemble Metric Learning

Activity-based person identification using sparse coding and discriminative metric learning.

Human Gait Recognition Via Sparse Discriminant Projection Learning.

Activity-Based Human Identification

Graph-based Sparse Coding and Embedding for Activity-Based Human Identification

Activity Recognition Via Distributed Random Projection and Joint Sparse Representation in Body Sensor Networks

Learning Dictionaries Of Sparse Codes Of 3d Movements Of Body Joints For Real-Time Human Activity Understanding

Sparse Tensor Discriminative Locality Alignment For Gait Recognition

A sparse and discriminative tensor to vector projection for human gait feature representation.

Human Activity Recognition based on Dynamic Spatio-Temporal Relations

Simultaneous Learning from Human Pose and Object Cues for Real-Time Activity Recognition

Learning Dynamic Spatio-Temporal Relations for Human Activity Recognition.

Robust Person Gait Identification Based on Limited Radar Measurements Using Set-Based Discriminative Subspaces Learning.

3d Gaussian Bin Based Sparse Representation For Action Recognition

Gait Recognition Via GEI Subspace Projections and Collaborative Representation Classification

Human Activity Recognition with Posture Tendency Descriptors on Action Snippets

Tensor Manifold Discriminant Projections for Acceleration-Based Human Activity Recognition

Bimodal Discriminant Projection Analysis for Gait Recognition.

3D human behavior recognition based on spatiotemporal texture features

Kernel sparsity preserving projections and its application to gait recognition