Abstract:Nowadays, more and more activity recognition algorithms begin to improve recognition performance by combining the RGB and depth information. Although, the space-time volumes (STV) algorithm and the space-time local features algorithm can combine the RGB and depth information effectively, they also have their own defects. Such as they need expensive computational cost and they are not suitable for modeling nonperiodic activity. In this paper, we propose a novel algorithm for three dimensional human activity recognition that combines spatial-domain local texture features and spatio-temporal local texture features. On the one hand, in order to extract spatial local texture features, we mix the RGB and depth image sequence which have been applied with ViBe (Visual Background extractor) and binarization operator. Then we obtain the RGB-MOHBBI and depth-MOBHBI respectively and perform intersect operation on them. Afterwards, we extract LBP feature from the mixed MOHBBI to describe spatial domain feature. On the other hand, we follow the same background subtraction and binarization method to process the RGB and depth image sequences and get the spatial-temporal local texture features. And then, we project the three dimensional image volume on plane X-T and plane Y-T to get the spatio-temporal behavior volume change image to which we apply LBP operator to extract features that can represent human activity feature in spatio-temporal domain. At last, we combine the two local features that are extracted by LBP algorithm as one integrated feature of our model final output. Extensive experiments are conducted on the BUPT Arm Activity Dataset and the BUPT Arm And Finger Activity Dataset. The experimental results demonstrate the algorithm we proposed in this paper can make up for the deficiency of traditional activity recognition algorithms effectively and provide excellent experiment results on different databases of various complexities.

RGBD-HuDaAct: A color-depth video database for human daily activity recognition

Collecting Public RGB-D Datasets for Human Daily Activity Recognition

NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understanding

RGB-Depth Feature for 3D Human Activity Recognition

Multilevel Depth and Image Fusion for Human Activity Detection.

Integrating Multi-Stage Depth-Induced Contextual Information for Human Action Recognition and Localization

Combing Rgb and Depth Map Features for Human Activity Recognition

Hierarchical Activity Recognition Using Smart Watches and RGB-Depth Cameras.

Depth Context: a New Descriptor for Human Activity Recognition by Using Sole Depth Sequences

Human Activity Recognition by Multi-Modal Context Fusion

Activity Recognition from RGB-D Camera with 3D Local Spatio-temporal Features

Action Recognition in Depth Video from RGB Perspective: A Knowledge Transfer Manner

A Large-scale RGB-D Database for Arbitrary-view Human Action Recognition.

Jointly Learning Heterogeneous Features for RGB-D Activity Recognition.

Human Interaction Recognition Fusing Multiple Features of Depth Sequences

Unsupervised Learning Spatio-temporal Features for Human Activity Recognition from RGB-D Video Data

Spatial-temporal Texture Features for 3D Human Activity Recognition Using Laser-Based RGB-D Videos

Robust action recognition via borrowing information across video modalities

3D human behavior recognition based on spatiotemporal texture features

Human action recognition using Adaptive Hierarchical Depth Motion Maps and Gabor filter

Deep Convolutional Neural Networks for Human Action Recognition Using Depth Maps and Postures