Abstract:Nowadays, more and more activity recognition algorithms begin to improve recognition performance by combining the RGB and depth information. Although, the space-time volumes (STV) algorithm and the space-time local features algorithm can combine the RGB and depth information effectively, they also have their own defects. Such as they need expensive computational cost and they are not suitable for modeling nonperiodic activity. In this paper, we propose a novel algorithm for three dimensional human activity recognition that combines spatial-domain local texture features and spatio-temporal local texture features. On the one hand, in order to extract spatial local texture features, we mix the RGB and depth image sequence which have been applied with ViBe (Visual Background extractor) and binarization operator. Then we obtain the RGB-MOHBBI and depth-MOBHBI respectively and perform intersect operation on them. Afterwards, we extract LBP feature from the mixed MOHBBI to describe spatial domain feature. On the other hand, we follow the same background subtraction and binarization method to process the RGB and depth image sequences and get the spatial-temporal local texture features. And then, we project the three dimensional image volume on plane X-T and plane Y-T to get the spatio-temporal behavior volume change image to which we apply LBP operator to extract features that can represent human activity feature in spatio-temporal domain. At last, we combine the two local features that are extracted by LBP algorithm as one integrated feature of our model final output. Extensive experiments are conducted on the BUPT Arm Activity Dataset and the BUPT Arm And Finger Activity Dataset. The experimental results demonstrate the algorithm we proposed in this paper can make up for the deficiency of traditional activity recognition algorithms effectively and provide excellent experiment results on different databases of various complexities.

3D Human behavior recognition based on binocular vision and face–hand feature

2D Motion Detection Bounded Hand 3D Trajectory Tracking and Gesture Recognition under Complex Background

Real-time 3D bare-hand gesture recognition using binocular vision videos

Based on cluster tree human action recognition algorithm for monocular video

Video Based Head Detection and Tracking Surveillance System

Human Behavior Recognition Based on 3D Features and Hidden Markov Models

Human-Computer Interaction System Based on Binocular Stereo Vision

Uniform Local Binary Pattern Based Texture-Edge Feature for 3D Human Behavior Recognition.

A Novel and Stable Human Detection and Behavior Recognition Method Based on Depth Sensor

Gesture recognition based on binocular vision

Human Behavior Recognition of Video Surveillance System Based on Neural Network

Human Behavior Feature Representation and Recognition Based on Depth Video

Implementation of Behavior Recognition Based on Machine Vision

Fuzzy system based human behavior recognition by combining behavior prediction and recognition

A Systematic Survey on Human Behavior Recognition Methods

Dynamic Hand Gesture Recognition Based on Two-channel Hybrid 3D-2D RBM

Human behavior understanding for video surveillance: Recent advance

3D human behavior recognition based on spatiotemporal texture features

Binocular Omni-Stereo Based Human Tracking System In Indoor Environments For Intelligent Surveillance

Real-Time Human Behavior Recognition in Intelligent Environment

Human Posture Tracking and Classification through Stereo Vision and 3D Model Matching