Abstract:Online action recognition is an important task for human-centered intelligent services. However, it remains a highly challenging problem due to the high varieties and uncertainties of spatial and temporal scales of human actions. In this paper, the following core ideas are proposed to deal with the online action recognition problem. First, we combine spatial and temporal skeleton features to represent human actions, which include not only geometrical features, but also multiscale motion features, such that both spatial and temporal information of the actions are covered. We use an efficient one-dimensional convolutional neural network to fuse spatial and temporal features and train them for action recognition. Second, we propose a group sampling method to combine the previous action frames and current action frames, which are based on the hypothesis that the neighboring frames are largely redundant, and the sampling mechanism ensures that the long-term contextual information is also considered. Third, the skeletons from multiview cameras are fused in a distributed manner, which can improve the human pose accuracy in the case of occlusions. Finally, we propose a Restful style based client-server service architecture to deploy the proposed online action recognition module on the remote server as a public service, such that camera networks for online action recognition can benefit from this architecture due to the limited onboard computational resources. We evaluated our model on the data sets of JHMDB and UT-Kinect, which achieved highly promising accuracy levels of 80.1% and 96.9%, respectively. Our online experiments show that our memory group sampling mechanism is far superior to the traditional sliding window.

Human action recognition in daily living

Human Action Recognition Based on Kinematic Similarity in Real Time.

Human Action Recognition Using Deep Learning Methods.

Online Robust Action Recognition Based on a Hierarchical Model

On-Line Recognition of Actions in Daily Living

Human Action Recognition with Contextual Constraints Using a RGB-D Sensor

Exploring 3d Human Action Recognition: From Offline To Online

Human Activity Recognition based on Dynamic Spatio-Temporal Relations

Human Action Recognition Based on Human Skeleton Hu Invariant Moments Combined with Human Geometrical Characteristics

An Improved Interest Point Detector for Human Action Recognition

Human Action Recognition Based on Depth Images from Microsoft Kinect

Human Action Recognition with Skeleton Induced Discriminative Approximate Rigid Part Model

Action Recognition Based on Depth Image Sequence

Robust Human Action Recognition Based on Spatio-Temporal Descriptors and Motion Temporal Templates

Human 3D Model-based 2D Action Recognition

Action Reconginiton Using Human Pose

Human Action Recognition Based on Key Frames

Simultaneous Learning from Human Pose and Object Cues for Real-Time Activity Recognition

Online Human Action Recognition with Spatial and Temporal Skeleton Features Using a Distributed Camera Network.

Human Activity Recognition Based on Pose Points Selection

Attention-Oriented Action Recognition for Real-Time Human-Robot Interaction