Abstract:The visual recognition of complex, articulated human movements is fundamental for a wide range of artificial systems oriented toward human-robot communication, action classification, and action-driven perception. These challenging tasks may generally involve the processing of a huge amount of visual information and learning-based mechanisms for generalizing a set of training actions and classifying new samples. To operate in natural environments, a crucial property is the efficient and robust recognition of actions, also under noisy conditions caused by, for instance, systematic sensor errors and temporarily occluded persons. Studies of the mammalian visual system and its outperforming ability to process biological motion information suggest separate neural pathways for the distinct processing of pose and motion features at multiple levels and the subsequent integration of these visual cues for action perception. We present a neurobiologically-motivated approach to achieve noise-tolerant action recognition in real time. Our model consists of self-organizing Growing When Required (GWR) networks that obtain progressively generalized representations of sensory inputs and learn inherent spatio-temporal dependencies. During the training, the GWR networks dynamically change their topological structure to better match the input space. We first extract pose and motion features from video sequences and then cluster actions in terms of prototypical pose-motion trajectories. Multi-cue trajectories from matching action frames are subsequently combined to provide action dynamics in the joint feature space. Reported experiments show that our approach outperforms previous results on a dataset of full-body actions captured with a depth sensor, and ranks among the best results for a public benchmark of domestic daily actions.

Human Action Recognition by Imitating the Simple Cells of Visual Cortex

Computational Model of Primary Visual Cortex Combining Visual Attention for Action Recognition

Human Action Recognition Based on Spiking Neural Networks

Human Action Recognition Using Deep Learning Methods.

Human Action Recognition From Digital Videos Based on Deep Learning.

Self-organizing neural integration of pose-motion features for human action recognition

Human Action Recognition Based on Extracted Discriminative Regions

Human Action Recognition by Learning Spatio-Temporal Features with Deep Neural Networks

Human Action Recognition Based On Oriented Motion Salient Regions

Combining Multi-scale Directed Depth Motion Maps and Log-Gabor Filters for Human Action Recognition

A fast human action recognition network based on spatio-temporal features

Human Action Recognition Based on Deep Images and Dense Trajectories

Oriented Gradients for Human Action Recognition.

Human action recognition in videos using motion impression image

Exploring Hybrid Spatio-Temporal Convolutional Networks for Human Action Recognition.

Human Action Recognition Using Key-Frame Attention-Based LSTM Networks

Skeleton-based Human Action Recognition by Fusing Attention Based Three-Stream Convolutional Neural Network and SVM.

Action Recognition Using Lie Algebrized Gaussians over Dense Local Spatio-Temporal Features.

Human Action Recognition Using Sparse Representation

An Efficient Motion Visual Learning Method for Video Action Recognition

Human action recognition using Adaptive Hierarchical Depth Motion Maps and Gabor filter