Abstract:Abstract Automated human action recognition is one of the most attractive and practical research fields in computer vision. In such systems, the human action labelling is based on the appearance and patterns of the motions in the video sequences; however, majority of the existing research and most of the conventional methodologies and classic neural networks either neglect or are not able to use temporal information for action recognition prediction in a video sequence. On the other hand, the computational cost of a proper and accurate human action recognition is high. In this paper, we address the challenges of the preprocessing phase, by an automated selection of representative frames from the input sequences. We extract the key features of the representative frame rather than the entire features. We propose a hierarchical technique using background subtraction and HOG, followed by application of a deep neural network and skeletal modelling method. The combination of a CNN and the LSTM recursive network is considered for feature selection and maintaining the previous information; and finally, a Softmax-KNN classifier is used for labelling the human activities. We name our model as “Hierarchical Feature Reduction & Deep Learning” -based action recognition method, or HFR-DL in short. To evaluate the proposed method, we use the UCF101 dataset for the benchmarking which is widely used among researchers in the action recognition research field. The dataset includes 101 complicated activities in the wild. Experimental results show a significant improvement in terms of accuracy and speed in comparison with eight state-of-the-art methods.

Human action recognition based on multi-feature fusion and hierarchical BP-AdaBoost algorithm

Recognizing Human Actions by BP-AdaBoost Algorithm under a Hierarchical Recognition Framework

Human Action Recognition Based on Three-Stream Network with Frame Sequence Features

Human Action Recognition Using Deep Learning Methods.

Human Action Recognition Based on Hierarchical Multi-Scale Adaptive Conv-Long Short-Term Memory Network

Complex Human Action Recognition Using a Hierarchical Feature Reduction and Deep Learning-Based Method

Joint Multi-Scale Residual and Motion Feature Learning for Action Recognition.

Online Robust Action Recognition Based on a Hierarchical Model

Multi-feature fusion based human action recognition algorithm

Action recognition using a hierarchy of feature groups

Human Action Recognition Based on Improved Fusion Attention CNN and RNN

Local-aware spatio-temporal attention network with multi-stage feature fusion for human action recognition

Action Recognition Using 3d Histograms of Texture and A Multi-Class Boosting Classifier

Human Action Recognition Based on Fusion Features Extraction of Adaptive Background Subtraction and Optical Flow Model

Human-Object Contour for Action Recognition with Attentional Multi-modal Fusion Network

Attribute-based supervised deep learning model for action recognition

Hierarchical Multi-scale Attention Networks for Action Recognition

Skeleton-Indexed Deep Multi-Modal Feature Learning for High Performance Human Action Recognition

Human Action Recognition Based on HOIRM Feature Fusion and AP Clustering BOW.

Action Recognition Based on Adaptive Fusion of RGB and Skeleton Features

Boosted Multi-Class Semi-Supervised Learning for Human Action Recognition