Abstract:As image processing techniques and devices advance, the real-time applications of computer vision such as human action/interaction recognition and video content analysis become more attractive. However, the methods proposed in the state-of-the-art studies are still far from representing real-time and all-inclusive classifiers because of the image and video analysis complexity. This work presents a new approach based on key-poses of frame silhouettes for human interaction recognition. We use an inner-distance-based shape descriptor which gives a perfect description of the shape due to its ability to collect data from the whole shape. The core idea is to develop a two-step classifier based on a sequential pattern mining classifier. So, we extract the Bilateral Silhouette shape for the persons and describe it based on the inner-distance feature to compare each frame with a pre-defined dictionary of key-poses. The classification process is performed in frame and sequence layers. Accurate and efficient, the sequential pattern mining approach provides an appealing solution to the problem of sequence classification, giving comparable or even better results than standard classifiers. We evaluated the recognition performance of the system using video sequences of SBU human interaction dataset and the UT-interaction dataset as two well-known interaction datasets and the results are considered acceptable (95.25% in SBU and 90.5% in UT databases, respectively), outperforming most state-of-the-art results. These recognition rates are calculated after we have tested different parameters which can affect the results. Both datasets include multiple interaction classes performed by different actors, which helps us develop an all-inclusive method based on the datasets. The proposed method can be optimized to be used in some real world applications such as abnormal activity recognition in crowded places, auxiliary surveillance system, human-computer interaction, etc.

Interaction recognition through positive action representation

Efficient Interaction Recognition Through Positive Action Representation

Recognition and Detection of Two-Person Interactive Actions Using Automatically Selected Skeleton Features

Recognizing Human Interaction by Multiple Features

Action Status Based Novel Relative Feature Representations for Interaction Recognition

Human Interaction Recognition Using Spatial-Temporal Salient Feature

Recognising human interaction from videos by a discriminative model

An interaction system using mixed hand gestures.

A Hierarchical Model for Human Interaction Recognition.

Exemplar-Based Recognition of Human–Object Interactions

Interaction Part Mining: A Mid-Level Approach For Fine-Grained Action Recognition

Human Action Recognition Based on Improved CoHOG-LQC

An Improved Interest Point Detector for Human Action Recognition

A novel hierarchical interaction model and HITS map for action recognition in static images

A Two-Step Shapelets Based Framework for Interactional Activities Recognition

Human Action Recognition with Contextual Constraints Using a RGB-D Sensor

Two-stream Multi-level Dynamic Point Transformer for Two-person Interaction Recognition

Human Interaction Recognition Based on Whole-Individual Detection.

Two-person interaction recognition using a two-step sequential pattern classification

A novel two-level interactive action recognition model based on inertial data fusion

Human Interaction Representation and Recognition Through Motion Decomposition.