Abstract:Automatic identification of human interaction is a challenging task especially in dynamic environments with cluttered backgrounds from video sequences. Advancements in computer vision sensor technologies provide powerful effects in human interaction recognition (HIR) during routine daily life. In this paper, we propose a novel features extraction method which incorporates robust entropy optimization and an efficient Maximum Entropy Markov Model (MEMM) for HIR via multiple vision sensors. The main objectives of proposed methodology are: (1) to propose a hybrid of four novel features—i.e., spatio-temporal features, energy-based features, shape based angular and geometric features—and a motion-orthogonal histogram of oriented gradient (MO-HOG); (2) to encode hybrid feature descriptors using a codebook, a Gaussian mixture model (GMM) and fisher encoding; (3) to optimize the encoded feature using a cross entropy optimization function; (4) to apply a MEMM classification algorithm to examine empirical expectations and highest entropy, which measure pattern variances to achieve outperformed HIR accuracy results. Our system is tested over three well-known datasets: SBU Kinect interaction; UoL 3D social activity; UT-interaction datasets. Through wide experimentations, the proposed features extraction algorithm, along with cross entropy optimization, has achieved the average accuracy rate of 91.25% with SBU, 90.4% with UoL and 87.4% with UT-Interaction datasets. The proposed HIR system will be applicable to a wide variety of man–machine interfaces, such as public-place surveillance, future medical applications, virtual reality, fitness exercises and 3D interactive gaming.

Capture, Recognition, and Visualization of Human Semantic Interactions in Meetings.

Collaborative capturing and detection of human interactions in meetings

Inferring Human Interactions in Meetings: A Multimodal Approach

Multimodal Sensing, Recognizing and Browsing Group Social Dynamics

Capturing Human Interaction Semantics in Meetings

An Adaptive Vision System Toward Implicit Human Computer Interaction

Automatic Recognition of Human Interaction via Hybrid Descriptors and Maximum Entropy Markov Model Using Depth Sensors

Tree-Based Mining for Discovering Patterns of Human Interaction in Meetings

Extracting Social Semantics from Multimodal Meeting Content

3D Intuitive Gesture Interaction via Motion Sensing

Interactive Phrases: Semantic Descriptions for Human Interaction Recognition.

Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey

Social Interaction Mining in Small Group Discussion Using a Smart Meeting System.

Dynamic context driven human detection and tracking in meeting scenarios.

Learning human interaction by interactive phrases

Automatic inference of interaction occasion in multiparty meetings: Spontaneous or reactive

Towards Smart Meeting: Enabling Technologies And A Real-World Application

Engagement Detection in Meetings

Human-to-Human Interaction Detection

A Semantic Fusion Based Multimodal Interaction Panel for Virtual City Planning

Panoptic Studio: A Massively Multiview System for Social Interaction Capture