Abstract:Reliable extraction of human pose features that are invariant to view angle and body shape changes is critical for advancing human movement analysis. In this dissertation, the multifactor analysis techniques, including the multilinear analysis and the multifactor Gaussian process methods, have been exploited to extract such invariant pose features from video data by decomposing various key contributing factors, such as pose, view angle, and body shape, in the generation of the image observations. Experimental results have shown that the resulting pose features extracted using the proposed methods exhibit excellent invariance properties to changes in view angles and body shapes. Furthermore, using the proposed invariant multifactor pose features, a suite of simple while effective algorithms have been developed to solve the movement recognition and pose estimation problems. Using these proposed algorithms, excellent human movement analysis results have been obtained, and most of them are superior to those obtained from state-of-the-art algorithms on the same testing datasets. Moreover, a number of key movement analysis challenges, including robust online gesture spotting and multi-camera gesture recognition, have also been addressed in this research. To this end, an online gesture spotting framework has been developed to automatically detect and learn non-gesture movement patterns to improve gesture localization and recognition from continuous data streams using a hidden Markov network. In addition, the optimal data fusion scheme has been investigated for multicamera gesture recognition, and the decision-level camera fusion scheme using the product rule has been found to be optimal for gesture recognition using multiple uncalibrated cameras. Furthermore, the challenge of optimal camera selection in multi-camera gesture recognition has also been tackled. A measure to quantify the complementary strength across cameras has been proposed. Experimental results obtained from a real-life gesture recognition dataset have shown that the optimal camera combinations identified according to the proposed complementary measure always lead to the best gesture recognition results.

View-invariant Full-Body Gesture Recognition Via Multilinear Analysis of Voxel Data

Dynamic hand gesture recognition using hidden Markov models

View-invariant Full-Body Gesture Recognition from Video

2D Motion Detection Bounded Hand 3D Trajectory Tracking and Gesture Recognition under Complex Background

Online gesture spotting from visual hull data.

Invariant Human Pose Feature Extraction for Movement Recognition and Pose Estimation

Gesture Recognition with a 3-D Accelerometer

Surface Electromyography-based Gesture Recognition by Multi-view Deep Learning.

MVHANet: Multi-view Hierarchical Aggregation Network for Skeleton-Based Hand Gesture Recognition

Online human gesture recognition from motion data streams.

View-Invariant Pose Recognition Using Multilinear Analysis and the Universum

A Kinect Based Gesture Recognition Algorithm Using Gmm And Hmm

WristCam: A Wearable Sensor for Hand Trajectory Gesture Recognition and Intelligent Human–Robot Interaction

Multiview human pose estimation with unconstrained motions

Vision-Based Gesture Recognition Referring to Human Structure

Multiresolution Match Kernels for Gesture Video Classification

A Novel EMG-Based Hand Gesture Recognition Framework Based on Multivariate Variational Mode Decomposition

Viewpoint-independent Hand Gesture Recognition System

Binocular Dance Pose Recognition and Body Orientation Estimation via Multilinear Analysis

Binocular Full-Body Pose Recognition and Orientation Inference Using Multilinear Analysis

Kinect Sensor Based Gesture Recognition for Surveillance Application