Abstract:Reliable extraction of human pose features that are invariant to view angle and body shape changes is critical for advancing human movement analysis. In this dissertation, the multifactor analysis techniques, including the multilinear analysis and the multifactor Gaussian process methods, have been exploited to extract such invariant pose features from video data by decomposing various key contributing factors, such as pose, view angle, and body shape, in the generation of the image observations. Experimental results have shown that the resulting pose features extracted using the proposed methods exhibit excellent invariance properties to changes in view angles and body shapes. Furthermore, using the proposed invariant multifactor pose features, a suite of simple while effective algorithms have been developed to solve the movement recognition and pose estimation problems. Using these proposed algorithms, excellent human movement analysis results have been obtained, and most of them are superior to those obtained from state-of-the-art algorithms on the same testing datasets. Moreover, a number of key movement analysis challenges, including robust online gesture spotting and multi-camera gesture recognition, have also been addressed in this research. To this end, an online gesture spotting framework has been developed to automatically detect and learn non-gesture movement patterns to improve gesture localization and recognition from continuous data streams using a hidden Markov network. In addition, the optimal data fusion scheme has been investigated for multicamera gesture recognition, and the decision-level camera fusion scheme using the product rule has been found to be optimal for gesture recognition using multiple uncalibrated cameras. Furthermore, the challenge of optimal camera selection in multi-camera gesture recognition has also been tackled. A measure to quantify the complementary strength across cameras has been proposed. Experimental results obtained from a real-life gesture recognition dataset have shown that the optimal camera combinations identified according to the proposed complementary measure always lead to the best gesture recognition results.

Automatic Feature Extraction of Pose-measuring System Based on Geometric Invariants

Pose Measurement of Non-Cooperative Target Based on Stereo Vision

Direct Alignment with Generalized Correspondences: A Unified Framework for Structure-Based Visual Pose Estimation.

Pose-invariant Face Recognition via SIFT Vocabulary Tree

6D Pose Measurement of Metal Parts Based on Virtual Geometric Feature Point Matching

Automatic foreground extraction of head shoulder images

Pose Measurement for Non-Cooperative Target Based on Visual Information

A Simple Pose Estimation Method Based on Co-Planar Feature Points

Affine Invariant Fusion Feature Extraction Based on Geometry Descriptor and BIT for Object Recognition.

Affine Invariant Feature Extraction Based on Affine Geometry

A New Method for Fast Detection and Pose Estimation of Texture-Less Industrial Parts

Fast and precise 6D pose estimation of textureless objects using the point cloud and gray image

Rectangular Natural Feature Recognition and Pose Measurement Method for Non-Cooperative Spacecraft

A Pose Measurement Method of a Space Noncooperative Target Based on Maximum Outer Contour Recognition

Invariant Human Pose Feature Extraction for Movement Recognition and Pose Estimation

Researches on Binocular Vision Pose Measurement with Selected Feature Points

Line Segment Based Man-Made Object Recognition Using Invariance

High-Accuracy Relative Pose Measurement of Noncooperative Objects Based on Double-Constrained Intersurface Mutual Projections

Multi-sensor Image Registration Based on Algebraic Projective Invariants.

Pose-invariant detection of facial features from range data

Manipulated-object Detection and Pose Estimation Based on Multimodal Feature Points and Neighboring Patches