Abstract:Articulated skeleton extraction or learning has been extensively studied for 2D (e.g., images and video) and 3D (e.g., volume sequences, motion capture, and mesh sequences) data. Nevertheless, robustly and accurately learning 3D articulated skeletons from point set sequences captured by a single consumer-grade depth camera still remains challenging, since such data are often corrupted with substantial noise and outliers. Relatively few approaches have been proposed to tackle this problem. In this paper, we present a novel unsupervised framework to address this issue. Specifically, we first build one-to-one point correspondences among the point cloud frames in a sequence with our non-rigid point cloud registration algorithm. We then generate a skeleton involving a reasonable number of joints and bones with our skeletal structure extraction algorithm. We lastly present an iterative Linear Blend Skinning based algorithm for accurate joints learning. At the end, our method can learn a quality articulated skeleton from a single 3D point sequence possibly corrupted with noise and outliers. Through qualitative and quantitative evaluations on both publicly available data and in-house Kinectcaptured data, we show that our unsupervised approach soundly outperforms state of the art techniques in terms of both quality (i.e., visual) and accuracy (i.e., Euclidean distance error metric). Moreover, the poses of our extracted skeletons are even comparable to those by KinectSDK, a well-known supervised pose estimation technique; for example, our method and KinectSDK achieves similar distance errors of 0.0497 and 0.0521.

Real-Time Human Segmentation Using Pose Skeleton Map

Human Pose Tracking Algorithm Based on Skeleton-Texture Model

Based on network probabilistic graph human pose segmentation algorithm

3D Human Landmark Detection and Segmentation with Semantic Knowledge

Real-time Skeletonization for Sketch-Based Modeling

Human motion segmentation using collaborative representations of 3D skeletal sequences.

Pose2Seg: Human Instance Segmentation Without Detection.

3D Articulated Skeleton Extraction Using a Single Consumer-Grade Depth Camera.

Live Stream Temporally Embedded 3D Human Body Pose and Shape Estimation

Human Pose Estimation Algorithm Based on Segmentations of Human Head and Shoulder in Video Sequences

Unsupervised Articulated Skeleton Extraction from Point Set Sequences Captured by a Single Depth Camera

Symmetry-Aware Semantic Segmentation of a 3D Human Body Model

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

Real-time human pose recognition in parts from single depth images

QuickPose: Real-time Multi-view Multi-person Pose Estimation in Crowded Scenes

A 3D Human Body Segmentation Algorithm Based on Reeb Graph

Joint Parsing And Segmentation Of Articulated Human Bodies From Videos

AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time

Deep3DPose: Realtime Reconstruction of Arbitrarily Posed Human Bodies from Single RGB Images

A Semi-supervised Clustering-based Segmentation Algorithm of 3D Reconstructed Human Body Parts

Pose2Seg: Detection Free Human Instance Segmentation