Abstract:Articulated skeleton extraction or learning has been extensively studied for 2D (e.g., images and video) and 3D (e.g., volume sequences, motion capture, and mesh sequences) data. Nevertheless, robustly and accurately learning 3D articulated skeletons from point set sequences captured by a single consumer-grade depth camera still remains challenging, since such data are often corrupted with substantial noise and outliers. Relatively few approaches have been proposed to tackle this problem. In this paper, we present a novel unsupervised framework to address this issue. Specifically, we first build one-to-one point correspondences among the point cloud frames in a sequence with our non-rigid point cloud registration algorithm. We then generate a skeleton involving a reasonable number of joints and bones with our skeletal structure extraction algorithm. We lastly present an iterative Linear Blend Skinning based algorithm for accurate joints learning. At the end, our method can learn a quality articulated skeleton from a single 3D point sequence possibly corrupted with noise and outliers. Through qualitative and quantitative evaluations on both publicly available data and in-house Kinectcaptured data, we show that our unsupervised approach soundly outperforms state of the art techniques in terms of both quality (i.e., visual) and accuracy (i.e., Euclidean distance error metric). Moreover, the poses of our extracted skeletons are even comparable to those by KinectSDK, a well-known supervised pose estimation technique; for example, our method and KinectSDK achieves similar distance errors of 0.0497 and 0.0521.

Mass-Driven Topology-Aware Curve Skeleton Extraction from Incomplete Point Clouds

Curve Skeleton Extraction From 3D Point Clouds Through Hybrid Feature Point Shifting and Clustering

A New Method for Extracting Feature Skeleton from Point Cloud

EPCS: Endpoint-based Part-aware Curve Skeleton Extraction for Low-quality Point Clouds

Skeleton-driven 2D Distance Field Metamorphosis Using Intrinsic Shape Parameters

Skeleton Extraction from 3D Point Clouds by Decomposing the Object into Parts

Mmskeleton: 3D Human Skeleton Estimation Using Millimeter Wave Radar Sparse Point Clouds

L 1 -Medial Skeleton of Point Cloud

Skeleton Extraction by Mesh Contraction

Point2Skeleton: Learning Skeletal Representations from Point Clouds

Real-time Skeletonization for Sketch-Based Modeling

3D Articulated Skeleton Extraction Using a Single Consumer-Grade Depth Camera.

Robust Reconstruction of Closed Parametric Curves by Topological Understanding with Persistent Homology.

Fast and robust curve skeletonization for real-world elongated objects

Unsupervised Articulated Skeleton Extraction from Point Set Sequences Captured by a Single Depth Camera

Fitting Unorganized Point Clouds with Active Implicit B-spline Curves

CurveCloudNet: Processing Point Clouds with 1D Structure

A novel tree-structured point cloud dataset for skeletonization algorithm evaluation

Repairing Topological Inconsistency of Mesh Sequences

PointSkelCNN: Deep Learning-Based 3D Human Skeleton Extraction from Point Clouds

A Two-Phase Approach of Progressive Mesh Reconstruction from Unorganized Point Clouds