Abstract:Videos are an accessible form of media for analyzing sports postures and providing feedback to athletes. Existing sport-specific systems embed bespoke human pose attributes and thus can be hard to scale for new attributes, especially for users without programming experiences. Some systems retain scalability by directly showing the differences between two poses, but they might not clearly visualize the key differences that viewers would like to pursue. Besides, video-based coaching systems often present feedback on the correctness of poses by augmenting videos with visual markers or reference poses. However, previewing and augmenting videos limit the analysis and visualization of human poses due to the fixed viewpoints in videos, which confine the observation of captured human movements and cause ambiguity in the augmented feedback. To address these issues, we study customizable human pose data analysis and visualization in the context of running pose attributes, such as joint angles and step distances. Based on existing literature and a formative study, we have designed and implemented a system, PoseCoach, to provide feedback on running poses for amateurs by comparing the running poses between a novice and an expert. PoseCoach adopts a customizable data analysis model to allow users' controllability in defining pose attributes of their interests through our interface. To avoid the influence of viewpoint differences and provide intuitive feedback, PoseCoach visualizes the pose differences as part-based 3D animations on a human model to imitate the demonstration of a human coach. We conduct a user study to verify our design components and conduct expert interviews to evaluate the usefulness of the system.

CoreUI: Interactive Core Training System with 3D Human Shape

AI Coach: Deep Human Pose Estimation and Analysis for Personalized Athletic Training Assistance

Core Training: Learning Deep Neuromuscular Control of the Torso for Anthropomimetic Animation

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

Unsupervised Universal Hierarchical Multi-Person 3D Pose Estimation for Natural Scenes

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

Skeleton Cluster Tracking for robust multi-view multi-person 3D human pose estimation

Real-time Full Body Capture with Inter-part Correlations – Supplemental Document –

Synthetic Training for Monocular Human Mesh Recovery

Coupling Top-down and Bottom-up Methods for 3D Human Pose and Shape Estimation from Monocular Image Sequences

PoseCoach: A Customizable Analysis and Visualization System for Video-based Running Coaching

A Monocular 3D Human Pose Estimation Approach for Virtual Character Skeleton Retargeting.

Detailed Human Shape Estimation From A Single Image By Hierarchical Mesh Deformation

Hybrid 3D Human Pose Estimation with Monocular Video and Sparse IMUs

Multi-Person 3d Pose Estimation From Monocular Image Sequences

Observation-oriented silhouette-aware fast full body tracking with Kinect

HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimation

3D Human Body Shape and Pose Estimation from Depth Image.

Shape and Pose Estimation for Closely Interacting Persons Using Multi-view Images.

A Real-Time 3d Human Body Tracking And Modeling System

An Investigation of 3D Human Pose Estimation for Learning Tai Chi: A Human Factor Perspective