Abstract:Skeleton-based human action recognition is a longstanding challenge due to its complex dynamics. Some fine-grain details of the dynamics play a vital role in classification. The existing work largely focuses on designing incremental neural networks with more complicated adjacent matrices to capture the details of joints relationships. However, they still have difficulties distinguishing actions that have broadly similar motion patterns but belong to different categories. Interestingly, we found that the subtle differences in motion patterns can be significantly amplified and become easy for audience to distinct through specified view directions, where this property haven't been fully explored before. Drastically different from previous work, we boost the performance by proposing a conceptually simple yet effective Multi-view strategy that recognizes actions from a collection of dynamic view features. Specifically, we design a novel Skeleton-Anchor Proposal (SAP) module which contains a Multi-head structure to learn a set of views. For feature learning of different views, we introduce a novel Angle Representation to transform the actions under different views and feed the transformations into the baseline model. Our module can work seamlessly with the existing action classification model. Incorporated with baseline models, our SAP module exhibits clear performance gains on many challenging benchmarks. Moreover, comprehensive experiments show that our model consistently beats down the state-of-the-art and remains effective and robust especially when dealing with corrupted data. Related code will be available on https://github.com/ideal-idea/SAP .

Distinctive Action Sketch

Distinctive Action Sketch for Human Action Recognition.

Sketching Feature-Based Modeling by Capturing Design Intention

SceneSketcher: Fine-Grained Image Retrieval with Scene Sketches

Sketch-Based Retrieval in Large-Scale Image Database Via Position-Aware Silhouette Matching.

Sketch-based 3D Modeling by Aligning Outlines of an Image

Model-driven sketch reconstruction with structure-oriented retrieval

Video sketch: A middle-level representation for action recognition

Shifting Perspective to See Difference: A Novel Multi-View Method for Skeleton Based Action Recognition

Human motion retrieval based on freehand sketch

Why Does the Sketch Look So Vivid?

Sketch-based Video Object Segmentation: Benchmark and Analysis

An Interactive Personalized Video Summarization Based on Sketches.

SketchMaker: Sketch Extraction and Reuse for Interactive Scene Sketch Composition

Deep3DSketch+\+: High-Fidelity 3D Modeling from Single Free-hand Sketches

A Preliminary Study On Extracting Objects In Sketches

3D Sketching for 3D Object Retrieval

Deep3DSketch+: Rapid 3D Modeling from Single Free-hand Sketches

Optical Flow-based Spatiotemporal Sketch for Video Representation: A Novel Framework

CustomSketching: Sketch Concept Extraction for Sketch-based Image Synthesis and Editing

Sketch based modeling and editing via shape space exploration