Abstract:Automatic tagging of video recordings of sports matches and training sessions can be helpful to coaches and players and provide access to structured data at a scale that would be unfeasible if one were to rely on manual tagging. Recognition of different actions forms an essential part of sports video tagging. In this paper, the authors employ machine learning techniques to automatically recognize specific types of volleyball actions (i.e., underhand serve, overhead pass, serve, forearm pass, one hand pass, smash, and block which are manually annotated) during matches and training sessions (uncontrolled, in the wild data) based on motion data captured by inertial measurement unit sensors strapped on the wrists of eight female volleyball players. Analysis of the results suggests that all sensors in the inertial measurement unit (i.e., magnetometer, accelerometer, barometer, and gyroscope) contribute unique information in the classification of volleyball actions types. The authors demonstrate that while the accelerometer feature set provides better results than other sensors, overall (i.e., gyroscope, magnetometer, and barometer) feature fusion of the accelerometer, magnetometer, and gyroscope provides the bests results (unweighted average recall = 67.87%, unweighted average precision = 68.68%, and κ = .727), well above the chance level of 14.28%. Interestingly, it is also demonstrated that the dominant hand (unweighted average recall = 61.45%, unweighted average precision = 65.41%, and κ = .652) provides better results than the nondominant (unweighted average recall = 45.56%, unweighted average precision = 55.45, and κ = .553) hand. Apart from machine learning models, this paper also discusses a modular architecture for a system to automatically supplement video recording by detecting events of interests in volleyball matches and training sessions and to provide tailored and interactive multimodal feedback by utilizing an HTML5/JavaScript application. A proof of concept prototype developed based on this architecture is also described.

Online Real-Time Learning Strategies for Data Streams for Neurocomputing

Gesture Recognition Based on Localist Attractor Networks with Application to Robot Control [Application Notes]

Structured Streaming Skeleton -- A New Feature for Online Human Gesture Recognition

Online human gesture recognition from motion data streams.

A Motion-based User Interface for the Control of Virtual Humans Performing Sports.

Online Recognition of Incomplete Gesture Data to Interface Collaborative Robots

A fully connected deep learning approach to upper limb gesture recognition in a secure FES rehabilitation environment

Online Human Gesture Recognition using Recurrent Neural Networks and Wearable Sensors

Online Learning with Mobile Sensor Data for User Recognition

Biosensor-Based Multimodal Deep Human Locomotion Decoding via Internet of Healthcare Things

Real-Time Gesture Recognition with Virtual Glove Markers

Real-time 3D full body motion gesture recognition

Study on Gesture Recognition Method with Two-Stream Residual Network Fusing sEMG Signals and Acceleration Signals

Analysis of Students' Sports Exercise Behavior and Health Education Strategy Using Visual Perception–Motion Recognition Algorithm

Towards Automatic Modeling of Volleyball Players’ Behavior for Analysis, Feedback, and Hybrid Training

Deep Temporal Model-Based Identity-Aware Hand Detection for Space Human-Robot Interaction

A Dynamic Head Gesture Recognition Method for Real-time Intention Inference and Its Application to Visual Human-robot Interaction

A Real-Time Hand Posture Recognition System Using Deep Neural Networks

Computer Vision-Based Real-Time 3d Gesture Recognition Using Depth Image

Real-time hand gesture recognition using multiple deep learning architectures

Human Gait Recognition Based on Deterministic Learning and Data Stream of Microsoft Kinect.