The Impact of Quantity of Training Data on Recognition of Eating Gestures

Yiru Shen,Eric Muth,Adam Hoover

DOI: https://doi.org/10.48550/arXiv.1812.04513

2018-12-12

Abstract:This paper considers the problem of recognizing eating gestures by tracking wrist motion. Eating gestures can have large variability in motion depending on the subject, utensil, and type of food or beverage being consumed. Previous works have shown viable proofs-of-concept of recognizing eating gestures in laboratory settings with small numbers of subjects and food types, but it is unclear how well these methods would work if tested on a larger population in natural settings. As more subjects, locations and foods are tested, a larger amount of motion variability could cause a decrease in recognition accuracy. To explore this issue, this paper describes the collection and annotation of 51,614 eating gestures taken by 269 subjects eating a meal in a cafeteria. Experiments are described that explore the complexity of hidden Markov models (HMMs) and the amount of training data needed to adequately capture the motion variability across this large data set. Results found that HMMs needed a complexity of 13 states and 5 Gaussians to reach a plateau in accuracy, signifying that a minimum of 65 samples per gesture type are needed. Results also found that 500 training samples per gesture type were needed to identify the point of diminishing returns in recognition accuracy. Overall, the findings provide evidence that the size a data set typically used to demonstrate a laboratory proofs-of-concept may not be sufficiently large enough to capture all the motion variability that could be expected in transitioning to deployment with a larger population. Our data set, which is 1-2 orders of magnitude larger than all data sets tested in previous works, is being made publicly available.

Machine Learning

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is: **the impact of the amount of training data on the recognition accuracy when identifying eating gestures by tracking wrist movements**. Specifically, the study explored the relationship between the complexity of Hidden Markov Models (HMM) and the amount of required training data when performing large - scale population eating - gesture recognition in natural environments (such as cafeterias).

### Problem Background
The recognition of eating gestures has great variability, which depends on the individual, the utensils used, and the type of food or drink consumed. Although previous studies have demonstrated a viable proof - of - concept in laboratory environments, it is unclear whether these methods can maintain the same accuracy in larger - scale populations. As the number of test subjects, locations, and food types increase, motion variability may lead to a decline in recognition accuracy.

### Research Objectives
1. **Explore the complexity of HMM**: Determine how many states and Gaussian components are required to effectively capture the motion variability of eating gestures.
2. **Evaluate the impact of the amount of training data**: Determine the minimum number of training samples required for each gesture type to achieve the best recognition effect, and find the point of diminishing returns in recognition accuracy.

### Main Findings
- **HMM Complexity**: The study shows that an HMM with 13 states and 5 Gaussian components can reach a plateau in recognition accuracy.
- **Amount of Training Data**: At least 65 samples are required for each gesture type to train an effective HMM, and using 500 samples can further improve the accuracy by 8%.

### Conclusions
The results of this study indicate that the data sets used for proof - of - concept in the laboratory may not be sufficient to capture all motion variability, thereby affecting the recognition accuracy in practical applications. Therefore, in order to ensure a smooth transition from the laboratory to actual deployment, larger - scale data sets and more complex models are required.

Through these studies, the author hopes to provide references for future research, especially on how to ensure the effectiveness and robustness when applying successful models in the laboratory to larger - scale populations.