Relative Merits of Nominal and Effective Indexes of Difficulty of Fitts' Law: Effects of Sample Size and the Number of Repetitions on Model Fit

Shota YamanakaYahoo Japan Corporation,Tokyo,JapanShota Yamanaka is a senior chief researcher at Yahoo! JAPAN Research. He received his PhD in engineering from Meiji University in 2016. His research interests include human-computer interaction,graphical user interfaces,and human performance modeling.
DOI: https://doi.org/10.1080/10447318.2024.2303201
IF: 4.92
2024-01-16
International Journal of Human-Computer Interaction
Abstract:Two formulations of Fitts' index of difficulty ID are empirically compared under different subjective speed-accuracy biases: the nominal form IDn and the effective form IDe using endpoint variability. The effective forms have typically been considered beneficial for capturing the actual accuracy of users' performance, while the nominal form is better for single-biased data. In our analysis of the data from 210 crowdworkers, the best model tended to switch. At times, this switch was statistically significant, especially when limited portions of the entire workers and trials were used, such as the first eight clicks (out of 16) performed by 20 workers who were randomly sampled from a comprehensive group of 210 participants. Our findings caution against assuming a model's capability based on only a few experiments using a limited number of participants or just a few trials. They also emphasize the need for performing replications on even well-investigated models.
computer science, cybernetics,ergonomics
What problem does this paper attempt to address?