Joint Modeling of Psychological Experimental Data: Mixed Effects of Reaction and Reaction Time
GUO Xiaojun,JIAO Yuyue,BAI Xiaoyun,LUO Zhaosheng,LI Hong
DOI: https://doi.org/10.3724/sp.j.1041.2024.01619
2024-01-01
Acta Psychologica Sinica
Abstract:Mixed-Effects Models(MEMs)have become a prominent trend in the analysis of psychological experiment data.MEMs can simultaneously treat both subjects and stimuli as random variables,effectively analyzing experimental effects and the associated differences between subjects(or stimuli).This approach avoids the issue of treating subjects or stimuli as fixed variables and consequently the high incidence of false positives,which is common in analysis of variance(ANOVA).Typically,in psychological experiments,reaction and reaction times are described and modeled separately.However,this separation hinders the full utilization and integration of different data from subjects to exploit maximum information from sample datasets. Current psychometric and cognitive process models attempt to jointly analyze different data sources,providing insights for the joint modeling of psychological experiment data.In psychological experiments,a specific duration is typically set for each stimulus,and subjects are required to make a keystroke response within this period.This setup is similar to time-limited tests,but the tasks in psychological experiments are usually simpler.Based on this,the paper constructs three joint models:mixed MEM,independent MEM,and speed MEM.These models are compared with the separate model of reaction and reaction time data(i.e.,separate MEM)in a series of studies. In the analysis of IAT(Implicit Association Test)experiment data,the separate MEM was found to be inferior to the independent MEM in both data fitting and parameter estimation.The mixed MEM showed better model fit indices than both independent MEM and speed MEM.In the simulation studies,different comparisons were conducted using mixed MEM and speed MEM as benchmark models.The simulation results show that the relative bias in parameter estimation for separate MEM was generally greater than that for independent MEM,and it had a higher Type I error rate.Among the joint models,the independent MEM exhibited significant parameter estimate biases across benchmark models and also had high Type I error rates and statistical power.Similarly,the speed MEM was found to have comparable issues under mixed MEM simulation conditions.On the other hand,the mixed MEM was able to better identify parameters under different simulated scenarios compared to other joint models,and it had better Type I error rates and statistical power. In conclusion,joint modeling is more advantageous than separate analysis in psychological experiments.Moreover,the reaction and reaction times in experimental tasks are more likely to have complex mixed influence relationships.