Abstract:Mixed-Effects Models(MEMs)have become a prominent trend in the analysis of psychological experiment data.MEMs can simultaneously treat both subjects and stimuli as random variables,effectively analyzing experimental effects and the associated differences between subjects(or stimuli).This approach avoids the issue of treating subjects or stimuli as fixed variables and consequently the high incidence of false positives,which is common in analysis of variance(ANOVA).Typically,in psychological experiments,reaction and reaction times are described and modeled separately.However,this separation hinders the full utilization and integration of different data from subjects to exploit maximum information from sample datasets. Current psychometric and cognitive process models attempt to jointly analyze different data sources,providing insights for the joint modeling of psychological experiment data.In psychological experiments,a specific duration is typically set for each stimulus,and subjects are required to make a keystroke response within this period.This setup is similar to time-limited tests,but the tasks in psychological experiments are usually simpler.Based on this,the paper constructs three joint models:mixed MEM,independent MEM,and speed MEM.These models are compared with the separate model of reaction and reaction time data(i.e.,separate MEM)in a series of studies. In the analysis of IAT(Implicit Association Test)experiment data,the separate MEM was found to be inferior to the independent MEM in both data fitting and parameter estimation.The mixed MEM showed better model fit indices than both independent MEM and speed MEM.In the simulation studies,different comparisons were conducted using mixed MEM and speed MEM as benchmark models.The simulation results show that the relative bias in parameter estimation for separate MEM was generally greater than that for independent MEM,and it had a higher Type I error rate.Among the joint models,the independent MEM exhibited significant parameter estimate biases across benchmark models and also had high Type I error rates and statistical power.Similarly,the speed MEM was found to have comparable issues under mixed MEM simulation conditions.On the other hand,the mixed MEM was able to better identify parameters under different simulated scenarios compared to other joint models,and it had better Type I error rates and statistical power. In conclusion,joint modeling is more advantageous than separate analysis in psychological experiments.Moreover,the reaction and reaction times in experimental tasks are more likely to have complex mixed influence relationships.

Benefits of multinomial processing tree models with discrete and continuous variables in memory research: an alternative modeling proposal to Juola et al. (2019)

A critical comparison of discrete-state and continuous models of recognition memory: Implications for recognition and beyond.

Discrete-state and continuous models of recognition memory: Testing core properties under minimal assumptions.

RT-MPTs: Process models for response-time distributions with diffusion-model kernels

A Multinomial Processing Tree Model of the 2-back Working Memory Task

Evaluating the robustness of parameter estimates in cognitive models: A meta-analytic review of multinomial processing tree models across the multiverse of estimation methods.

Hierarchical multinomial processing tree models for meta-analysis of diagnostic accuracy studies

Modeling confidence judgments, response times, and multiple choices in decision making: Recognition memory and motion discrimination.

A response time model of the three-choice Mnemonic Similarity Task provides stable, mechanistically interpretable individual-difference measures

On aggregation invariance of multinomial processing tree models

Cognitive modeling of the Mnemonic Similarity Task as a digital biomarker for Alzheimer's disease

Complementary benefits of multivariate and hierarchical models for identifying individual differences in cognitive control

Joint Modeling of Psychological Experimental Data: Mixed Effects of Reaction and Reaction Time

HIINT: Historical, Intra- and Inter- personal Dynamics Modeling with Cross-person Memory Transformer

Refining Bayesian hierarchical MPT modeling: Integrating prior knowledge and ordinal expectations

Everyday amnesia: Residual memory for high confidence misses and implications for decision models of recognition.

Tree Inference: Response Time in a Binary Multinomial Processing Tree, Representation and Uniqueness of Parameters

On using the fixed-point property of binary mixtures to discriminate among models of recognition memory

Cognitive modeling of the Mnemonic Similarity Task as a digital biomarker for Alzheimer’s Disease

Interpreting and Testing Interactions in Conditional Mixture Models

Discrete threshold versus continuous strength models of perceptual recognition