Choosing, rejecting, and closely replicating, 30 years later: A commentary on Chandrashekar et al.

Eldar Shafir,Nathan N. Cheek

DOI: https://doi.org/10.1017/jdm.2023.48

2024-01-01

Judgment and decision making

Abstract:Abstract In a ‘very close replication’ study using the same attributes as the original, Chandrashekar et al. (2021) report a failure to replicate some choose–reject problems documented in Shafir (1993). We find that several of the original attributes have changed their valence three decades later, and we compose new versions with updated attributes that fully replicate Shafir’s (1993) original findings. Despite their apparent exactitude, ‘very close replications’ across contexts or time, when stimuli may have changed their meaning or valence, can be highly misleading, further exacerbating replication concerns.

psychology, multidisciplinary

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is the replication problem regarding the choice and rejection decision - making patterns. Specifically, the author of the paper explored the failure to successfully replicate Shafir's research results in 1993 in the study published by Chandrashekar et al. in 2021. Shafir's original research revealed that choice and rejection are not complementary processes, that is, when people choose an option, they are also more likely to reject the same option, especially when this option has more positive and negative attributes. However, Chandrashekar et al.'s "near - replication" study failed to reproduce this finding, which raised doubts about the reliability of the original research results.

By re - evaluating whether the attributes (such as income, health status, working hours, etc.) in the original research still have the same meaning and value 30 years later, the author of the paper found that with the passage of time, the meaning and value of these attributes have changed. For example, "average working hours" may have been regarded as a neutral or slightly negative attribute in the past, but in the current social context, with people's emphasis on work - life balance, this attribute may be re - evaluated as a positive attribute. Based on these new evaluations, the author of the paper designed two new versions to test the choice and rejection decision - making patterns and successfully replicated Shafir's original research results.

Therefore, this paper not only solves the problem of whether the original research results can be replicated, but also emphasizes that when conducting replication research across time and cultural backgrounds, the timeliness and cultural sensitivity of experimental materials need to be considered to ensure the effectiveness and reliability of the experiment.