How instructed knowledge shapes adaptive learning

Lauren Atlas,Bradley B Doll,Jian Li,Nathaniel Daw,Elizabeth A Phelps
DOI: https://doi.org/10.31234/osf.io/f4sh9
2018-01-01
Abstract:We previously published results of a study examining how instructions shape aversive reversal learning (Atlas et al., 2016). Our original paper measured how instructions and learning influence on expected value, and assumed that learning rates remain stable over time. We found that instructions caused immediate reversals in corticostriatal systems, while value signals in the amygdala required reinforcement in order to update. However, our paradigm was originally designed to measure adaptive learning, and to test whether previously observed neural dissociations in the encoding of associability and prediction error i) replicate in the context of repeated reversals and ii) are modulated with instructions. Here, we present reanalyses using a hybrid model, in which associability gates learning. In our Uninstructed Group, we replicate previous dissociations (Li et al., 2011) such that the striatum tracks prediction error while the amygdala tracks associability. Comparisons with an Instructed Group reveal that instructions update expected value and striatal prediction error, while amygdala associability updates based on feedback alone, irrespective of instruction. This work adds to a growing body of literature on adaptive learning and provides new results that suggest that instructions have dissociable effects on prediction error and associability.
What problem does this paper attempt to address?