Lowered cutoffs to reduce false positives on the Word Memory Test

Martin L. Rohling,George J. Demakis,Jennifer Langhinrichsen-Rohling

DOI: https://doi.org/10.1080/13803395.2024.2314736

2024-02-18

Journal of Clinical and Experimental Neuropsychology

Abstract:Objective To adjust the decision criterion for the Word Memory Test (WMT, Green, 2003) to minimize the frequency of false positives.

psychology, clinical,clinical neurology

What problem does this paper attempt to address?

Further Consideration of Advanced Clinical Solutions Word Choice: Comparison to the Recognition Memory Test-Words and Classification Accuracy in a Clinical Sample

Jeremy J. Davis

DOI: https://doi.org/10.1080/13854046.2014.975844

2014-11-05

The Clinical Neuropsychologist

Abstract:Word Choice (WC), a test in the Advanced Clinical Solutions package for Wechsler measures, was examined in two studies. The first study compared WC to the Recognition Memory Test-Words (RMT-W) in a clinical sample (N = 46). WC scores were significantly higher than RMT-W scores overall and in sample subsets grouped by separate validity indicators. In item-level analyses, WC items demonstrated lower frequency, greater imageability, and higher concreteness than RMT-W items. The second study explored WC classification accuracy in a different clinical sample grouped by separate validity indicators into Pass (n = 54), Fail-1 (n = 17), and Fail-2 (n = 8) groups. WC scores were significantly higher in the Pass group (M = 49.1, SD = 1.9) than in the Fail-1 (M = 46.0, SD = 5.3) and Fail-2 (M = 44.1, SD = 4.8) groups. WC demonstrated area under the curve of .81 in classifying Pass and Fail-2 participants. Using the test manual cutoff associated with a 10% false positive rate, sensitivity was 38% and specificity was 96% in Pass and Fail-2 groups with 24% of Fail-1 participants scoring below cutoff. WC may be optimally used in combination with other measures given observed sensitivity.
Optimizing Cognitive Assessment Outcome Measures for Alzheimer's Disease by Matching Wordlist Memory Test Features to Scoring Methodology

Jason R Bock,Julie Russell,Junko Hara,Dennis Fortier

DOI: https://doi.org/10.3389/fdgth.2021.750549

2021-11-03

Abstract:Cognitive assessment with wordlist memory tests is a cost-effective and non-invasive method of identifying cognitive changes due to Alzheimer's disease and measuring clinical outcomes. However, with a rising need for more precise and granular measures of cognitive changes, especially in earlier or preclinical stages of Alzheimer's disease, traditional scoring methods have failed to provide adequate accuracy and information. Well-validated and widely adopted wordlist memory tests vary in many ways, including list length, number of learning trials, order of word presentation across trials, and inclusion of semantic categories, and these differences meaningfully impact cognition. While many simple scoring methods fail to account for the information that these features provide, extensive effort has been made to develop scoring methodologies, including the use of latent models that enable capture of this information for preclinical differentiation and prediction of cognitive changes. In this perspective article, we discuss prominent wordlist memory tests in use, their features, how different scoring methods fail or successfully capture the information these features provide, and recommendations for emerging cognitive models that optimally account for wordlist memory test features. Matching the use of such scoring methods to wordlist memory tests with appropriate features is key to obtaining precise measurement of subtle cognitive changes.
That old dog can still hunt—Alternative cutoffs and the recognition trial improve the classification accuracy of the Rey 15-Item Test.

Kelly Y. An,Kaitlyn Abeare,Laura Cutler,Maame Brantuo,Sami Ali,Luciano Giromini,Maurissa Hastings,Laszlo A. Erdodi

DOI: https://doi.org/10.1037/pro0000557

2024-10-18

Professional Psychology Research and Practice

Abstract:This study was designed to test the upper limits of the Rey-15's classification accuracy in cognitively intact university students and clinical patients. A brief battery of neuropsychological tests was administered to all participants. Students were randomly assigned to either the control ( n = 80) or experimental malingering ( n = 59) condition. Invalid performance in patients ( n = 52) was psychometrically defined. The classification accuracy of the Rey-15 (original free recall and the combination score including the recognition trial developed by Boone et al., 2002) was computed across a range of cutoffs. A free recall ≤ 13 and combination score ≤ 25 produced a good combination of sensitivity (.41–.70) and specificity (.90–.94) among students. The highest cutoff to reach .90 specificity in clinical patients was free recall ≤ 11 and combination score ≤ 23, at .38–.56 sensitivity. Results confirmed the previous reports that more liberal alternative cutoffs maintain adequate specificity. Cutoffs can be raised even further in cognitively intact examinees. The introduction of the recognition trial provided a significant boost to the instrument's classification accuracy. The Rey-15 remains a cost-effective and clinically useful test in both clinical and research settings. (PsycInfo Database Record (c) 2024 APA, all rights reserved)

psychology, multidisciplinary
The classification accuracy of Warrington's recognition memory test (words) as a performance validity Test in a neurorehabilitation setting

Jenna Parsons,Nelson B. Rodrigues,Laszlo A. Erdodi

DOI: https://doi.org/10.1080/23279095.2024.2337130

2024-06-25

Applied Neuropsychology Adult

Abstract:This study was designed to evaluate the classification accuracy of the Warrington's Recognition Memory Test (RMT) in 167 patients (97 or 58.1% men; M Age = 40.4; M Education = 13.8) medically referred for neuropsychological evaluation against five psychometrically defined criterion groups. At the optimal cutoff (≤42), the RMT produced an acceptable combination of sensitivity (.36-.60) and specificity (.85-.95), correctly classifying 68.4-83.3% of the sample. Making the cutoff more conservative (≤41) improved specificity (.88-.95) at the expense of sensitivity (.30-.60). Lowering the cutoff to ≤40 achieved uniformly high specificity (.91-.95) but diminished sensitivity (.27-.48). RMT scores were unrelated to lateral dominance, education, or gender. The RMT was sensitive to a three-way classification of performance validity ( Pass/Borderline/Fail ), further demonstrating its discriminant power. Despite a notable decline in research studies focused on its classification accuracy within the last decade, the RMT remains an effective free-standing PVT that is robust to demographic variables. Relatively low sensitivity is its main liability. Further research is needed on its cross-cultural validity (sensitivity to limited English proficiency).

psychology,clinical neurology
Cognitive components of aging-related increase in word-finding difficulty

Hsi T. Wei,Dana Kulzhabayeva,Lella Erceg,Jessica Robin,You Zhi Hu,Mark Chignell,Jed A. Meltzer

DOI: https://doi.org/10.1080/13825585.2024.2315774

2024-02-16

Aging Neuropsychology and Cognition

Abstract:Word-finding difficulty (WFD) is a common cognitive complaint in aging, manifesting both in natural speech and in controlled laboratory tests. Various theories of cognitive aging have addressed WFD, and understanding its underlying mechanisms can help to clarify whether it has diagnostic value for neurodegenerative disease. Two influential "information-universal" theories attribute it to rather broad changes in cognition. The processing speed theory posits a general slowdown of all cognitive processes, while the inhibitory deficit hypothesis (IDH) predicts a specific problem in suppressing irrelevant information. One "information specific" theory of language production, the transmission deficit hypothesis (TDH), posits a breakdown in retrieval of phonological word forms from a corresponding lemma. To adjudicate between these accounts, we administered an online gamified covert naming task featuring picture-word interference (PWI), previously validated to elicit similar semantic interference and phonological facilitation effects as overt naming tasks. 125 healthy adults aged 18 to 85 completed the task, along with a battery of executive function tasks and a naturalistic speech sample to quantify WFD in connected speech. PWI effects provided strong support for the TDH but limited support for IDH, in that semantic interference increased and phonological facilitation decreased across the lifespan. However, neither of these effects on single-word retrieval associated with WFD measured in connected speech. Rather, overall reaction time for word retrieval (controlling for psychomotor slowing) was the best predictor of spontaneous WFD and executive function decline, suggesting processing speed as the key factor, and that verbal reaction time may be an important clinical measure.

psychology, experimental, developmental
Using ROC Analysis to Refine Cut Scores Following a Standard Setting Process

Dongwei Wang,Lisa A. Keller

DOI: https://doi.org/10.1177/00131644241278925

2024-09-26

Educational and Psychological Measurement

Abstract:Educational and Psychological Measurement, Ahead of Print. In educational assessment, cut scores are often defined through standard setting by a group of subject matter experts. This study aims to investigate the impact of several factors on classification accuracy using the receiver operating characteristic (ROC) analysis to provide statistical and theoretical evidence when the cut score needs to be refined. Factors examined in the study include the sample distribution relative to the cut score, prevalence of the positive event, and cost ratio. Forty item responses were simulated for examinees of four sample distributions. In addition, the prevalence and cost ratio between false negatives and false positives were manipulated to examine their impacts on classification accuracy. The optimal cut score is identified using the Youden Index J. The results showed that the optimal cut score identified by the evaluation criterion tended to pull the cut score closer to the mode of the proficiency distribution. In addition, depending on the prevalence of the positive event and cost ratio, the optimal cut score shifts accordingly. With the item parameters used to simulate the data and the simulated sample distributions, it was found that when passing the exam is a low-prevalence event in the population, increasing the cut score operationally improves the classification; when passing the exam is a high-prevalence event, then cut score should be reduced to achieve optimality. As the cost ratio increases, the optimal cut score suggested by the evaluation criterion decreases. In three out of the four sample distributions examined in this study, increasing the cut score enhanced the classification, irrespective of the cost ratio when the prevalence in the population is 50%. This study provides statistical evidence when the cut score needs to be refined for policy reasons.

psychology, educational, mathematical,mathematics, interdisciplinary applications
Detecting feigned impairment with the word list recognition of the Wechsler Memory Scale-3rd edition

Vicki L Hacker,Christopher Jones

DOI: https://doi.org/10.1080/02699050902748315

Abstract:Primary objective: To cross-validate the WMS-III Word List Recognition (WLR) sub-test as an embedded symptom validity measure using a simulator validation paradigm. Methods and procedures: Between subjects and cross-sectional correlational designs were employed with 27 traumatic brain injury (TBI), 30 control and 30 analogue malingerer participants. All participants were administered a battery of tests of cognitive functioning. Results: The WLR yielded low-to-high levels of sensitivity (40-73%) and high specificity (95-100%), although there was some evidence to suggest that it is sensitive to severe cognitive impairment. Conclusions: Overall the findings provide preliminary evidence to support the use of the WLR as an embedded symptom validity indicator. These findings, however, require further cross-validation with larger clinical samples in order to assess its ecological validity.
Ten-words recall test: an effective tool to differentiate mild cognitive impairment from subjective cognitive decline

Hua Ren,Qiansen Feng,Lei Chen,Linlin Li,Jiayu Wang,Jiajing Wu,Li Dong,Tiejun Liu,Ziqi Wang

DOI: https://doi.org/10.3389/fpsyt.2024.1429934

IF: 4.7

2024-10-12

Frontiers in Psychiatry

Abstract:Introduction: Subjective cognitive decline (SCD) and mild cognitive impairment (MCI) are stages 2 and 3, respectively, of the Alzheimer's continuum. The Alzheimer's Disease Assessment Scale-Cognitive Subscale (ADAS-cog's) ten-words recall test is a validated method for the early detection of cognitive impairment in Alzheimer's disease. However, limited studies have investigated its ability to differentiate between SCD and MCI. Methods: 203 participants with SCD and 62 participants with MCI underwent multiple neuropsychological assessments. The Mini-Mental State Examination (MMSE) and Montreal Cognitive Assessment-Basic (MOCA-B) served as brief global cognition tests. A binary logistic regression model was used to analyze the potential factors affecting MCI. The accuracy of the ten-words recall test was assessed using the area under the receiver operating characteristic (ROC) and the area under the curve (AUC). Results: The neuropsychological assessment revealed significant differences in the ten-words recall test scores between the SCD (median age 61 years; 70.44% female) and MCI (median age 64 years; 61.29% female) groups ( p < 0.001), with the MCI group scoring the highest. Using a cut-off value of 3.15 for the ten-words recall test, sensitivity for distinguishing MCI from SCD reached 87%, while specificity stood at 61% (AUC 0.777, p < 0.001). DeLong's test indicated no statistically significant difference in the ten-words recall test's ability to distinguish between SCD and MCI compared to the total score of ADAS-Cog (AUC 0.833, p ) and MMSE (AUC 0.784, p > 0.05). However, a significant difference was observed when compared to MoCA-B (AUC 0.973, p < 0.001). In the population with an education level of ≤ 9 years, the optimal cut-off value for the ten-words recall test was 3.15, yielding a sensitivity of 91% and a specificity of 45% (AUC = 0.674, p = 0.030). In the population with an education level > 9 years, the optimal cut-off value was 3.63, resulting in a sensitivity of 79% and a specificity of 71% (AUC = 0.785, p < 0.001). Discussion: The ten-words recall test from the ADAS-cog may detect MCI early owing to its simplicity and quick administration. It is an effective and convenient tool for rapidly identifying mild cognitive impairment.

psychiatry
Multiple Levels of Control Processes for Wisconsin Card Sorts: An Observational Study

Bruno Kopp,Alexander Steinke,Malte Bertram,Thomas Skripuletz,Florian Lange,Kopp,Steinke,Bertram,Skripuletz,Lange

DOI: https://doi.org/10.3390/brainsci9060141

IF: 3.333

2019-06-17

Brain Sciences

Abstract:We explored short-term behavioral plasticity on the Modified Wisconsin Card Sorting Test (M-WCST) by deriving novel error metrics by stratifying traditional set loss and perseverative errors. Separating the rule set and the response set allowed for the measurement of performance across four trial types, crossing rule set (i.e., maintain vs. switch) and response demand (i.e., repeat vs. alternate). Critically, these four trial types can be grouped based on trial-wise feedback on t − 1 trials. Rewarded (correct) maintain t − 1 trials should lead to error enhancement when the response demands shift from repeat to alternate. In contrast, punished (incorrect) t − 1 trials should lead to error suppression when the response demands shift from repeat to alternate. The results supported the error suppression prediction: An error suppression effect (ESE) was observed across numerous patient samples. Exploratory analyses show that the ESE did not share substantial portions of variance with traditional neuropsychological measures of executive functioning. They further point into the direction that striatal or limbic circuit neuropathology may be associated with enhanced ESE. These data suggest that punishment of the recently executed response induces behavioral avoidance, which is detectable as the ESE on the WCST. The assessment of the ESE might provide an index of response-related avoidance learning on the WCST.

neurosciences
On the Clinimetrics of the Montreal Cognitive Assessment: Cutoff Analysis in Patients with Mild Cognitive Impairment due to Alzheimer's Disease

Ciro Rosario Ilardi,Alina Menichelli,Marco Michelutti,Tatiana Cattaruzza,Giovanni Federico,Marco Salvatore,Alessandro Iavarone,Paolo Manganotti

DOI: https://doi.org/10.3233/jad-240339

2024-08-18

Journal of Alzheimer s Disease

Abstract:Background: In the era of disease-modifying therapies, empowering the clinical neuropsychologist's toolkit for timely identification of mild cognitive impairment (MCI) is crucial. Objective: Here we examine the clinimetric properties of the Montreal Cognitive Assessment (MoCA) for the early diagnosis of MCI due to Alzheimer's disease (MCI-AD). Methods: Data from 48 patients with MCI-AD and 47 healthy controls were retrospectively analyzed. Raw MoCA scores were corrected according to the conventional Nasreddine's 1-point correction and demographic adjustments derived from three normative studies. Optimal cutoffs were determined while previously established cutoffs were diagnostically reevaluated. Results: The original Nasreddine's cutoff of 26 and normative cutoffs (non-parametric outer tolerance limit on the 5th percentile of demographically-adjusted score distributions) were overly imbalanced in terms of Sensitivity (Se) and Specificity (Sp). The optimal cutoff for Nasreddine's adjustment showed adequate clinimetric properties (≤23.50, Se = 0.75, Sp = 0.70). However, the optimal cutoff for Santangelo's adjustment (≤22.85, Se = 0.65, Sp = 0.87) proved to be the most effective for both screening and diagnostic purposes according to Larner's metrics. The results of post-probability analyses revealed that an individual testing positive using Santangelo's adjustment combined with a cutoff of 22.85 would have 84% post-test probability of receiving a diagnosis of MCI-AD (LR+ = 5.06). Conclusions: We found a common (mal)practice of bypassing the applicability of normative cutoffs in diagnosis-oriented clinical practice. In this study, we identified optimal cutoffs for MoCA to be allocated in secondary care settings for supporting MCI-AD diagnosis. Methodological and psychometric issues are discussed.

neurosciences
Utility of learning ratio scores from the Consortium to Establish a Registry for Alzheimer's Disease (CERAD) Word List Memory Test in distinguishing patterns of cognitive decline in veterans referred for neuropsychological evaluation

Joseph J. Boscarino,Daniel S. Weitzner,Erin K. Bailey,Joel E. Kamper,Emily N. Vanderbleek

DOI: https://doi.org/10.1080/13854046.2024.2330144

2024-03-19

The Clinical Neuropsychologist

Abstract:Background: The Learning Ratio (LR) is a novel learning score that has shown improved utility over other learning metrics in detecting Alzheimer's disease (AD) across multiple memory tasks. However, its utility on the Consortium to Establish a Registry for Alzheimer's Disease Word List Memory Test (CERAD WLMT), a widely used list learning measure sensitive to decline in neurodegenerative disease, is unknown. The goal of the current study was to determine the utility of LR on the CERAD WLMT in differentiating between diagnostic (MiNCD vs MaNCD) and etiologic groups (VaD vs AD) in a veteran sample. Methods: Raw learning slope (RLS) and LR scores were examined in 168 veterans diagnosed with major neurocognitive disorder (MaNCD), mild neurocognitive disorder (MiNCD), or normal aging following neuropsychological evaluation. Patients with MaNCD were further classified by suspected etiology (i.e. microvascular disease vs AD). Results: Whereas RLS scores were not significantly different between MiNCD and MaNCD, LR scores were significantly different between all diagnostic groups ( p ' s < .05). Those with AD had lower LR scores and RLS scores compared to those with VaD ( p ' s < .05). LR classification accuracy was acceptable for MiNCD (AUC = .76), excellent for MaNCD (AUC = .86) and VaD (AUC = .81), and outstanding for AD (AUC = .91). Optimal cutoff scores for WLMT LR were derived from Youden's index. Conclusion: Results support the use of LR scores over RLS when interpreting the CERAD WLMT and highlight the clinical utility of LR in differentiating between diagnostic groups and identifying suspected etiology.

psychology, clinical,clinical neurology
“Identify-to-reject”: A specific strategy to avoid false memories in the DRM paradigm

Paula Carneiro,Angel Fernandez,Emiliano Diez,Leonel Garcia-Marques,Tânia Ramos,Mário B. Ferreira

DOI: https://doi.org/10.3758/s13421-011-0152-6

2011-10-05

Abstract:Previous research using the Deese–Roediger–McDermott (DRM) paradigm has shown that lists of associates in which the critical words were easily identified as the themes of the lists produce lower levels of false memories in adults. In an attempt to analyze whether this effect is due to the application of a specific memory-editing process (the identify-to-reject strategy), two experiments manipulated variables that are likely to disrupt this strategy either at encoding or at retrieval. In Experiment 1, lists were presented at a very fast presentation rate to reduce the possibility of identifying the missing critical word as the theme of the list, and in Experiment 2, participants were pressed to give yes/no recognition answers within a very short time. The results showed that both of these manipulations disrupted the identifiability effect, indicating that the identify-to-reject strategy and theme identifiability play a major role in the rejection of false memories in the DRM paradigm.

psychology, experimental
On stepdown control of the false discovery proportion

Joseph P. Romano,Azeem M. Shaikh

DOI: https://doi.org/10.1214/074921706000000383

2006-10-27

Abstract:Consider the problem of testing multiple null hypotheses. A classical approach to dealing with the multiplicity problem is to restrict attention to procedures that control the familywise error rate ($FWER$), the probability of even one false rejection. However, if $s$ is large, control of the $FWER$ is so stringent that the ability of a procedure which controls the $FWER$ to detect false null hypotheses is limited. Consequently, it is desirable to consider other measures of error control. We will consider methods based on control of the false discovery proportion ($FDP$) defined by the number of false rejections divided by the total number of rejections (defined to be 0 if there are no rejections). The false discovery rate proposed by Benjamini and Hochberg (1995) controls $E(FDP)$. Here, we construct methods such that, for any $\gamma$ and $\alpha$, $P\{FDP>\gamma \}\le \alpha$. Based on $p$-values of individual tests, we consider stepdown procedures that control the $FDP$, without imposing dependence assumptions on the joint distribution of the $p$-values. A greatly improved version of a method given in Lehmann and Romano \citer10 is derived and generalized to provide a means by which any sequence of nondecreasing constants can be rescaled to ensure control of the $FDP$. We also provide a stepdown procedure that controls the $FDR$ under a dependence assumption.

Statistics Theory
A - 07 Three Brief, Public-Domain Performance-Validity Measures for Concussion Baseline Testing: Normative Performance and Sub-Optimal Cut Scores

A Bankston,R Malkin,A LoGalbo,F Webbe

DOI: https://doi.org/10.1093/arclin/acae052.07

2024-07-06

Archives of Clinical Neuropsychology

Abstract:Abstract Purpose Purpose: We report normative data with non-athlete college students for three brief, public-domain performance validity tests (PVT) representing auditory-verbal memory (Rey Word Recognition Test; RWRT), auditory vigilance; (A-Test), and visual attention (Rey Dot Counting Test; DCT). Cut scores for suboptimal performance (SOP) were determined, and the importance of using multiple PVTs was established. Method Method: 150 non-athlete college students (45% female; representing four college year levels) were recruited via the college’s research participation application and assigned randomly to honest-effort, fake-bad, or instructed fake-bad groups. 50 student-athletes were selected randomly to compare athlete performance with non-athletes. Group differences for PVT measures, and receiver operating curve (ROC) cut scores for suboptimal performance are reported. Results Results: Only the RWRT measures met normality and homogeneity of variance assumptions. MANOVA with post-hoc Tukey tests showed no differences between groups for RWRT. For DCT and A-Test, non-parametric Kruskal-Wallis comparisons were conducted, each resulting in significant differences (all p < 0.001) between honest-effort and SOP groups. No differences were found between the two SOP groups, nor athlete baseline vs honest effort groups, but athletes differed significantly from both SOP groups. ROC cut scores that suggested suboptimal effort were DCT combination score ≥ 15; RWRT combination score ≤ 12; and A-Test omission errors ≥1. Four participants from the honest-effort group and 49 from the fake-bad groups fell below criteria for two tests. Conclusions Conclusion: The DCT combination and A-Test omission scores were valid indicators of suboptimal performance. Combining multiple PVT “failures”maximized identification of suspect performers and minimized inclusion of honest-effort participants.

psychology, clinical
Lower constraint testing enhances the testing effect for some contextual details but not others

Konstadena L. Giannakopoulos,Matthew P. McCurdy,Allison M. Sklenar,Andrea N. Frankenstein,Pauline Urban Levy,Eric D. Leshikar

DOI: https://doi.org/10.1002/brb3.3380

IF: 3.1

2024-01-11

Brain and Behavior

Abstract:Research has shown that testing is an effective strategy for improving memory for previously learned material compared to restudying (i.e., the testing effect or the retrieval practice effect). In this investigation, we examine whether providing less information about target items during a practice test (a lower constraint test) improves item and context memory over a practice test with more information about target items (a higher constraint test). Results showed that the lower constraint practice test led to better memory relative to the higher constraint test, restudy, and control conditions. Overall, we establish a way to increase the magnitude of the testing effect in memory, which may be a way to optimize memory using this well‐known study strategy. Introduction Retrieval practice has been shown to be an effective means of learning new information, a memory phenomenon known as the testing effect or the retrieval practice effect. Some work suggests that the magnitude of the testing effect can be enhanced when the test used for retrieval practice uses fewer cues to retrieve previously studied information. It is unclear, however, whether such testing benefits extend to peripheral contextual details associated with studied materials (e.g., location where stimuli appear, font color in which items are presented, etc.). In this experiment, we examine both item memory (i.e., memory for the studied items) and context memory under conditions where the intervening test offers fewer cues (i.e., lower constraint) compared to more cues (higher constraint) to better understand item and context memory testing effects. Methods Participants first studied word pairs presented in one of eight locations as well as in either red or green font color. Then, in the re‐exposure phase, participants processed materials in two types of intervening tests (lower constraint and a higher constraint test) as well as in a restudy condition, before a final memory test. Results For item memory, results showed that memory was better in the lower constraint testing condition compared to both the higher constraint testing condition as well as the restudy (control) condition. For context memory, results indicated improved memory for location context under lower constraint testing compared to both higher constraint testing and restudy conditions. There was no difference in memory, however, for color context across all conditions. Conclusion Overall, these findings suggest that providing fewer cues to aid retrieval in the intervening test can induce better memory for both items as well as some contextual details.

behavioral sciences,neurosciences
False (or biased) memory: Emotion and working memory capacity effects in the DRM paradigm

Elif Yüvrük,Aycan Kapucu

DOI: https://doi.org/10.3758/s13421-022-01298-y

2022-03-15

Abstract:This study aimed to investigate the role of emotion and working memory capacity (WMC) on false memory by measuring memory sensitivity independently of response bias. We used the Deese-Roediger-McDermott (DRM) paradigm in which arousal levels were kept constant across positive, negative, and neutral word lists associated with unstudied critical lures. Participants' WMC was measured by the Operation Span Task. Although negative critical lures generated significantly more false recognition (i.e., false-alarm rates) compared to positive or neutral ones, Receiver operating characteristic (ROC) analysis based on signal detection theory showed that this effect could be ascribed to shifts in bias rather than actual memory sensitivity. Data revealed that the DRM effect is a robust illusion influenced by neither emotion nor WMC in terms of memory sensitivity. However, negative words led to a prominent increase in liberal bias to say "old" for both critical and noncritical lures. Furthermore, reaction time (RT) data suggested that mentally activated but actually unstudied critical lures were monitored as old words and that participants were faster to accept negative critical lures than positive or neutral ones, suggesting that the DRM illusion was clearly reflected on the RT data as well. These results were discussed emphasizing the role of negative emotion on response bias in recognition memory.

psychology, experimental
Comparison of semantic and phonological false memories in short- and long-term tests

Jennifer Heather Coane,Dawn M McBride,Kai Chang,Yonca Cam,Elizabeth M Marsh,Jennifer H Coane,Elizabeth Marsh

DOI: https://doi.org/10.1177/17470218241231575

IF: 2.138

2024-02-20

Quarterly Journal of Experimental Psychology

Abstract:Quarterly Journal of Experimental Psychology, Ahead of Print. The Deese–Roediger–McDermott (DRM) paradigm has been at the centre of false memory research. Whereas most work with this paradigm has examined memory at the long term and with semantically associated lists, the present study examines phonological and semantic false memories at both short- and long-term delays. In two experiments, participants studied short lists containing six (Experiment 1) or four (Experiment 2) items, either semantically or phonologically related to the same non-studied critical items (CI). Following each list, participants completed 36 trials of an immediate recognition task (short-term memory [STM]-only condition) only or they also completed a surprise recognition test after a 1-min delay after all 36 STM trials (STM + long-term memory [LTM] condition). In STM, false alarms were higher in phonological lists, whereas after the delay, false alarms were higher in semantic lists, reflecting differential sensitivity to the type of association as a function of delay. A third experiment examined LTM performance after controlling for prior testing and yielded highly similar results. Both the activation-monitoring framework (AMF) and fuzzy-trace theory (FTT) can explain the majority of the findings, with some remaining issues. These results confirm that information from the knowledge base (LTM) does influence accuracy in an STM task, albeit less so than perceptual level similarity.

psychology, experimental,physiology
Modern Scores for Traditional Tests - Review of the Diagnostic Potential of Scores Derived from Word List Learning Tests in Mild Cognitive Impairment and Early Alzheimer's Disease

Simona Schäfer,Johannes Tröger,Jutta Kray

DOI: https://doi.org/10.1016/j.neuropsychologia.2024.108908

IF: 3.054

2024-05-13

Neuropsychologia

Abstract:Episodic memory impairments are one of the early hallmarks in Alzheimer's Disease. In the clinical diagnosis and research, episodic memory impairment is typically assessed using word lists that are repeatedly presented to and recalled by the participant across several trials. Until recently, total learning scores, which consist of the total number of words that are recalled by participants, were almost exclusively used for diagnostic purposes. The present review aims at summarizing evidence on additional scores derived from the learning trials which have recently been investigated more frequently regarding their diagnostic potential. These scores reflect item acquisition, error frequencies, strategy use, intertrial fluctuations, and recall consistency. Evidence was summarized regarding the effects of clinical status on these scores. Preclinical, mild cognitive impairment and mild Alzheimer's Disease stages were associated with a pattern of reduced item acquisition, more errors, less strategy use, and reduced access of items, indicating slowed and erroneous encoding. Practical implications and limitations of the present research will be discussed.

behavioral sciences,psychology, experimental,neurosciences
Comparative Study of Discerning Efficacy of Shortened Neuropsychological Tests on Mild Cognitive Impairment

Qi-hao GUO,Qian-hua ZHAO,Yan ZHOU,Ding DING,Zhen HONG

DOI: https://doi.org/10.3969/j.issn.1672-6731.2010.03.014

2010-01-01

Abstract:Objective To assess the efficacy of shortened neuropsychological tests for discernment of mild cognitive impairment (MCI) by comparing 3 shortened tests [Animal Fluency Test (AFT), Color Trail Test (CTT) B and Bells Test (BT)], and to provide information for developing brief cognitive screening tool. Methods One hundred and twenty MCI patients and 180 cognitive normal controls (NC) were assessed by a set of standardized comprehensive neuropsychological evaluation including Mini⁃Mental State Examination (MMSE), Auditory Verbal Learning Test (AVLT), Logical Memory Test (LM), Rey⁃Osterrieth Complex Figure Test (ROCFT), Clock Drawing Test (CDT), AFT, Boston Naming Test (BNT), Cancellation Test (CT), Digit Span Test (DS), Stroop Color ⁃ Word Test (CWT), CTT A and B, Similarity Test, BT, Clinical Dementia Rating Scale (CDR), Activities of Daily Living Scale (ADL), Self ⁃ Rating Depression Scale (SDS) and Geriatric Depression Scale (GDS). Results 1) AFT: the greatest difference was seen between MCI (12.65 ± 2.83) and NC (14.93 ± 2.49) in 45 s fluency test version (t = 7.315, P = 0.000). 2) CTT: there was significant difference between MCI (9.28 ± 3.53) and NC (13.43 ± 4.12) in terms of 1 min CTT version (t = 9.356, P = 0.000), and in which the differential efficacy nearly approached the full length version. 3) BT: there were significant differences between MCI and NC groups in all 4 scores including accuracy score, time, post⁃ advising accuracy score and total time (t = 4.164, 3.427, 3.616, 5.102, respectively; P = 0.000, for all). The average time for recancellation was 100 s. However, discerning efficacy was not obviously improved after recancellation. Conclusion Appropriately shortened version of Animal Fluency Test, Color Trail Test and Bells Test prensents the same discerning efficacy for MCI as the original versions. It is feasible for MCI screening. DOI：10.3969/j.issn.1672-6731.2010.03.014
Optimal cutoff scores of the Montreal Cognitive Assessment to detect mild cognitive impairment and dementia in Costa Rican older adults

Carolina Boza-Calvo,Jose Pablo Ulate-Aguilar,Shirley Rojas-Salazar,Norbel Roman-Garita,Arjun V. Masurkar

DOI: https://doi.org/10.1080/13803395.2024.2411355

2024-10-11

Journal of Clinical and Experimental Neuropsychology

Abstract:Background The burden of Alzheimer's disease and related dementias (AD/ADRD) in Costa Rica is expected to become one of the highest in the region. Early detection will help optimize resources and improve primary care interventions. The Montreal Cognitive Assessment (MoCA) has shown good sensitivity for detecting mild cognitive impairment (MCI), but specificity varies depending on the population. This motivated the analysis of different cutoffs to minimize false-positive classifications in a Costa Rican sample for its use in clinical settings.

psychology, clinical,clinical neurology

Lowered cutoffs to reduce false positives on the Word Memory Test

Further Consideration of Advanced Clinical Solutions Word Choice: Comparison to the Recognition Memory Test-Words and Classification Accuracy in a Clinical Sample

Optimizing Cognitive Assessment Outcome Measures for Alzheimer's Disease by Matching Wordlist Memory Test Features to Scoring Methodology

That old dog can still hunt—Alternative cutoffs and the recognition trial improve the classification accuracy of the Rey 15-Item Test.

The classification accuracy of Warrington's recognition memory test (words) as a performance validity Test in a neurorehabilitation setting

Cognitive components of aging-related increase in word-finding difficulty

Using ROC Analysis to Refine Cut Scores Following a Standard Setting Process

Detecting feigned impairment with the word list recognition of the Wechsler Memory Scale-3rd edition

Ten-words recall test: an effective tool to differentiate mild cognitive impairment from subjective cognitive decline

Multiple Levels of Control Processes for Wisconsin Card Sorts: An Observational Study

On the Clinimetrics of the Montreal Cognitive Assessment: Cutoff Analysis in Patients with Mild Cognitive Impairment due to Alzheimer's Disease

Utility of learning ratio scores from the Consortium to Establish a Registry for Alzheimer's Disease (CERAD) Word List Memory Test in distinguishing patterns of cognitive decline in veterans referred for neuropsychological evaluation

“Identify-to-reject”: A specific strategy to avoid false memories in the DRM paradigm

On stepdown control of the false discovery proportion

A - 07 Three Brief, Public-Domain Performance-Validity Measures for Concussion Baseline Testing: Normative Performance and Sub-Optimal Cut Scores

Lower constraint testing enhances the testing effect for some contextual details but not others

False (or biased) memory: Emotion and working memory capacity effects in the DRM paradigm

Comparison of semantic and phonological false memories in short- and long-term tests

Modern Scores for Traditional Tests - Review of the Diagnostic Potential of Scores Derived from Word List Learning Tests in Mild Cognitive Impairment and Early Alzheimer's Disease

Comparative Study of Discerning Efficacy of Shortened Neuropsychological Tests on Mild Cognitive Impairment

Optimal cutoff scores of the Montreal Cognitive Assessment to detect mild cognitive impairment and dementia in Costa Rican older adults