Abstract:This study uses a new method to summarize diagnostic validity information to explore which constructs are captured by malingering tests. The Test Validation Summary applies mixed-groups validation to investigate the meaning of test constructs and to estimate test classification characteristics when test validation groups are not "pure" criterion groups (ie, "compliant" vs "malingering"), but members have variable probability of malingering. The method permits the use of tests with relatively low validity to validate tests of greater validity. In our initial analysis, we argue that the Rey 15-Item Memory Test is best construed as an "intention test" (capturing the intention of testtakers when taking a test) as opposed to an "effort test." Using the Test Validation Summary and mixed-groups validation, we demonstrate that as an indicator of "intention to feign cognitive impairment," the Rey 15-Item Memory Test has estimated false-positive rate (FPR) = 0.02 and true-positive rate (TPR) = 0.57. We then explore the meaning of failure on the Word Memory Test (WMT), which uses a dichotomous classification of performance as valid or invalid. Although the WMT is commonly referred to as an "effort test," we argue that it likely captures both "intention" and "effort" but collapses this information into a single dichotomous classification of symptom validity. We demonstrate that, as a result of this dichotomous classification process, the WMT likely has a problematic FPR. In our analysis of previously published WMT data, the WMT FPR is estimated at 0.12 when there is no predisposition to perform poorly but rises dramatically and unrealistically as the predisposition to perform poorly increases. We compare these findings to those of the Validity Indicator Profile (VIP), which captures both intent and effort to classify 4 different sorts of response styles in cognitive testing. In our analyses, the VIP demonstrates that FPR = 0 and TPR = 0.86 when the construct being measured is "intent to perform poorly," and reveals that FPR = 0.06 and TPR = 0.63 when the construct being measured is "inconsistent responding" or "poor effort." We were able to demonstrate for the VIP the same "oversensitivity" shown by the WMT when the VIP was interpreted only as a dichotomous classification test. These results indicate that researchers who attempt to generate classification characteristics for malingering tests must carefully consider what constructs are being captured by the test.

Developing a Symptom Validity Test for Posttraumatic Stress Disorder: Application of the binomial distribution

Exploration of PCL-5 symptom validity indices for detection of exaggerated and feigned PTSD

Evaluating constructs represented by symptom validity tests in forensic neuropsychological assessment of traumatic brain injury

Assessing Negative Response Bias Using Self-Report Measures: New Articles, New Issues

The Importance of the Morel Emotional Numbing Test Instructions: A Diagnosis Threat Induction Study

What are the chances? – Validity assessment and the cumulative binomial distribution in the evaluation of fitness to stand trial

The two-factorial symptom structure of post-traumatic stress disorder: depression-avoidance and arousal-anxiety.

Detecting Negative Response Bias Within the Trauma Symptom Inventory–2 (TSI-2): a Review of the Literature

A Strategy for the Development of Biomarker Tests for PTSD

Self-reported neurobehavioral symptoms in combat veterans: An examination of NSI with mBIAS symptom validity scales and potential effects of psychological distress.

A validation study of the International Trauma Questionnaire to assess post-traumatic stress disorder in treatment-seeking veterans

Sex differences in DSM-IV posttraumatic stress disorder symptoms expression using item response theory: A population-based study

Malingering assessment after severe traumatic brain injury in forensic psychology with a potential embedded symptom validity indicator of Symptom Checklist 90

Partial Posttraumatic Stress Disorder Revisited

[Detection of Malingering Post-Traumatic Stress Disorder].

Bayesian PTSD-Trajectory Analysis with Informed Priors Based on a Systematic Literature Search and Expert Elicitation

Utility of the mild brain injury atypical symptoms scale as a screening measure for symptom over-reporting in operation enduring freedom/operation iraqi freedom service members with post-concussive complaints

A validated predictive algorithm of post-traumatic stress course following emergency department admission after a traumatic stressor

Cross-Validation of Supplemental Test of Memory Malingering Scores as Performance Validity Measures

Multi-omic biomarker identification and validation for diagnosing warzone-related post-traumatic stress disorder

Multisample cross-validation of a model of childhood posttraumatic stress disorder symptomatology