Patient-Reported Outcomes Measurement Information System (PROMIS) Instruments: Reliability and Validity in Veterans Following Orthopedic Surgery

Katherine Hadlandsmyth,Lilian N. Dindo,Barbara J. St. Marie,Roohina Wajid,Jennie L. Embree,Nicolas O. Noiseux,Toni Tripp-Reimer,M. Bridget Zimmerman,Barbara A. Rakel
DOI: https://doi.org/10.1177/0163278719856406
2019-06-13
Abstract:The patient-reported outcomes measurement information system (PROMIS) offers standardized assessment measures of clinically relevant patient-reported outcomes. This study evaluated the reliability and validity of select PROMIS measures with U.S. military veterans following orthopedic surgery. Data for the current study were collected as part of a pilot randomized control trial assessing the efficacy of a 1-day Acceptance and Commitment Therapy workshop on persistent postsurgical pain in at-risk veterans undergoing orthopedic surgery. Sixty-seven participants completed surveys 3 months after surgery. Participants completed the following PROMIS instruments: PROMIS Anxiety Short Form 8a, PROMIS Depression Short Form 8b, and PROMIS Pain Interference Short Form 8a. PROMIS measures were compared to the Generalized Anxiety Disorder 7-Item Scale, the Patient Health Questionnaire 9-Item Scale, and the Brief Pain Inventory Pain Interference subscale, respectively. All three PROMIS measures demonstrated excellent internal consistency (Cronbach’s αs ranged from .93 to .96) and each loaded onto a single factor. The PROMIS measures were moderately correlated with their respective comparison measures ( r = .69 to .76). The PROMIS anxiety and PROMIS depression measures were highly correlated to one another ( r = .91). Findings highlight the potential utility of these PROMIS measures in veterans following orthopedic surgery and the overlap between the PROMIS depression and anxiety measures in this sample.
health care sciences & services,health policy & services
What problem does this paper attempt to address?
### Problems the Paper Attempts to Solve This paper aims to validate the reliability and validity of the Patient-Reported Outcomes Measurement Information System (PROMIS) tools in veterans 3 months after undergoing orthopedic surgery. Specifically, the study evaluates the internal consistency and structural validity of the PROMIS Anxiety Short Form, PROMIS Depression Short Form, and PROMIS Pain Interference Short Form in this specific population and compares them with established scales such as GAD-7, PHQ-9, and the Pain Interference subscale of the Brief Pain Inventory. ### Background 1. **PROMIS Tools**: PROMIS is a set of standardized self-report assessment tools developed by the National Institutes of Health (NIH) to measure patient-reported outcomes across various psychological, physical, and social domains. 2. **Characteristics of Veterans**: Veterans may represent a unique medical group in healthcare settings, with higher risks of depression and anxiety, and chronic pain being prevalent among veterans. 3. **Pain, Depression, and Anxiety Post-Orthopedic Surgery**: Increasing evidence suggests that pain, depression, and anxiety can affect the outcomes of orthopedic surgery. Therefore, consistent measurement of these variables during the perioperative period is crucial. ### Study Objectives 1. **Validate Reliability**: Assess the internal consistency of the PROMIS Anxiety, Depression, and Pain Interference Short Forms in veterans. 2. **Validate Validity**: Evaluate the structural and convergent validity of the PROMIS tools by comparing them with established scales. 3. **Explore Overlap**: Investigate the overlap between the PROMIS Depression and Anxiety scales and their relationship with other related scales. ### Methods 1. **Study Design**: Data collection was from a randomized controlled trial evaluating the effectiveness of a 1-day Acceptance and Commitment Therapy workshop on persistent pain post-surgery in high-risk orthopedic patients. 2. **Participants**: 67 veterans completed the questionnaires 3 months post-surgery. 3. **Measurement Tools**: - **PROMIS Anxiety Short Form**: Assesses fear, anxiety, hypervigilance, and somatic symptoms related to vigilance. - **PROMIS Depression Short Form**: Assesses negative mood, self-view, social cognition, and decreased positive affect or engagement. - **PROMIS Pain Interference Short Form**: Assesses the impact of pain on daily activities, social, emotional, physical, and recreational activities. 4. **Comparison Tools**: - **GAD-7**: Assesses generalized anxiety. - **PHQ-9**: Assesses depressive symptoms. - **Pain Interference subscale of the Brief Pain Inventory**: Assesses the interference of pain with general activity, mood, physical activity, interpersonal relationships, and sleep. ### Results 1. **Sample Description**: Participants were primarily male (93%), with an average age of 63.7 years. Most participants were married (57%), white (85%), had undergone total knee replacement (67%), were not currently taking opioids (69%), and had an annual income below $40,000 (56%). 2. **Internal Consistency**: All PROMIS scales demonstrated good internal consistency, with Cronbach’s α values of 0.93 (Anxiety), 0.95 (Depression), and 0.96 (Pain Interference). 3. **Structural Validity**: Factor analysis indicated that each PROMIS scale primarily measured a single construct. 4. **Convergent Validity**: The correlation coefficient between the PROMIS Anxiety scale and GAD-7 was 0.69, between the PROMIS Depression scale and PHQ-9 was 0.69, and between the PROMIS Pain Interference scale and the Pain Interference subscale of the Brief Pain Inventory was 0.76. 5. **Discriminant Validity**: The PROMIS Depression and Anxiety scales were highly correlated (r=0.91), suggesting that these two scales may largely measure the same underlying construct—distress—in this sample. ### Discussion 1. **Preliminary Validity**: The study's results preliminarily validate the effectiveness of the PROMIS Anxiety, Depression, and Pain Interference Short Forms in veterans 3 months post-orthopedic surgery. 2. **Overlap**: The high correlation between the PROMIS Depression and Anxiety scales suggests that they may, to some extent, measure the same construct.