Abstract:The validity of organizational research relies on strong research methods, which include effective measurement of psychological constructs. The general consensus is that multiple item measures have better psychometric properties than single-item measures. However, due to practical constraints (e.g., survey length, respondent burden) there are situations in which certain single items may be useful for capturing information about constructs that might otherwise go unmeasured. We evaluated 37 items, including 18 newly developed items as well as 19 single items selected from existing multiple-item scales based on psychometric characteristics, to assess 18 constructs frequently measured in organizational and occupational health psychology research. We examined evidence of reliability; convergent, discriminant, and content validity assessments; and test-retest reliabilities at 1- and 3-month time lags for single-item measures using a multistage and multisource validation strategy across 3 studies, including data from N = 17 occupational health subject matter experts and N = 1,634 survey respondents across 2 samples. Items selected from existing scales generally demonstrated better internal consistency reliability and convergent validity, whereas these particular new items generally had higher levels of content validity. We offer recommendations regarding when use of single items may be more or less appropriate, as well as 11 items that seem acceptable, 14 items with mixed results that might be used with caution due to mixed results, and 12 items we do not recommend using as single-item measures. Although multiple-item measures are preferable from a psychometric standpoint, in some circumstances single-item measures can provide useful information.

What problem does this paper attempt to address?

### What problems does this paper attempt to solve? This paper aims to explore the application and effectiveness of single - item measures in organizational research. Specifically, the researchers hope to evaluate whether single - item measures can effectively assess psychological constructs in certain situations and provide specific suggestions for future research. #### Main problems include: 1. **Reliability and Validity of Single - Item Measures**: - The paper focuses on whether single - item measures can reliably and effectively assess psychological constructs, especially in research in areas such as work - family conflict and balance. - The researchers evaluated 37 single - item measures, including 18 newly developed items and 19 items selected from existing scales, to assess 18 common organizational and occupational health psychology constructs. 2. **Comparison between Multi - Item Scales and Single - Item Measures**: - Although multi - item scales usually have better psychometric properties, in practical research, single - item measures are sometimes more practical due to factors such as survey length and respondent burden. - The researchers hope to find out which single - item measures can be effective alternatives by comparing newly developed single - item measures and single - item measures selected from multi - item scales. 3. **Psychometric Properties of Single - Item Measures**: - The researchers evaluated the reliability, convergent validity, discriminant validity, and content validity of single - item measures, and also carried out an assessment of test - retest reliability. - A multi - level, multi - source validation strategy was used, and data were collected through three research phases, including data from occupational health experts and survey respondents from two samples. 4. **Application Scenarios of Single - Item Measures**: - The researchers provided suggestions on when it is more appropriate or inappropriate to use single - item measures. - 11 acceptable single - item measures, 14 single - item measures with mixed results that need to be used with caution, and 12 single - item measures not recommended for use were recommended. #### Conclusions and Recommendations: Although multi - item scales are superior from a psychometric perspective, in some cases, strictly developed single - item measures can provide useful information. The researchers hope that through this research, they can provide guidance for future organizational and occupational health psychology research, enabling researchers to rationally use single - item measures in specific situations, thereby reducing respondent burden and increasing response rates. In summary, the problem that this paper attempts to solve is: **How to rationally use single - item measures to assess psychological constructs under the premise of ensuring effectiveness, especially in cases of limited resources or the need to simplify surveys**.

Developing and investigating the use of single-item measures in organizational research.

Normalizing the Use of Single-Item Measures: Validation of the Single-Item Compendium for Organizational Psychology

Single-Item Versus Multiple-Item Measurement Scales: An Empirical Comparison

Examining the Concurrent and Predictive Validity of Single Items in Ecological Momentary Assessments

Psychometric Evaluation of Single-Item Relationship Satisfaction, Love, Conflict, and Commitment Measures

Undergraduates' workplace learning in health sciences education: psychometric properties of single-item measures

Appropriate use of single-item measures is here to stay

Assessing Autonomy, Competence, and Relatedness Briefly

Less Evaluative Measures of Personality in Job Applicant Contexts: The Effect on Socially Desirable Responding and Criterion Validity

Development and validation of the SDR-O: A new measure of socially desirable responding in organizations

Reliability and validity testing of a single-item physical activity measure

Pragmatic adaptation of implementation research measures for a novel context and multiple professional roles: a factor analysis study

Are Biasing Factors Idiosyncratic to Measures? A Comparison of Interpersonal Conflict, Organizational Constraints, and Workload

The Social Media Use Scale: Development and Validation

Short and sweet: Comparing strategies for the reduction of questionnaires on self‐criticism and social safeness while preserving construct validity

Testing the ruler with item response theory: Increasing precision of measurement for relationship satisfaction with the Couples Satisfaction Index.

The development of a single item FoMO (Fear of Missing Out) scale

Can—and should—automaticity be self‐reported using a single item? A secondary analysis of 16 datasets

When better is the enemy of good: two cautionary tales of conceptual validity versus parsimony in clinical psychometric research

Psychometric assessment of three newly developed implementation outcome measures

The Effects of Questionnaire Length on the Relative Impact of Response Styles in Ambulatory Assessment