Abstract:Recent developments in the philosophy of validity, highlighting the importance of investigating the consequences of assessment use, provide theoretical support for the move toward performance assessment. The problem for validity researchers is finding the appropriate set of criteria and standards to simultaneously support the validity of an assessment-based interpretation and the validity of its impact on the educational system. My intent is to provide an integrative and critical review of the guidance available for conducting validity inquiry in the context of performance assessment. In the first section is a summary of the emerging consensus among measurement scholars—not reflected in the 1985 Standards for Educational and Psychological Testing (American Educational Research Association [AERA], American Psychological Association [APA], & National Council on Measurement in Education [NCME])—about the centrality of construct validity to the evaluation of any assessment-based interpretation and about the importance of expanding the concept of validity to include explicit consideration of the consequences of assessment use. The description of this emerging consensus suggests general epistemological principles for validity inquiry. In the second section is a description and synthesis of various categories of questions, evidence, or criteria that have been used to describe or guide validity inquiry, either for assessment in general or for performance assessment in particular. These analytic schemes, like the traditional construct-content-criterion categories, highlight specific issues that their authors consider important for validity researchers to address. Each balances technical concerns about such issues as reliability, generalizability, and comparability with concerns about the consequences of assessment. In the final section is an overview of concerns, expressed largely by interpretive researchers, about validity criteria that privilege standardized forms of assessment, whether performance-based or multiple-choice. These arguments suggest the importance of further expanding the conception of validity inquiry to treat as problematic the epistemological principles used to warrant validity conclusions.

The New Understanding of Validity Concept

Discussion on Validity of Empirical Study in Research Field of Entrepreneurship

A Review on Validity Generalization

Primacy of theory? Exploring perspectives on validity in conceptual psychometrics

Shifting Conceptions of Validity in Educational Measurement: Implications for Performance Assessment

A Study on the Predictive Validity of Self-concept for Subjective Well-being with the Approach of Implicit Social Cognition

Constructing Validity of SCL 90 Applied to Chinese Non-Clinical Population

The Validity Issue in Mixed Research

How do validity experts conceptualise argumentation? It's a rhetorical question

Validity in the Next Era of Assessment: Consequences, Social Impact, and Equity

Validation Frameworks and Methods

Relativists at 30,000 Feet——On the Compatibility Between Relativism and the Validity of Science

The 3-Dimension Construction of Classroom Assessment Knowledge and Its Implications in the Transformation of Knowledge Theory

Standards of Validity and the Validity of Standards in Behavioral Software Engineering Research: The Perspective of Psychological Test Theory

Constructing arguments for the interpretation and use of patient-reported outcome measures in research: an application of modern validity theory

Cultural validity: Promoting cultural responsiveness in classroom assessment

Contemporary Test Validity in Theory and Practice: A Primer for Discipline-Based Education Researchers

A contemporary approach to validity arguments: a practical guide to Kane's framework

Three Elements of Urban Design and Their Validity on Implementation

The validation of regulatory test methods - Conceptual, ethical, and philosophical foundations

The Logic and Theoretical Perspective Underlying Diversification Measures: An Examination of Content Validity