Abstract:In the UK, US and elsewhere, school accountability systems increasingly compare schools using value-added measures of school performance derived from pupil scores in high-stakes standardised tests. Rather than naively comparing school average scores, which largely reflect school intake differences in prior attainment, these measures attempt to compare the average progress or improvement pupils make during a year or phase of schooling. Schools, however, also differ in terms of their pupil demographic and socioeconomic characteristics and these also predict why some schools subsequently score higher than others. Many therefore argue that value-added measures unadjusted for pupil background are biased in favour of schools with more 'educationally advantaged' intakes. But, others worry that adjusting for pupil background entrenches socioeconomic inequities and excuses low performing schools. In this article we explore these theoretical arguments and their practical importance in the context of the 'Progress 8' secondary school accountability system in England which has chosen to ignore pupil background. We reveal how the reported low or high performance of many schools changes dramatically once adjustments are made for pupil background and these changes also affect the reported differential performances of region and of different school types. We conclude that accountability systems which choose to ignore pupil background are likely to reward and punish the wrong schools and this will likely have detrimental effects on pupil learning. These findings, especially when coupled with more general concerns surrounding high-stakes testing and school value-added models, raise serious doubts about their use in school accountability systems.

Student Assessment Opt Out and the Impact on Value-Added Measures of Teacher Quality

Missing data in value-added modeling of teacher effects

Opting Out as an Untapped Resource in Instructional Design: Review and Implications

Uncertainty in Rank Estimation: Implications for Value-Added Modeling Accountability Systems

Value-Added Modeling and Educational Accountability

A Correlated Random Effects Model for Nonignorable Missing Data in Value-Added Assessment of Teacher Effects

School value-added models for multivariate academic and non-academic outcomes: A more rounded approach to using student data to inform school accountability

Grading Teacher Performance Appraisal Systems: Understanding the Implications of Student Test Scores and Performance Information Use

Accounting for Student Disadvantage in Value-Added Models

Models for Value-Added Modeling of Teacher Effects

The Causal Effect of Student Mobility on Standardized Test Performance: A Case Study with Possible Implications for Accountability Mandates within the Elementary and Secondary Education Act

A comparison of value-added models for school accountability

Value-Added Models for Teacher Preparation Programs: Validity and Reliability Threats, and a Manageable Alternative

Stability of Teacher Value-Added Rankings Across Measurement Model and Scaling Conditions

Should we adjust for pupil background in school value-added models? A study of Progress 8 and school accountability in England

Opt-out testing for stigmatized diseases: A social psychological approach to understanding the potential effect of recommendations for routine HIV testing.

Teacher-Level Value-Added Models on Trial: Empirical and Pragmatic Issues of Concern Across Five Court Cases

The Sensitivity of Value-Added Modeling to the Creation of a Vertical Score Scale

Stakes Matter: Student Motivation and the Validity of Student Assessments for Teacher Evaluation

A Potential Outcomes View of Value-Added Assessment in Education

Choosing to learn: The importance of student autonomy in higher education