Abstract:In the UK, US and elsewhere, school accountability systems increasingly compare schools using value-added measures of school performance derived from pupil scores in high-stakes standardised tests. Rather than naively comparing school average scores, which largely reflect school intake differences in prior attainment, these measures attempt to compare the average progress or improvement pupils make during a year or phase of schooling. Schools, however, also differ in terms of their pupil demographic and socioeconomic characteristics and these also predict why some schools subsequently score higher than others. Many therefore argue that value-added measures unadjusted for pupil background are biased in favour of schools with more 'educationally advantaged' intakes. But, others worry that adjusting for pupil background entrenches socioeconomic inequities and excuses low performing schools. In this article we explore these theoretical arguments and their practical importance in the context of the 'Progress 8' secondary school accountability system in England which has chosen to ignore pupil background. We reveal how the reported low or high performance of many schools changes dramatically once adjustments are made for pupil background and these changes also affect the reported differential performances of region and of different school types. We conclude that accountability systems which choose to ignore pupil background are likely to reward and punish the wrong schools and this will likely have detrimental effects on pupil learning. These findings, especially when coupled with more general concerns surrounding high-stakes testing and school value-added models, raise serious doubts about their use in school accountability systems.

The Sensitivity of Value-Added Modeling to the Creation of a Vertical Score Scale

A Correlated Random Effects Model for Nonignorable Missing Data in Value-Added Assessment of Teacher Effects

Missing data in value-added modeling of teacher effects

School value-added models for multivariate academic and non-academic outcomes: A more rounded approach to using student data to inform school accountability

Teacher Value-Added at the High-School Level

A comparison of value-added models for school accountability

Measurement Models, Estimation, and the Study of Change

Temporally Dynamic, Cohort-Varying Value-Added Models

Value-Added Modeling and Educational Accountability

Reducing Attenuation Bias in Regression Analyses Involving Rating Scale Data via Psychometric Modeling

Accounting for Student Disadvantage in Value-Added Models

A Potential Outcomes View of Value-Added Assessment in Education

Teacher-Level Value-Added Models on Trial: Empirical and Pragmatic Issues of Concern Across Five Court Cases

Modeling Item-Level Heterogeneous Treatment Effects With the Explanatory Item Response Model: Leveraging Large-Scale Online Assessments to Pinpoint the Impact of Educational Interventions

Should we adjust for pupil background in school value-added models? A study of Progress 8 and school accountability in England

Assessment of School Performance Through a Multilevel Latent Markov Rasch Model

Multidimensional item response theory models for testlet-based doubly bounded data

Modeling construct change over time amidst potential changes in construct measurement: A longitudinal moderated factor analysis approach

An Evaluation of Empirical Bayes’s Estimation of Value-Added Teacher Performance Measures

Principal goals at school: evaluating construct validity and response scaling format

Testing the feasibility of a value‐added model of school quality in a low‐income country