Abstract:The increasing availability of longitudinal student achievement data has heightened interest among researchers, educators and policy makers in using these data to evaluate educational inputs, as well as for school and possibly teacher accountability. Researchers have developed elaborate "value-added models" of these longitudinal data to estimate the effects of educational inputs (e.g., teachers or schools) on student achievement while using prior achievement to adjust for nonrandom assignment of students to schools and classes. A challenge to such modeling efforts is the extensive numbers of students with incomplete records and the tendency for those students to be lower achieving. These conditions create the potential for results to be sensitive to violations of the assumption that data are missing at random, which is commonly used when estimating model parameters. The current study extends recent value-added modeling approaches for longitudinal student achievement data Lockwood et al. [J. Educ. Behav. Statist. 32 (2007) 125--150] to allow data to be missing not at random via random effects selection and pattern mixture models, and applies those methods to data from a large urban school district to estimate effects of elementary school mathematics teachers. We find that allowing the data to be missing not at random has little impact on estimated teacher effects. The robustness of estimated teacher effects to the missing data assumptions appears to result from both the relatively small impact of model specification on estimated student effects compared with the large variability in teacher effects and the downweighting of scores from students with incomplete data.

Stability of Teacher Value-Added Rankings Across Measurement Model and Scaling Conditions

The Sensitivity of Value-Added Modeling to the Creation of a Vertical Score Scale

A Correlated Random Effects Model for Nonignorable Missing Data in Value-Added Assessment of Teacher Effects

Value-Added Modeling and Educational Accountability

School value-added models for multivariate academic and non-academic outcomes: A more rounded approach to using student data to inform school accountability

Teacher Value-Added at the High-School Level

Missing data in value-added modeling of teacher effects

A Potential Outcomes View of Value-Added Assessment in Education

A comparison of value-added models for school accountability

The stability of kindergarten teachers’ effectiveness: A generalizability study comparing the Framework For Teaching and the Classroom Assessment Scoring System

Rethinking principal effects on student outcomes

An Evaluation of Empirical Bayes’s Estimation of Value-Added Teacher Performance Measures

Accounting for Student Disadvantage in Value-Added Models

Teacher-Level Value-Added Models on Trial: Empirical and Pragmatic Issues of Concern Across Five Court Cases

Temporally Dynamic, Cohort-Varying Value-Added Models

Accounting for Co-Teaching: A Guide for Policymakers and Developers of Value-Added Models

The Effect of the Prior Teacher on Value-Added

Measurement Models, Estimation, and the Study of Change

Teacher perceptions of a new performance evaluation system and their influence on practice: A within- and between-school level analysis

Teacher and Classroom Context Effects on Student Achievement: Implications for Teacher Evaluation

Assessment of School Performance Through a Multilevel Latent Markov Rasch Model