An Evaluation of Empirical Bayes’s Estimation of Value-Added Teacher Performance Measures

Cassandra M. Guarino,Michelle Maxfield,Mark D. Reckase,Paul N. Thompson,Jeffrey M. Wooldridge
DOI: https://doi.org/10.3102/1076998615574771
2015-04-01
Journal of Educational and Behavioral Statistics
Abstract:Empirical Bayes’s (EB) estimation has become a popular procedure used to calculate teacher value added, often as a way to make imprecise estimates more reliable. In this article, we review the theory of EB estimation and use simulated and real student achievement data to study the ability of EB estimators to properly rank teachers. We compare the performance of EB estimators with that of other widely used value-added estimators under different teacher assignment scenarios. We find that, although EB estimators generally perform well under random assignment (RA) of teachers to classrooms, their performance suffers under nonrandom teacher assignment. Under non-RA, estimators that explicitly (if imperfectly) control for the teacher assignment mechanism perform the best out of all the estimators we examine. We also find that shrinking the estimates, as in EB estimation, does not itself substantially boost performance.
education & educational research,psychology, mathematical,social sciences, mathematical methods
What problem does this paper attempt to address?