Abstract:Previous research provides evidence that ratings from students and external observers can deliver reliable and valid measures of teaching quality. However, there is still a lack of research on how stable these measures are across time and classes, which is particularly important when they are used for evaluations. We addressed this issue in 3 different studies from Germany. Study 1 examined stability over time using a longitudinal sample of 174 teachers and 106 classes. The results show that student ratings of teaching quality are relatively stable when the same class rates the same teacher in 2 subsequent school years. However, we also found teacher-independent stabilities, which occurred when the same students rated different teachers. Study 2 examined stabilities in student ratings across classes. In this study, each teacher (N = 95) was evaluated by 2 different classes (N = 190). The results of a 3-level model reveal rather low stabilities across classes within teachers. Study 3 drew on a unique dataset in which 1 single teacher taught the same content to 30 different classes of the same grade level. Teaching quality as rated by students and external observers varied considerably between these classes. Differences in teaching quality were related to student learning, and the motivation of students in a class was a significant predictor of differences in teaching quality. In summary, the results of these studies show that both researchers and policymakers should be cautious when interpreting measures of teaching quality as indicators of teacher quality.

Validity of students' evaluations of college teaching: A multitrait–multimethod analysis.

Validity of student evaluations of instructional effectiveness: A comparison of faculty self-evaluations and evaluations by their students.

Validity of students' evaluations of teaching effectiveness: Cognitive and affective criteria.

Students' evaluations of university teaching: Dimensionality, reliability, validity, potential baises, and utility.

The multidimensionality of students' evaluations of teaching effectiveness: The generality of factor structures across academic discipline, instructor level, and course level

Student Ratings of College Teaching: Reliability, Validity, and Usefulness

Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility.

Students' evaluations of university teaching: Research findings, methodological issues, and directions for future research

Multidimensional ratings of teaching effectiveness by students from different academic settings and their relation to student/course/instructor characteristics.

The influence of student, course, and instructor characteristics in evaluations of university teaching

Validity and usefulness of student evaluations of instructional quality.

Students’ evaluations of university teaching: Dimensionality, reliability, validity, potential biases and usefulness

The validity of students’ evaluations: Classroom evaluations of instructors independently nominated as best and worst teachers by graduating seniors

Class size, students’ evaluations, and instructional effectiveness

Multidimensional students' evaluations of teaching effectiveness: A profile analysis

Three Foci of Mathematic Teachers' Considerations in Evaluation of School Students' Achievements

SEEQ: A RELIABLE, VALID, AND USEFUL INSTRUMENT FOR COLLECTING STUDENTS'EVALUATIONS OF UNIVERSITY TEACHING

Do university teachers become more effective with experience? A multilevel growth model of students' evaluations of teaching over 13 years.

The student evaluation of teaching and the competence of students as evaluators

Multidimensional students' evaluations of teaching effectiveness: A test of alternative higher-order structures.

Don’t blame the teacher? The need to account for classroom characteristics in evaluations of teaching quality.