Abstract:Evaluating quality of teaching is important in nearly every higher education institute. The most common way of assessing teaching effectiveness takes place through students. Student Evaluation of Teaching (SET) is used to gather information about students’ experiences with a course and instructor’s performance at some point of semester. SET can be considered as a type of rater mediated performance assessment where students are the raters and instructors are the examinees. When performance assessment becomes a rater mediated assessment process, extra measures need to be taken into consideration in order to create more reliable and fair assessment practices. The study has two main purposes; (a) to examine the extent to which the facets (instructor, student, and rating items) contribute to instructors’ score variance and (b) to examine the students’ judging behavior in order to detect any potential source of bias in student evaluation of teaching by using the Many-Facet Rasch Model. The data set includes one thousand 235 students’ responses from 254 courses. The results show that a) students greatly differ in the severity while rating instructors, b) students were fairly consistent in their ratings, c) students as a group and individual level are tend to display halo effect in their ratings, d) students are clustered at the highest two categories of the scale and e) the variation in item measures is fairly low. The findings have practical implications for the SET practices by improving the psychometric quality of measurement.

Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility.

Students’ evaluations of university teaching: Dimensionality, reliability, validity, potential biases and usefulness

Students' evaluations of university teaching: Dimensionality, reliability, validity, potential baises, and utility.

Multidimensional students' evaluations of teaching effectiveness: A profile analysis

Validity of students' evaluations of teaching effectiveness: Cognitive and affective criteria.

Students' evaluations of university teaching: Research findings, methodological issues, and directions for future research

The use of students’ evaluations and an individually structured intervention to enhance university teaching effectiveness

The relative importance of teaching evaluation criteria from the points of view of students and faculty

Three Foci of Mathematic Teachers' Considerations in Evaluation of School Students' Achievements

Validity of students' evaluations of college teaching: A multitrait–multimethod analysis.

Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders?

Performance evaluation in teaching: Dissecting student evaluations in higher education

Validity of student evaluations of instructional effectiveness: A comparison of faculty self-evaluations and evaluations by their students.

Do university teachers become more effective with experience? A multilevel growth model of students' evaluations of teaching over 13 years.

The effect of teaching style and academic motivation on student evaluation of teaching: Insights from social cognition

Distinguishing between good (useful) and bad workloads on students’ evaluations of teaching

Multiple dimensions of university teacher self-concept

Playing the SET game: how teachers view the impact of student evaluation on the experience of teaching and learning

Are Student Evaluations of Teaching Effectiveness Valid for Measuring Student Learning Outcomes in Business Related Classes? A Neural Network and Bayesian Analyses

Exploring Variability Sources in Student Evaluation of Teaching via Many-Facet Rasch Model

Validity and usefulness of student evaluations of instructional quality.