Are Student Evaluations of Teaching Effectiveness Valid for Measuring Student Learning Outcomes in Business Related Classes? A Neural Network and Bayesian Analyses

Craig S. Galbraith,Gregory B. Merrill,Doug M. Kline
DOI: https://doi.org/10.1007/s11162-011-9229-0
2011-06-09
Research in Higher Education
Abstract:In this study we investigate the underlying relational structure between student evaluations of teaching effectiveness (SETEs) and achievement of student learning outcomes in 116 business related courses. Utilizing traditional statistical techniques, a neural network analysis and a Bayesian data reduction and classification algorithm, we find little or no support for the validity of SETEs as a general indicator of teaching effectiveness or student learning. In fact, the underlying structure appears to be non-linear and possibly negatively bimodal where the most effective instructors are within the middle percentiles of student course ratings, while instructors receiving ratings in the top quintile or the bottom quintile are associated with significantly lower levels of student achievement.
education & educational research
What problem does this paper attempt to address?