Abstract:Measures of student learning are playing an increasingly significant role in determining the quality and productivity of higher education. This paper evaluates approaches for estimating the value added by university education, and proposes a methodology for use by institutions and systems. The paper argues that value-added measures of learning are important for quality assurance in contemporary higher education. It reviews recent large-scale developments in Australia, methodological considerations pertaining to the measurement and evaluation of student learning, and instruments validated to measure students’ capability, generic skills, specific competencies, work readiness and student engagement. Four approaches to calculating value-added measures are reviewed. The first approach computes value-added estimates by comparing predicted against actual performance using data from entrance tests and routine course assessments. In the second approach, comparisons are made between outcomes from objective assessments administered to cohorts in the first and later years of study. Comparisons of first-year and later-year students’ engagement in key learning activities offer a third and complementary means of assessing the value added by university study. Feedback on graduate skills provided by employers is a fourth approach which gives an independent perspective on the quality of education. Reviewing these four approaches provides a basis for their synthesis into a robust and potentially scalable methodology for measuring the value added by higher education. This methodology is advanced, along with its implications for instrumentation, sampling, analysis and reporting. Case studies are presented to illustrate the methodology’s potential for informing comparative analyses of the performance of higher education systems. Quelle difference ? Un modele pour mesurer la valeur ajoutee de l’enseignement superieur en Australie L’evaluation des connaissances acquises par les etudiants est desormais un outil indispensable pour determiner la qualite et la productivite de l’enseignement superieur. Ce rapport examine les differentes approches permettant d’evaluer la valeur ajoutee de l’enseignement superieur et propose une methode utilisable a la fois au sein des etablissements et a l’echelle des systemes d’enseignement superieur. L’idee centrale qui sous-tend ce rapport est la suivante : la mesure des acquis des etudiants est l’un des piliers de l’assurance qualite au sein des systemes d’enseignement superieur modernes. L’auteur passe ainsi en revue les tendances majeures observees recemment en la matiere en Australie, analyse les problemes methodologiques inherents a la mesure et a l’evaluation des acquis des etudiants, et enfin etudie les instruments couramment employes pour mesurer les capacites, les competences generiques et specifiques, l’aptitude au travail et l’implication des etudiants. Quatre methodes de calcul de la valeur ajoutee sont ainsi passees en revue. La premiere consiste a estimer cette valeur ajoutee en comparant les performances escomptees et les performances reelles des eleves, a l’aide des resultats des tests d’admission et de ceux des evaluations realisees en cours de cycle. La deuxieme approche compare les resultats d’evaluations objectives d’etudiants pour chaque annee d’etude (premiere annee et suivantes). La troisieme methode utilisee pour evaluer la valeur ajoutee de l’enseignement secondaire, de nature complementaire, consiste a comparer l’implication des etudiants dans certains modules d’apprentissage cles durant la premiere annee et au cours des annees suivantes. Enfin, la quatrieme methode etudiee envisage la qualite de l’enseignement superieur selon une perspective differente, puisqu’elle tient compte des retours d’experience de certains employeurs sur les competences des jeunes diplomes. L’examen de ces quatre approches permet ensuite de les synthetiser et d’obtenir une methode fiable pour evaluer la valeur ajoutee de l’enseignement superieur, ladite methode consolidee offrant en outre le potentiel de s’adapter a differentes echelles. Il s’agit d’une approche sophistiquee, aux implications complexes en termes d’instrumentation, d’echantillonnage, d’analyse et de presentation des resultats. Une serie d’etudes de cas permet a l’auteur de demontrer le potentiel offert par cette methode pour etayer l’analyse comparative des performances de differents systemes d’enseignement superieur.

Investigating applications of university productivity measurement models using Australian data

Productivity and Policy in Higher Education

Measuring International Higher Education Productivity: Lessons from Nine Countries in Asia

Non-structural and Structural Models in Productivity Analysis: Study of the British Isles During the 2007–2009 Financial Crisis

The Productivity of Leading Global Universities: Empirical Insights and Implications for Higher Education

The Productivity of Leading Global Universities

Research Productivity for Augmenting the Innovation Potential of Higher Education Institutions: An Interpretive Structural Modeling Approach and MICMAC Analysis

Revisiting Higher Education Business Models and Academic Performance Metrics Times

Higher Education Efficiency Frontier Analysis: A Review of Variables to Consider

Universities on the Catwalk

Effects of the Performance-Based Research Fund and Other Factors on the Efficiency of New Zealand Universities: A Malmquist Productivity Approach

What's the Difference? A Model for Measuring the Value Added by Higher Education in Australia

MEASURING RESEARCH PRODUCTIVITY OF MARKETING SCHOLARS AND MARKETING DEPARTMENTS

The hybrid returns-to-scale model and its extension by production trade-offs: an application to the efficiency assessment of public universities in Malaysia

Stochastic vs. deterministic frontier distance output function: Evidence from Brazilian higher education institutions

Efficiency, costs, rankings and heterogeneity: the case of US higher education

Benefit of the doubt approach to assessing the research performance of Australian universities

Productivity analysis of research in Natural Sciences, Technology and Clinical Medicine: an input–output model applied in comparison of Top 300 ranked universities of 4 North European and 4 East Asian countries

A new perspective to productivity measurement

Counting what counts: A researcher productivity scoring framework for South African's universities of technology