Abstract:Measures of student learning are playing an increasingly significant role in determining the quality and productivity of higher education. This paper evaluates approaches for estimating the value added by university education, and proposes a methodology for use by institutions and systems. The paper argues that value-added measures of learning are important for quality assurance in contemporary higher education. It reviews recent large-scale developments in Australia, methodological considerations pertaining to the measurement and evaluation of student learning, and instruments validated to measure students’ capability, generic skills, specific competencies, work readiness and student engagement. Four approaches to calculating value-added measures are reviewed. The first approach computes value-added estimates by comparing predicted against actual performance using data from entrance tests and routine course assessments. In the second approach, comparisons are made between outcomes from objective assessments administered to cohorts in the first and later years of study. Comparisons of first-year and later-year students’ engagement in key learning activities offer a third and complementary means of assessing the value added by university study. Feedback on graduate skills provided by employers is a fourth approach which gives an independent perspective on the quality of education. Reviewing these four approaches provides a basis for their synthesis into a robust and potentially scalable methodology for measuring the value added by higher education. This methodology is advanced, along with its implications for instrumentation, sampling, analysis and reporting. Case studies are presented to illustrate the methodology’s potential for informing comparative analyses of the performance of higher education systems. Quelle difference ? Un modele pour mesurer la valeur ajoutee de l’enseignement superieur en Australie L’evaluation des connaissances acquises par les etudiants est desormais un outil indispensable pour determiner la qualite et la productivite de l’enseignement superieur. Ce rapport examine les differentes approches permettant d’evaluer la valeur ajoutee de l’enseignement superieur et propose une methode utilisable a la fois au sein des etablissements et a l’echelle des systemes d’enseignement superieur. L’idee centrale qui sous-tend ce rapport est la suivante : la mesure des acquis des etudiants est l’un des piliers de l’assurance qualite au sein des systemes d’enseignement superieur modernes. L’auteur passe ainsi en revue les tendances majeures observees recemment en la matiere en Australie, analyse les problemes methodologiques inherents a la mesure et a l’evaluation des acquis des etudiants, et enfin etudie les instruments couramment employes pour mesurer les capacites, les competences generiques et specifiques, l’aptitude au travail et l’implication des etudiants. Quatre methodes de calcul de la valeur ajoutee sont ainsi passees en revue. La premiere consiste a estimer cette valeur ajoutee en comparant les performances escomptees et les performances reelles des eleves, a l’aide des resultats des tests d’admission et de ceux des evaluations realisees en cours de cycle. La deuxieme approche compare les resultats d’evaluations objectives d’etudiants pour chaque annee d’etude (premiere annee et suivantes). La troisieme methode utilisee pour evaluer la valeur ajoutee de l’enseignement secondaire, de nature complementaire, consiste a comparer l’implication des etudiants dans certains modules d’apprentissage cles durant la premiere annee et au cours des annees suivantes. Enfin, la quatrieme methode etudiee envisage la qualite de l’enseignement superieur selon une perspective differente, puisqu’elle tient compte des retours d’experience de certains employeurs sur les competences des jeunes diplomes. L’examen de ces quatre approches permet ensuite de les synthetiser et d’obtenir une methode fiable pour evaluer la valeur ajoutee de l’enseignement superieur, ladite methode consolidee offrant en outre le potentiel de s’adapter a differentes echelles. Il s’agit d’une approche sophistiquee, aux implications complexes en termes d’instrumentation, d’echantillonnage, d’analyse et de presentation des resultats. Une serie d’etudes de cas permet a l’auteur de demontrer le potentiel offert par cette methode pour etayer l’analyse comparative des performances de differents systemes d’enseignement superieur.

Excellent Measures Precede Measures Of Excellence

Linking Assessment for Learning, Improvement and Accountability

Building Quality Foundations: Indicators and Instruments to Measure the Quality of Vocational Education and Training

Defining and Monitoring Academic Standards in Australian Higher Education

Assessing Student Learning Outcomes Internationally: Insights and Frontiers

The Datafication of Higher Education : Evaluating tests that measure learning outcomes

Universities on the Catwalk

The Value of Student Engagement for Higher Education Quality Assurance

Managing survey engagement to improve quality assurance

What's the Difference? A Model for Measuring the Value Added by Higher Education in Australia

Keynote: Engaging Students in Higher Education: Strategies and Insights for ACU

The Assessment of Learning Outcomes in Australia

The changing nature of teaching and unit evaluations in Australian universities

Assessing Student Engagement and Outcomes: Modelling Insights from Australia and Around the World

Quality management, performance measurement and indicators in higher education institutions: between burden, inspiration and innovation

The Governance, Policy and Strategy of Learning Outcomes Assessment in Higher Education

L'université Sous Les Projecteurs

Implementation of Total Quality Management in Higher Education A conceptual framework

What we measure … and what we should measure in medical education

Définition et suivi des standards académiques de l’enseignement supérieur en Australie

Developing Outcomes Assessments For Collaborative, Cross-Institutional Benchmarking: Progress Of The Australian Medical Assessment Collaboration