Abstract:Introduction: Assessment environment, synonymous with climate or atmosphere, is multifaceted. Although there are valid and reliable instruments for measuring the educational environment, there is no validated instrument for measuring the assessment environment in medical programs. This study aimed to develop an instrument for measuring students' perceptions of the assessment environment in an undergraduate medical program and to examine the psychometric properties of the new instrument. Method: The Assessment Environment Questionnaire (AEQ), a 40-item, four-point (1=Strongly Disagree to 4=Strongly Agree) Likert scale instrument designed by the authors, was administered to medical undergraduates from the authors' institution. The response rate was 626/794 (78.84%). To establish construct validity, exploratory factor analysis (EFA) with principal component analysis and varimax rotation was conducted. To examine the internal consistency reliability of the instrument, Cronbach's α was computed. Mean scores for the entire AEQ and for each factor/subscale were calculated. Mean AEQ scores of students from different academic years and sex were examined. Results: Six hundred and eleven completed questionnaires were analysed. EFA extracted four factors: feedback mechanism (seven items), learning and performance (five items), information on assessment (five items), and assessment system/procedure (three items), which together explained 56.72% of the variance. Based on the four extracted factors/subscales, the AEQ was reduced to 20 items. Cronbach's α for the 20-item AEQ was 0.89, whereas Cronbach's α for the four factors/subscales ranged from 0.71 to 0.87. Mean score for the AEQ was 2.68/4.00. The factor/subscale of 'feedback mechanism' recorded the lowest mean (2.39/4.00), whereas the factor/subscale of 'assessment system/procedure' scored the highest mean (2.92/4.00). Significant differences were found among the AEQ scores of students from different academic years. Conclusions: The AEQ is a valid and reliable instrument. Initial validation supports its use to measure students' perceptions of the assessment environment in an undergraduate medical program.

Characterising programme‐level assessment environments that support learning

Implementing summative assessment with a formative flavour: a case study in a large class

Assessment for learning: using programmatic assessment requirements as an opportunity to develop information literacy and data skills in undergraduate students

Measuring changes in higher-order cognition through the assessment of complex knowledge over time

Where the rubber meets the road — An integrative review of programmatic assessment in health care professions education

Validity evidence for programmatic assessment in competency-based education

Alternative perspectives on learning outcomes: challenges for assessment

Assessment professional development courses for university teachers: a nationwide analysis exploring length, evaluation and content

Enhancing the assessment and the feedback in higher education

Learning Outcome Oriented Programmatic Assessment

Linking Assessment for Learning, Improvement and Accountability

Support for assessment practice: developing the Assessment Design Decisions Framework

Experiential learning: assessing process and product

Designing and implementing a comprehensive assessment plan for a graduate accounting programme

Assessment IS learning: developing a student‐centred approach for assessment in Higher Education

Development of an instrument to measure medical students' perceptions of the assessment environment: initial validation

Developing a digital application for quality assurance of assessment programmes in higher education

Helping Hong Kong business students to appreciate how they learn

Constructive guidance and feedback for learning: the usefulness of exemplars, marking sheets and different types of feedback in a first year law subject

Ottawa 2020 consensus statements for programmatic assessment - 2. Implementation and practice

From copying to learning: using exemplars to engage students with assessment criteria and feedback