Abstract:Background: Academic success has been the primary criterion for admission to many nursing programs. However, academic success as an admission criterion may have limited predictive value for success in noncognitive skills. Adding situational judgment tests, such as Casper, to admissions procedures may be one strategy to strengthen decisions and address the limited predictive value of academic admission criteria. In 2021, admissions processes were modified to include Casper based on concerns identified with noncognitive skills. Objective: This study aims to (1) assess the incremental validity of Casper scores in predicting nursing student performance at years 1, 2, 3, and 4 and on the National Council Licensing Examination (NCLEX) performance; and (2) examine faculty members' perceptions of student performance and influences related to communication, professionalism, empathy, and problem-solving. Methods: We will use a multistage evaluation mixed methods design with 5 phases. At the end of each year, students will complete questionnaires related to empathy and professionalism and have their performance assessed for communication and problem-solving in psychomotor laboratory sessions. The final phase will assess graduate performance on the NCLEX. Each phase also includes qualitative data collection (ie, focus groups with faculty members). The goal of the focus groups is to help explain the quantitative findings (explanatory phase) as well as inform data collection (eg, focus group questions) in the subsequent phase (exploratory sequence). All students enrolled in the first year of the nursing program in 2021 were asked to participate (n=290). Faculty will be asked to participate in the focus groups at the end of each year of the program. Hierarchical multiple regression will be conducted for each outcome of interest (eg, communication, professionalism, empathy, and problem-solving) to determine the extent to which scores on Casper with admission grades, compared to admission grades alone, predict nursing student performance at years 1-4 of the program and success on the national exam. Thematic analysis of focus group transcripts will be conducted using interpretive description. The quantitative and qualitative data will be integrated after each phase is complete and at the end of the study. Results: This study was funded in September 2021, and data collection began in March 2022. Year 1 data collection and analysis are complete. Year 2 data collection is complete, and data analysis is in progress. Conclusions: At the end of the study, we will provide the results of a comprehensive analysis to determine the extent to which the addition of scores on Casper compared to admission grades alone predicts nursing student performance at years 1-4 of the program and on the NCLEX exam. International registered report identifier (irrid): RR1-10.2196/48672.

Associations Between an Open-Response Situational Judgment Test and Performance on OSCEs and Fieldwork: Implications for Admissions Decisions and Matriculant Diversity in an Occupational Therapy Program

Incorporating a situational judgement test in residency selections: clinical, educational and organizational outcomes

Measuring personal characteristics in applicants to German medical schools: Piloting an online Situational Judgement Test with an open-ended response format

Evaluation of Incremental Validity of Casper in Predicting Program and National Licensure Performance of Undergraduate Nursing Students: Protocol for a Mixed Methods Study

Predicting undergraduate OSCE performance using traditional and construct-driven situational judgment tests at admission

Long-term results of central venous access devices in children with haemophilia

Racial and Ethnic Disparities in Situational Judgment Testing Among Applicants to an Anesthesiology Residency Program

A preliminary study of the probitive value of personality assessment in medical school admissions within the United States

Using a Diagnostic OSCE to Discern Deficit From Disability in Struggling Students

Can personal qualities of medical students predict in-course examination success and professional behaviour? An exploratory prospective cohort study

Role of Cognitive and Non-Cognitive Attributes in Doctor of Physical Therapy Student Performance

Transitioning Competency-Based Communication Assessments to the Online Platform: Examples and Student Outcomes

Evaluating student performance assessment methods in Objective Structured Clinical Exam: perspectives and comparisons

Beyond Selection: The Use of Situational Judgement Tests in the Teaching and Assessment of Professionalism

The sights and insights of examiners in objective structured clinical examinations

[Difficulties in diagnosing complicated aneurysm of the abdominal aorta appearing as acute abdomen].

[Chronic eosinophilic pneumonia: Report of one case].

Exploring the Utility and Fairness of a Multi-institutional Situational Judgment Test

A basic aphasia examination: description with discussion of first results.

In Holistic Admissions, a Combination of Non-Academic Explanatory Variables Has Significant Predictive Value for Applicant Ranking

Requested a Different Doctor: Developing and Evaluating an OSCE Assessing Core Skills in Supporting Trainees Facing Patient Discrimination