Abstract:Background: Academic success has been the primary criterion for admission to many nursing programs. However, academic success as an admission criterion may have limited predictive value for success in noncognitive skills. Adding situational judgment tests, such as Casper, to admissions procedures may be one strategy to strengthen decisions and address the limited predictive value of academic admission criteria. In 2021, admissions processes were modified to include Casper based on concerns identified with noncognitive skills. Objective: This study aims to (1) assess the incremental validity of Casper scores in predicting nursing student performance at years 1, 2, 3, and 4 and on the National Council Licensing Examination (NCLEX) performance; and (2) examine faculty members' perceptions of student performance and influences related to communication, professionalism, empathy, and problem-solving. Methods: We will use a multistage evaluation mixed methods design with 5 phases. At the end of each year, students will complete questionnaires related to empathy and professionalism and have their performance assessed for communication and problem-solving in psychomotor laboratory sessions. The final phase will assess graduate performance on the NCLEX. Each phase also includes qualitative data collection (ie, focus groups with faculty members). The goal of the focus groups is to help explain the quantitative findings (explanatory phase) as well as inform data collection (eg, focus group questions) in the subsequent phase (exploratory sequence). All students enrolled in the first year of the nursing program in 2021 were asked to participate (n=290). Faculty will be asked to participate in the focus groups at the end of each year of the program. Hierarchical multiple regression will be conducted for each outcome of interest (eg, communication, professionalism, empathy, and problem-solving) to determine the extent to which scores on Casper with admission grades, compared to admission grades alone, predict nursing student performance at years 1-4 of the program and success on the national exam. Thematic analysis of focus group transcripts will be conducted using interpretive description. The quantitative and qualitative data will be integrated after each phase is complete and at the end of the study. Results: This study was funded in September 2021, and data collection began in March 2022. Year 1 data collection and analysis are complete. Year 2 data collection is complete, and data analysis is in progress. Conclusions: At the end of the study, we will provide the results of a comprehensive analysis to determine the extent to which the addition of scores on Casper compared to admission grades alone predicts nursing student performance at years 1-4 of the program and on the NCLEX exam. International registered report identifier (irrid): RR1-10.2196/48672.

First-Time NCLEX-RN Pass Rate: Measure of Program Quality or Something Else?

Using data to drive programmatic change: Recalculating NCLEX-RN success

Predictors of First-Time NCLEX-RN Pass Rate in Accelerated Bachelor of Science in Nursing Students

Predictors and students’ perceptions of NCLEX-RN success in a BS program

The Relationship of a Predictable Ability Measurement Examination and NCLEX-RN Disposition

An NCLEX-RN Improvement Project: A Study of Student Attributes Associated With Test Success

High Total Failures of the North American Pharmacist Licensure Examination (NAPLEX) Warrant Monitoring of Professional Pharmacy Programs

North American Pharmacist Licensure Examination Absolute Failures Warrant Monitoring of Colleges and Schools of Pharmacy

Quality improvement: A practical nursing program's admission test

A Mixed Methods Study on Character Traits of Nursing Students and Faculty Influencing a 100% Passing Rate in the Nursing Licensure Exam in the Philippines

Correlating Advanced Pharmacy Practice Experience Exam Scores and Pharmacist Licensure Status in a Single Program

A 1-Year Accredited Nurse Residency Program's Effect on Intent to Leave

Hoping to Pass: Randomized Trial of a One-Time Hope Intervention on Standardized Exam Passing Rates in BSN Students

First-round Accreditation and Pass Rates on Licensing Examination at Different Medical Schools in China: Closing the Performance Gap.

Nursing faculty perceptions of entry to nursing practice competencies expected at day one of hire: A statewide study

Revisiting the Impact of Accreditation on Transition to Practice Programs: Findings From a Replication Analysis

The competency index for clinical research professionals: a potential tool for competency-based clinical research academic program evaluation

Evaluation of Incremental Validity of Casper in Predicting Program and National Licensure Performance of Undergraduate Nursing Students: Protocol for a Mixed Methods Study

Evolving Licensure Examination: Assessing Student Confidence and Accuracy With Next Generation NCLEX

Improving Undergraduate Nursing Testing Practice by Developing a Peer-Review Methodology

Exploring the relationship between grit scores and academic potential in baccalaureate nursing students