Abstract:Background: Academic success has been the primary criterion for admission to many nursing programs. However, academic success as an admission criterion may have limited predictive value for success in noncognitive skills. Adding situational judgment tests, such as Casper, to admissions procedures may be one strategy to strengthen decisions and address the limited predictive value of academic admission criteria. In 2021, admissions processes were modified to include Casper based on concerns identified with noncognitive skills. Objective: This study aims to (1) assess the incremental validity of Casper scores in predicting nursing student performance at years 1, 2, 3, and 4 and on the National Council Licensing Examination (NCLEX) performance; and (2) examine faculty members' perceptions of student performance and influences related to communication, professionalism, empathy, and problem-solving. Methods: We will use a multistage evaluation mixed methods design with 5 phases. At the end of each year, students will complete questionnaires related to empathy and professionalism and have their performance assessed for communication and problem-solving in psychomotor laboratory sessions. The final phase will assess graduate performance on the NCLEX. Each phase also includes qualitative data collection (ie, focus groups with faculty members). The goal of the focus groups is to help explain the quantitative findings (explanatory phase) as well as inform data collection (eg, focus group questions) in the subsequent phase (exploratory sequence). All students enrolled in the first year of the nursing program in 2021 were asked to participate (n=290). Faculty will be asked to participate in the focus groups at the end of each year of the program. Hierarchical multiple regression will be conducted for each outcome of interest (eg, communication, professionalism, empathy, and problem-solving) to determine the extent to which scores on Casper with admission grades, compared to admission grades alone, predict nursing student performance at years 1-4 of the program and success on the national exam. Thematic analysis of focus group transcripts will be conducted using interpretive description. The quantitative and qualitative data will be integrated after each phase is complete and at the end of the study. Results: This study was funded in September 2021, and data collection began in March 2022. Year 1 data collection and analysis are complete. Year 2 data collection is complete, and data analysis is in progress. Conclusions: At the end of the study, we will provide the results of a comprehensive analysis to determine the extent to which the addition of scores on Casper compared to admission grades alone predicts nursing student performance at years 1-4 of the program and on the NCLEX exam. International registered report identifier (irrid): RR1-10.2196/48672.

Reliability and Validity Testing of the Creighton Competency Evaluation Instrument for Use in the NCSBN National Simulation Study

Validation of a detailed scoring checklist for use during advanced cardiac life support certification

Assessing Nursing Student Perceptions of the Clinical Learning Environment: Refinement and Testing of the SECEE Inventory

Development, Validity and Reliability of Objective Structured Clinical Examination in Nursing Students

The Relationship of a Predictable Ability Measurement Examination and NCLEX-RN Disposition

The Pathway to Developing a Competency-based Tool for Entry-level Nursing Simulation: A Delphi Study

Screen-Based Patient Simulation: An Exemplar for Developing and Assessing Competency

Validity evidence for programmatic assessment in competency-based education

The competency index for clinical research professionals: a potential tool for competency-based clinical research academic program evaluation

[Development and Psychometric Testing of the Clinical Nursing Competency Scale for Clinical Preceptor Use (CNCS-CP)].

Development and Validation of a Quantitative Grading Rubric for High-Fidelity Simulation Assessment

Testing the validity of three acute care assessment tools for assessing residents’ performance during in situ simulation: the ACAT-SimSit study

Evaluating anxiety and self-confidence in nursing students: Adaptation and validation of the NASC-CDM scale for high-fidelity simulation training

Development and Evaluating Content Validity of Clinical Skill Analysis Index Tools

The validity and reliability of an instrument to assess nursing competencies in spiritual care

Evaluation of Incremental Validity of Casper in Predicting Program and National Licensure Performance of Undergraduate Nursing Students: Protocol for a Mixed Methods Study

Dual use of instruments for assessing nursing students professional- and clinical competence

Translation and validation of the traditional Chinese NLN educational practices questionnaire, simulation design scale and student satisfaction and self-confidence in learning

Evolving Licensure Examination: Assessing Student Confidence and Accuracy With Next Generation NCLEX

Workplace-Based Entrustment Scales for the Core EPAs: A Multisite Comparison of Validity Evidence for Two Proposed Instruments Using Structured Vignettes and Trained Raters

Psychometric Properties of the Canadian Nurse Informatics Competency Assessment Scale