Abstract:Objective: The objective of this study was to develop generic domains of competence (DoC) with associated competencies and milestones for physical therapist residency education. This work was intended to culminate in establishing validity evidence to support a competency-based assessment instrument that could be used by residency programs to evaluate resident achievement of the competencies, regardless of specialty area. Methods: Employing the modified Delphi method, a residency education work group developed an evaluation instrument that included 7 DoC and 31 associated competencies with 6 milestones as rating scales for each competency. The instrument was distributed to mentors and residents in accredited physical therapist residency programs to establish validity evidence. Evaluations (measured by milestones) and demographics were collected at 3 time points (program entry, midterm, and final). Scores across these time points were compared using Kruskal-Wallis tests. Reliability was assessed with kappa statistics (interrater reliability) and alpha reliability coefficients (internal consistency). Construct validity was examined using confirmatory factor analysis via structural equation modeling. Results: Overall, 237 mentors and 228 residents completed 824 evaluations (460 by mentors and 364 resident self-evaluations) across the time points. Scores significantly increased from entry through final time points. The interrater reliability of the associated behaviors ranged from moderate to substantial agreement (κ = 0.417-0.774). The internal consistency was high for all DoC at every time point (α reliability coefficients = .881-.955 for entry, .857-.925 for midterm, and .824-.902 for final). After confirmatory factor analysis with structural equation modeling was performed, a model that included 7 DoC and 20 associated competencies was proposed. Conclusions: The residency assessment instrument developed demonstrates interrater reliability and validity evidence and therefore supports competency-based assessment of resident clinical performance across specialty areas. Additionally, the instrument aligns the physical therapy profession with other professions, such as medicine, dentistry, and pharmacy, that have transitioned to competency-based education. Impact: This study outlines the benefits of moving to competency-based education for physical therapist residents, using a sound evaluation tool that evaluates residents across specialty areas. The instrument will allow for transition to competency-based education in physical therapist residency education programs.

Changes in Clinical Competence of Novice Physical Therapists During Their First Year of Employment: A Single Center Retrospective Observational Study in Japan

Realist Approach to Continuing Training of Physical Assessment Education to School Nurses (Yogo Teachers) in Japan

Are physical therapy clinical instructors teaching the Institute of Medicine core competencies? An exploratory investigation using student perceptions

Comparisons of Clinical Competency and Job Responsibilities of Physical Therapists With and Without Postprofessional Training

Long-term impact of undergraduate community-based clinical training on community healthcare practice in Japan: a cross-sectional study

Self-reported Practice, Confidence, and Knowledge About Palliative Care of Nurses in a Japanese Regional Cancer Center: Longitudinal Study After 1-Year Activity of Palliative Care Team

Changes in attitudes of undergraduate students learning interprofessional education in the absence of patient safety modules: evaluation with a modified T-TAQ instrument

Impact of In-class Patient and Integrated Clinical Experiences on Physical Therapist Students’ Clinical Performance

Effectiveness of a Simulation-Based Education Program to Improve Novice Nurses' Clinical Judgment Skills

Current status of interprofessional competency among healthcare professions in Japan: A cross-sectional web-based survey

Physical Therapist Residency Competency-Based Education: Development of an Assessment Instrument

Development and psychometric testing of the Professional Interpersonal Competency Assessment Scale for Novice nurses (PICASN)

Cross-Cultural Interprofessional Faculty Development in Japan: Results of an Integrated Workshop for Clinical Teachers

Evaluation of an advance care planning training program for practice professionals in Japan incorporating shared decision making skills training: a prospective study of a curricular intervention

How can students attending physical therapist training schools get through the national examination?

Difference in the general medicine in-training examination score between community-based hospitals and university hospitals: a cross-sectional study based on 15,188 Japanese resident physicians

Outcomes of Residency Education: Insights Into the Professional Formation of the Physical Therapist Resident

Effectiveness of Interprofessional Education Modules on Cultural Competency of Physical Therapy and Occupational Therapy Students

Training potential of a teleoperated humanoid robot for use by a young psychiatrist during childcare leave

What did first-year students experience during their interprofessional education? A qualitative analysis of e-portfolios

Establishing excellence: Implementation of an onboarding and continuing education curriculum for pediatric intensive care unit nurse practitioners and physician associates