Consistency analysis of"5 stations assessment" criteria for psychiatric residents'training

Hong-bo HE,Yu-ping NING,Qun CHEN,Cheng-hua TIAN,Hong-yu TANG
DOI: https://doi.org/10.3969/j.issn.1005-3220.2017.06.008
2017-01-01
Abstract:Objective:To evaluate the reliability of the evaluation scale in"5 stations assessment" of ob-jective structured clinical examination (OSCE). Method:Firstly the tutors explained the assessment criteria of the 5 stations,especially the station of clinical skills,clinical thinking and clinical communication. Secondly, a couple of 2nd year residents were invited to see the true patients on site and the tutors did the evaluations to-gether with trainees based on the criteria. Then the tutors discussed and explained the evaluation criteria with the case again. Thirdly,all the trainees were divided into 4 groups to practice the evaluation with one resident seeing one true patients respectively. Results:Intra-class correlation coefficient (ICC)was calculated with statistic software and it showed high consistency among different assessors after training in all three stations including clinical skills,clinical thinking and clinical communication with ICC equal 0. 997,1. 000,and 0. 998 respective-ly. Conclusion:The "5 stations"assessment criteria for psychiatric residents training is practical with high consistency after training which potentially could be very beneficial to the standardization of psychiatric clinical skills assessment.
What problem does this paper attempt to address?