Chinese Journal of Medical Education ›› 2023, Vol. 43 ›› Issue (4): 316-320.DOI: 10.3760/cma.j.cn115259-20220624-00820

Previous Articles    

Exploration of a mutual evaluation model between teachers and students for professional skills training in rehabilitation therapy based on project response theory

Yu Wei 1, Chen Qun 2, Geng Baofeng2, Bian Jiajia2, Jiang Zhongli2, Shi Yawei3, Lin Feng2   

  1. 1Teaching and Research Office, School of Rehabilitation Medicine, Nanjing Medical University, Nanjing 210029, China;
    2Department of Rehabilitation Medicine, The Affiliated Sir Run Run Hospital of Nanjing Medical University, Nanjing 211100, China;
    3Department of Oral and Maxillofacial Surgery, The Affiliated Stomatological Hospital of Nanjing Medical University, Nanjing 210029, China
  • Received:2022-06-24 Published:2023-03-29
  • Contact: Lin Feng, Email: peterduus_lin@hotmail.com

Abstract: Objective Based on the item response theory(IRT), to build a model for the mutual evaluation between teachers and students in the professional skills training of rehabilitation therapy, and to verify the actual effect of the model for the mutual evaluation between teachers and students in the skills training. Methods To extract the examination results of the students majoring in rehabilitation therapy from grade 2015 to 2018 in the rehabilitation skills training management system of Sir Run Run Hospital affiliated to Nanjing Medical University, including the after-department examination, daily performance evaluation, case report performance, etc. The IRT model was established based on the evaluation items provided by the teacher assessment student (TAS, 13 items) questionnaire and the student assessment teacher (SAT, 12 items) questionnaire and each item is scored 0, 1, 3 and 5 points. The fitting, reliability and local independence of the model were verified through the result of TAS and SAT, and the correlation between the teaching capability, the students′ practical ability and the examination results is calculated. Results Both types of questionnaires were modeled after being converted into 2 category items. The 13 items of TAS can form a 1 factor 2 parameters model. The model has good fitness (P=0.206), reliability (r=0.853) and local independence. The level of students′ practical ability measured by the model is significantly related to the students′ performance in the examination (r=0.442,P<0.001). The 12 items of the SAT questionnaire can form a 1 factor 4 parameters model. The model has good fitness (P=0.237), reliability (r=0.952) and local independence. The teacher′s teaching level measured by the model is significantly related to the student′s performance in the examination (r=0.197, P=0.006). Conclusions On the basis of the 2 category items, the IRT model can be constructed to evaluate the professional-skills-teaching level of teachers and students′ practical ability. After verification, the model has good evaluation effect and can be considered for promotion and application.

Key words: Rehabilitation, Practical training, Item response theory, Teacher assessment, Student assessment, Build a model

CLC Number: