中华医学教育杂志

中华医学教育杂志 ›› 2023, Vol. 43 ›› Issue (4): 316-320.DOI: 10.3760/cma.j.cn115259-20220624-00820

• 医学教育评估 • 上一篇    

基于项目反应理论的康复治疗专业技能培训师生互评模型探索

於伟1, 陈群2, 耿宝峰2, 卞佳佳2, 江钟立2, 史亚伟3, 林枫2   

  1. 1南京医科大学康复医学院教学与科研办公室,南京 210029;
    2南京医科大学附属逸夫医院康复医学科,南京 211100;
    3南京医科大学附属口腔医院口腔颌面外科,南京 210029
  • 收稿日期:2022-06-24 发布日期:2023-03-29
  • 通讯作者: 林枫, Email: peterduus_lin@hotmail.com

Exploration of a mutual evaluation model between teachers and students for professional skills training in rehabilitation therapy based on project response theory

Yu Wei 1, Chen Qun 2, Geng Baofeng2, Bian Jiajia2, Jiang Zhongli2, Shi Yawei3, Lin Feng2   

  1. 1Teaching and Research Office, School of Rehabilitation Medicine, Nanjing Medical University, Nanjing 210029, China;
    2Department of Rehabilitation Medicine, The Affiliated Sir Run Run Hospital of Nanjing Medical University, Nanjing 211100, China;
    3Department of Oral and Maxillofacial Surgery, The Affiliated Stomatological Hospital of Nanjing Medical University, Nanjing 210029, China
  • Received:2022-06-24 Published:2023-03-29
  • Contact: Lin Feng, Email: peterduus_lin@hotmail.com

PDF (PC)

51

摘要： 目的 基于项目反应理论为康复治疗专业技能培训师生互评构建模型,并验证该模型用于技能培训师生互评的实际效果。方法 提取南京医科大学附属逸夫医院康复技能培训管理系统中2015至2018级康复治疗专业学生的出科考核、平时成绩、病例报告等考试成绩作为研究资料。以教师考核学生(考学,13项)问卷和学生评价教师(评师,12项)问卷作为评测条目,各条目评分为0、1、3和5分,由此建立项目反应理论模型。通过对师生互评结果分析验证所得模型的拟合度、信度和局部独立性,并测算教师的教学水平、学生的实践能力与出科考核成绩的相关性。结果 两类问卷均在转置为二分类项目后完成建模。考学问卷的13个项目可构成单因素2参数模型,该模型拟合度(P=0.206)、信度(r＝0.853)和局部独立性良好,且模型测算的学生实践能力与出科考核成绩显著相关(r=0.442,P<0.001)。评师问卷的12个项目可构成单因素4参数模型,该模型拟合度(P=0.237)、信度(r=0.952)和局部独立性良好,且模型测算的教师教学水平与学生出科考核成绩显著相关(r=0.197,P=0.006)。结论 在二分类项目基础上,可以构建出适用于评价康复治疗专业教师教学水平、学生实践能力的项目反应理论模型。经验证,该模型评测效果良好,可考虑推广应用。

关键词: 康复, 技能培训, 项目反应理论, 教师考评, 学生考评, 构建模型

Abstract: Objective Based on the item response theory(IRT), to build a model for the mutual evaluation between teachers and students in the professional skills training of rehabilitation therapy, and to verify the actual effect of the model for the mutual evaluation between teachers and students in the skills training. Methods To extract the examination results of the students majoring in rehabilitation therapy from grade 2015 to 2018 in the rehabilitation skills training management system of Sir Run Run Hospital affiliated to Nanjing Medical University, including the after-department examination, daily performance evaluation, case report performance, etc. The IRT model was established based on the evaluation items provided by the teacher assessment student (TAS, 13 items) questionnaire and the student assessment teacher (SAT, 12 items) questionnaire and each item is scored 0, 1, 3 and 5 points. The fitting, reliability and local independence of the model were verified through the result of TAS and SAT, and the correlation between the teaching capability, the students′ practical ability and the examination results is calculated. Results Both types of questionnaires were modeled after being converted into 2 category items. The 13 items of TAS can form a 1 factor 2 parameters model. The model has good fitness (P=0.206), reliability (r=0.853) and local independence. The level of students′ practical ability measured by the model is significantly related to the students′ performance in the examination (r=0.442,P<0.001). The 12 items of the SAT questionnaire can form a 1 factor 4 parameters model. The model has good fitness (P=0.237), reliability (r=0.952) and local independence. The teacher′s teaching level measured by the model is significantly related to the student′s performance in the examination (r=0.197, P=0.006). Conclusions On the basis of the 2 category items, the IRT model can be constructed to evaluate the professional-skills-teaching level of teachers and students′ practical ability. After verification, the model has good evaluation effect and can be considered for promotion and application.

Key words: Rehabilitation, Practical training, Item response theory, Teacher assessment, Student assessment, Build a model

中图分类号: