中华医学教育杂志 ›› 2020, Vol. 40 ›› Issue (5): 392-396.DOI: 10.3760/cma.j.cn115259-20191029-00911

• 医学教育评估 • 上一篇    下一篇

临床思维能力测评系统的评分准确性研究

卢燕1, 李国建2, 何惧3, 张颖1   

  1. 1国家医学考试中心研究评价处,北京 100097;
    2国家医学考试中心临床与基础试题开发处,北京 100097;
    3国家医学考试中心,北京 100097
  • 收稿日期:2019-10-29 出版日期:2020-05-01 发布日期:2020-12-09
  • 通讯作者: 李国建, Email: llgj1979@163.com, 电话: 010- 59935054

Analysis of scoring accuracy of clinical thinking ability assessment

Lu Yan1, Li Guojian2, He Ju3, Zhang Ying1   

  1. 1Research and Evaluation Department, National Medical Examination Center, Beijing 100097, China;
    2Clinical & Basic Medicine Item Development Division, National Medical Examination Center, Beijing 100097, China;
    3National Medical Examination Center, Beijing 100097, China
  • Received:2019-10-29 Online:2020-05-01 Published:2020-12-09
  • Contact: Li Guojian, Email:llgj1979@163.com, Tel: 0086-10-59935054

摘要: 目的 对临床思维能力测评(clinical thinking ability assessment,CTA)系统在医师资格考试临床类别分阶段考试实证研究中的评分准确性进行分析,为CTA系统的后续研究提供参考。方法 采用简单随机抽样法,选取参加2018年CTA系统测试的35名考生作为研究对象,邀请三级甲等医院副高级及以上职称的8位医师作为临床专家,对35名考生的临床思维能力进行等级评价,通过CTA系统评分与临床专家等级评价的Pearson相关系数和概化理论(generalizability theory, GT)对CTA系统评分和专家等级评价的一致性进行分析。结果 CTA系统在信息收集站、病情分析站、临床诊疗站和动态决策站的评分与临床专家等级评价的Pearson相关系数分别为0.824、0.697、0.856、0.815;GT分析得出的概化系数分别为0.879、0.904、0.879、0.878,可靠性指数分别为0.674、0.863、0.869、0.797。结论 CTA系统评分与临床专家等级评价的一致性较高。

关键词: 临床思维能力测评, 医师资格考试, 概化理论, 概化系数, 可靠性指数

Abstract: Objective To analyzes scoring accuracy of clinical thinking ability assessment in the empirical study of National Medical Licensing Examination(NMLE) phased examination, so as to provide reference for the follow-up study of CTA system. Methods In 2018,a simple random sampling method was used to select 35 candidates who participated in the CTA test as the research object. Eight clinical doctors of position of senior or higher from the third class hospital were invited as clinical experts to evaluate the clinical thinking ability of 35 examinees, then the consistency between CTA system score and clinical expert grade evaluation is analyzed by the Pearson correlation coefficient and general theory (GT). Results Pearsonal correlation coefficient of CTA system and clinical expert rating in information collection, disease analysis, clinical diagnosis and treatment and dynamic decision making were 0.824, 0.697, 0.856 and 0.815; The generalizability coefficient of GT analysis were 0.879, 0.904, 0.879, 0.878, dependent index were 0.674, 0.863, 0.869, 0.797. Conclusions The evaluation system of CTA is consistent with clinical experts evaluation.

Key words: Clinical thinking ability assessment, National Medical Licensing Examination, Generalizability theory, Generalizability coefficient, Dependent index

中图分类号: