医学教育评估

基于项目反应理论的医学心理学课程考试试卷质量分析

  • 张涛 ,
  • 荆雷 ,
  • 张亚亚
展开
  • 山西医科大学人文社会科学学院医学心理学教研室,太原 030001

收稿日期: 2023-06-02

  网络出版日期: 2024-04-30

Quality evaluation of medical psychology test paper based on item response theory

  • Zhang Tao ,
  • Jing Lei ,
  • Zhang Yaya
Expand
  • Department of Medical Psychology Management, School of Humanities and Social Sciences, Shanxi Medical University, Taiyuan 030001, China

Received date: 2023-06-02

  Online published: 2024-04-30

摘要

目的 应用项目反应理论(item response theory,IRT)对医学心理学课程考试试卷质量进行分析,为教育教学质量评价提供参考。方法 2022年5月,对山西医科大学2016级临床医学专业330名学生医学心理学试卷中的60道选择题进行质量评价,检验了IRT模型的核心假设和模型-数据拟合情况,分析了试题参数和信息量。结果 试题数据符合IRT理论假设,模型拟合良好,选择了双参数逻辑回归模型进行参数估计,有59道(98.3%)试题符合区分度参数估计标准,有54道(90.0%)试题符合难度参数估计标准,有55道(91.7%)试题能够提供最低要求信息量(0.16),最终质量良好的试题有49道(81.7%),试卷能够提供的信息量达到25。结论 试卷整体质量良好,绝大部分试题质量较高,小部分试题需要修改或删除。本研究可以为高校部分课程考试试卷依据IRT进行定量评价提供借鉴。

本文引用格式

张涛 , 荆雷 , 张亚亚 . 基于项目反应理论的医学心理学课程考试试卷质量分析[J]. 中华医学教育杂志, 2024 , 44(5) : 387 -390 . DOI: 10.3760/cma.j.cn115259-20230602-00554

Abstract

Objective Applying item response theory (IRT) to analyze the quality of medical psychology course examination papers provides a reference for the quality of the evaluation of education and teaching. Methods In May 2022, we assessed the quality of 60 multiple-choice questions in the Medical Psychology test paper for 330 clinical medicine students in the class of 2016 at Shanxi Medical University. We tested the core assumptions of the IRT model and analyzed the model-data fit, as well as the item parameters of the test questions and the amount of information. Results The test data were consistent with the theoretical assumptions of IRT, and the model was well-fitted. The two-parameter logistic regression model was selected for parameter estimation. 59 (98.3%) of the test questions met the criteria for estimating the discrimination parameter, 54 (90.0%) of the test questions met the criteria for estimation of the difficulty parameter, 55 (91.7%) of the test questions were able to provide the minimum required amount of information(0.16), and 49 (81.7%) of the test questions were of satisfactory final quality, with the amount of information provided by the examination paper reaching 25. Conclusions The overall quality of the question papers was good, with the vast majority of the items being of high quality. However, it was necessary to modify or delete a small number of questions. This study can serve as a reference for the quantitative evaluation of examination papers in some university courses based on IRT.

参考文献

[1] 钟轶,季晓辉.两种教育测量理论在试卷质量控制和评价中的应用及其展望[J].南京医科大学学报(社会科学版),2013(1):66-71.DOI:10.7655/NYDXBSS20130118.
[2] 杜红飞.经典测量理论与项目反应理论的比较研究[J].社会心理科学,2006,21(6):15-17.
[3] 徐爽.基于项目反应理论的CET4阅读理解试题质量评价[J].考试研究,2018(3):27-31.
[4] 许志勇,丁树良,钟君.高考数学试卷多维项目反应理论的分析及应用[J].心理学探新,2013,33(5):438-443.DOI:10.3969/j.issn.1003-5184.2013.05.009.
[5] 赵守盈,何妃霞,陈维,等.Rasch模型在研究生入学考试质量分析中的应用[J].教育研究,2012(6):61-65.
[6] Han Y, Jiang Z, Ouyang J, et al. Psychometric evaluation of a national exam for clinical undergraduates[J].Frontiers in Medicine,2022,9:1037897.DOI: 10.3389/fmed.2022.1037897.
[7] 王晓华,文剑冰.项目反应理论在教育考试命题质量评价中的应用[J].教育科学,2010,26(3):20-26.DOI:10.3969/j.issn.1002-8064.2010.03.004.
[8] 赵守盈,石艳梅,朱丹.项目反应理论在大规模选拔性考试试题质量评价中的应用[J].教育学报,2013,9(1):71-77.DOI:10.14082/j.cnki.1673-1298.2013.01.002.
[9] 漆书青,周骏,张青华.用信息函数法对标准参照测验作质量分析[J].心理与行为研究,2003(1):34-39.
文章导航

/