Objective To evaluate the mastery of scoring standards by raters in 2018 clinical fundamental skills test of National Medical Licensing Examination phased the first stage,to explore the consistency between standardized patients (SP) and examiners' scores, and to provide more information for relevant research. Methods In 2018, based on the scores of communication capacity and humanistic care from 77 candidates in clinical fundamental skills test of the National Medical Licensing Examination phased the first stage in a randomly selected medical college, use the many facets Rasch model to calculate estimated ability of 77 candidates, analyze the internal consistency of raters and the leniency and strictness of evaluation. Results The results showed that the average estimated capacity of 77 candidates was 2.75 logits, and the most examinees' infit was less than 1.5.The average severity of the raters was -0.55, the severity of the examiners was -0.45, of the SP was -0.70,The difference was not statistically significant. Conclusions Raters have a good command of scoring standards, the overall standard is relatively loose.The scores of SP and examiners were consistent.
Lu Yan
,
Zhang Ying
,
He Ju
,
Zou Jiewen
. The application of many facets Rasch model in the first stage clinical fundamental skills test of National Medical Licensing Examination phased examination[J]. Chinese Journal of Medical Education, 2020
, 40(4)
: 311
-315
.
DOI: 10.3760/cma.j.cn115259-20190822-00679
[1] Harden RM, Stevenson M, Downie, WW, et al. Assessment of clinical competence using objective structured examination [J].BMJ,1975,1(5955):447-451. DOI:10.1136/bmj.1.5955.447.
[2] Boulet JR, McKinley DW, Whelan GP, et al. Quality assurance methods for performance-based assessments [J].Adv Health Sci Educ,2003,8(1):27-47. DOI:10.1023/A:1022639521218.
[3] Iramaneerat C, Iramaneerat C,Yudkowsky R,et al. Quality control of an OSCE using generalizability theory and many-faceted, rasch measurement [J].Adv Health Sci Educ,2008, 13(4):479-493. DOI:10.1007/s10459-007-9060-8.
[4]徐晓峰,刘勇.评分者内部一致性的研究和应用[J].心理科学,2007,30(5):1175-1178. DOI: 10.16719/j.cnki.1671-6981.2007.05.036.
[5]Cronbach LJ, Gleser GC, Rajaratnam N. Theory of generalizability: a liberalization of reliability theory[J]. Brit J Math Stat Psy,1963, 16(2):137-163. DOI: 10.1111/j.2044-8317.1963.tb00206.x
[6]孙晓敏,薛刚.多面Racsh模型在结构化面试中的应用[J].心理学报,2008,40(9):1030-1040. DOI: 10. 3724/SP. J. 1041. 2008. 01030.
[7] Linacre JM, Wright BD.Understand, rasch measurement: construction of measures from many-facet data [J]. J Appl Meas, 2002,3(4):486-512.
[8] Chalhoub-Deville M,Wigglesworth G. Rater judgment and English language speaking proficiency[J]. World English, 2005,24(3):383-391.
[9] Bonk WJ, Ockey GJ. A many-facet, rasch analysis of the second language group oral discussion task[J].Lang Test, 2003, 20 (1):89-110.DOI:10.1191/0265532203lt245oa.
[10]何莲珍, 闵尚超.写作测试的主要实证研究方法及其发展趋势[J].中国外语,2008 5(6):42-46.DOI: 10.13564/j.cnki.issn.1672-9382.2008.06.005.
[11] Du Y, Brown WL, Rogers C. Raters and single prompt-to-prompt equating using the FACETS model in a writing performance assessment [C].Chicago: ERIC press, 1997:2-24.
