Estimation of decision consistency in National Medical Licensing Examination medical comprehensive examination (2016-2020)

doi:10.3760/cma.j.cn115259-20220107-00026

Chinese Journal of Medical Education ›› 2022, Vol. 42 ›› Issue (8): 753-756.DOI: 10.3760/cma.j.cn115259-20220107-00026

Previous Articles Next Articles

Estimation of decision consistency in National Medical Licensing Examination medical comprehensive examination (2016-2020)

Feng Pan¹, Zhang Quanhui², Luo Huiqin³

¹Department of General Management, National Medical Examination Center, Beijing 100097, China;
²Department of Information and Research, National Medical Examination Center, Beijing 100097, China;
³Second Department of Item Development, National Medical Examination Center, Beijing 100097, China

Received:2022-01-07 Published:2022-08-01
Contact: Zhang Quanhui, Email: 41329968@qq.com

Abstract

Abstract: Decision consistency (DC) is a key index in National Medical Licensing Examination (NMLE) validation. In this study, W-DC method was used to estimate DC index of medical comprehensive examination during 2016 to 2020. The results show that the lowest value of DC index coefficient is 0.826 7 and the highest one is 0.970 9. Among all types of examinations, the biggest variation between years is present in public health assistant physician test (0.144 2). The consistency of decision-making in medical comprehensive examination is good on the whole, and the examinee's actual test score is close to the qualified score, which contribute to the low DC index coefficient of individual examination. Our result provides evidence to support the interpretation and application of NMLE scores.

Key words: Validation, Decision consistency, National Medical Licensing Examination

CLC Number:

Feng Pan, Zhang Quanhui, Luo Huiqin. Estimation of decision consistency in National Medical Licensing Examination medical comprehensive examination (2016-2020)[J]. Chinese Journal of Medical Education, 2022, 42(8): 753-756.

[1]	Li Guojian, Xiang Yang, He Ju, Liu Maowei, Han Chunmei, Xi Zheng, Zhang Dongqi. Framework construction and system design of clinical thinking ability assessment [J]. Chinese Journal of Medical Education, 2020, 40(7): 565-568.
[2]	Zhang Wenjuan, Zhang Saiyi, Wang Haifeng, Ding Yimin, Wen Jiyuan, Xuan Haihua. The exploration and research of management information construction of practical skills examination in ChineseNational Medical Licensing Examination [J]. Chinese Journal of Medical Education, 2020, 40(5): 387-391.
[3]	Lu Yan, Li Guojian, He Ju, Zhang Ying. Analysis of scoring accuracy of clinical thinking ability assessment [J]. Chinese Journal of Medical Education, 2020, 40(5): 392-396.
[4]	Lu Yan, Zhang Ying, He Ju, Zou Jiewen. The application of many facets Rasch model in the first stage clinical fundamental skills test of National Medical Licensing Examination phased examination [J]. Chinese Journal of Medical Education, 2020, 40(4): 311-315.
[5]	Feng Pan. Study on the evaluation of cognitive ability model of medical comprehensive written examination for National Medical Licensing Examination in rural general practitioners [J]. Chinese Journal of Medical Education, 2019, 39(6): 466-469.
[6]	Yang Fangli, He Jia. Analysis for the influencing factors of item difficult in China's National Medical Licensing Examination [J]. Chinese Journal of Medical Education, 2017, 37(2): 312-316.

Estimation of decision consistency in National Medical Licensing Examination medical comprehensive examination (2016-2020)

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 6

Recommended Articles

Metrics

Comments